Skip to content
HUBURB
Artificial IntelligenceMaturity: Scaling

Foundation Models

Large models trained on broad data that can be adapted to many downstream tasks rather than being built for one purpose.

Why does it matter?

They turned machine learning from a bespoke engineering project into something closer to a utility. That shift is what makes almost every other AI category on this page possible.

How does it work?

Models are pre-trained on very large corpora, then refined with supervised and preference-based tuning. Adaptation happens through prompting, retrieval or lightweight fine-tuning.

Where is it today?

Capability gains are now coming as much from post-training, tool use and inference-time compute as from raw parameter count. Open-weight models trail the frontier but close the gap for many tasks.

Applications

  • · Assistants
  • · Code generation
  • · Document understanding
  • · Scientific modelling

Key challenges

  • · Training cost and energy use
  • · Data provenance and licensing
  • · Evaluation beyond benchmark scores

Advantages

  • · General purpose
  • · Rapid adaptation
  • · Strong developer ecosystem

Infrastructure required

Large GPU clusters, high-bandwidth interconnect and substantial power capacity.

Companies working on it

Recent developments

Huburb timeline

  1. Inference router claims large cost reduction by matching model to task

  2. Open-weight models narrow the gap on tool-use benchmarks

Related technologies