Language models with significantly fewer parameters than frontier models, designed for efficiency, speed, and deployment on resource-constrained devices.
Overview
- [Industry analysis] Andrej Karpathy predicted that AI intelligences will undergo ‘speciation,’ where smaller models with a cognitive core are specialized for specific tasks, reducing the need for a single oracle that knows everything. (Source: Andrej Karpathy, via AI Daily Brief, 2026-08-24)