Small Language Models Are the New Rage

Researchers Say Larger models can pull off a wider variety of feats, but the reduced footprint of smaller models makes them attractive tools.

Google reportedly spent $191 million. Large language models (LLMs) also require considerable computational power each time they answer a request, which makes them notorious energy hogs. A single query to ChatGPT consumes about 10 times as much energy as a single Google search, according to the Electric Power Research Institute.

Stephen Ornes