Minions: where local and cloud LLMs meet
- LLMs: 3 events in the last 90 days
What happened
Avanika Narayan, Dan Biderman, and Sabri Eyuboglu from Christopher Ré's Stanford Hazy Research lab, along with Avner May, Scott Linderman, James Zou, have developed a way to shift a substantial portion of LLM workloads to consumer devices by having small on-device models (such as Llama 3.2 with Ollama) collaborate with larger models in the cloud (such as GPT-4o).
Summary assembled by rule from the sources below
Why it's spreading
- ConfirmedOllama Blog published a first-party announcement
Timeline
- First appeared on Ollama BlogOllama Blog
Sources
Official
- Minions: where local and cloud LLMs meetOllama Blog