Exo
Exo: Run an AI cluster at home using your devices! Distribute AI workloads across phones, laptops, and more.
About Exo
Exo allows you to create a personal AI cluster from your existing devices like phones, laptops, and Raspberry Pis. It distributes AI workloads across these devices, letting you run larger models than would be possible on a single machine. Exo aims to simplify distributed inference by providing features like automatic device discovery and dynamic model partitioning, allowing users to leverage the combined power of their available hardware. It is maintained by exo labs.Key Features
- Automatic Device Discovery
- Dynamic Model Partitioning
- ChatGPT-compatible API
- Peer-to-Peer Architecture
- Wide Model Support (LLaMA, Mistral, etc.)