LocalAI
by Open Source
OpenAI API-compatible local inference
FreeCompletely free to use with no credit card required.AdvancedWeb
Good for local AI
Free-plan details
Completely free and open-source (MIT)
Meet the toolllama.cpp
by Open Source (Georgi Gerganov)
The Launchpad take
Verdict
C/C++ LLM inference engine
Efficient local LLM inference; model quantization; embedded AI; research; foundation for other tools
Best for
ML engineersC/C++ developersembedded systems developersresearchersperformance optimizers
Quick facts
- Free tier
- Completely free and open-source (MIT)
- Starting price
- Free
- Platforms
- local
- Company
- Open Source (Georgi Gerganov)
Pricing
| Plan | Price | Key limits |
|---|---|---|
| Free | Free | None (hardware-limited) |
Key capabilities
Works with
- Text
- embeddings
Outputs
- Text generation
- embeddings
- API responses (server mode)
Get it
How to use llama.cpp on phones and tablets.
- Mobile web: Works in a mobile browser (responsive or dedicated mobile site).
Technical details
- Offline
- Yes
- API
- Yes
- Languages
- Multilingual (depends on model)
- Difficulty
- Advanced
- Privacy
- High
- Time to productivity
- 2 hours
- Upgrade when
- N/A (fully free)
- Integrations
- Foundation for Ollama, LM Studio, GPT4All; Python bindings; server mode (OpenAI-compatible)