Best Local & open-source LLMs tools: Run AI models privately on your own PC
Local & open-source LLMs
Ranked by an evidence score built from public, verifiable facts (pricing, free tier, docs, platforms, open source, update activity). Hands-on testing is coming. How we test.
Top 3
#1
Jan
Open-source desktop ChatGPT alternative that runs models offline.
Free tier Open source 100/100 · evidence
#2
llama.cpp
C/C++ LLM inference engine behind many local tools.
Free tier Open source 95/100 · evidence
#3
Ollama
Run open LLMs locally with one command.
Free tier Open source 85/100 · evidence
Budget pick
Open WebUI
Self-hosted ChatGPT-style UI for Ollama and APIs.
Free tier Open source 85/100 · evidence
Local / open-source pick
Jan
Open-source desktop ChatGPT alternative that runs models offline.
Free tier Open source 100/100 · evidence
Comparison
| Tool | Pricing | Free tier | Score |
|---|---|---|---|
| Jan | Free, open source | Yes | 100 |
| llama.cpp | Free, open source | Yes | 95 |
| Ollama | Free, open source | Yes | 85 |
| Open WebUI | Free, open source | Yes | 85 |
| LM Studio | Free | Yes | 70 |