Local LLM Inference

Listed in editorial order. Click a column header to re-sort the whole list.

Press / to search. Tags open their category. Click a row for details.

Row number					Tags
1	ollama Local LLM Inference	13,419,321	10,632	2026-10-16	Local LLM Inference AI and Agents AI & ML
	Python client for Ollama, which downloads and runs open-weight LLMs locally.
	ollama/github.com/ollama/ollama-python /10,632 stars /2026-10-16
2	llama-cpp-python Local LLM Inference	616,599	10,658	2026-10-01	Local LLM Inference AI and Agents AI & ML
	Python bindings for llama.cpp, for running GGUF models locally.
	abetlen/github.com/abetlen/llama-cpp-python /10,658 stars /2026-10-01
3	mlx-lm Local LLM Inference	604,400	7,475	2026-10-24	Local LLM Inference AI and Agents AI & ML
	Run and fine-tune large language models on Apple Silicon with MLX.
	ml-explore/github.com/ml-explore/mlx-lm /7,475 stars /2026-10-24

Contribute

Know a project that belongs here?

Tell us what it does and why it stands out.

Submit a project Star the repository