LLM Inference and Serving

Search every project in one place

Press / to search. Tap a tag to filter. Click any row for details.

Filtering for

Row number					Tags
1	sglang LLM Inference and Serving	336,283,301	31,974	2026-08-18	LLM Inference and Serving AI and Agents AI & ML	→
	A high-performance serving framework for large language models and multimodal models.
	sgl-project/github.com/sgl-project/sglang /2026-08-18 /336,283,301 downloads/month
2	vllm LLM Inference and Serving	4,883,924	89,278	2026-08-18	LLM Inference and Serving AI and Agents AI & ML	→
	A high-throughput and memory-efficient inference and serving engine for LLMs.
	vllm-project/github.com/vllm-project/vllm /2026-08-18 /4,883,924 downloads/month
3	mlx-lm LLM Inference and Serving	1,304,112	6,671	2026-08-17	LLM Inference and Serving AI and Agents AI & ML	→
	Run and fine-tune large language models on Apple Silicon with MLX.
	ml-explore/github.com/ml-explore/mlx-lm /2026-08-17 /1,304,112 downloads/month

Contribute

Know a project that belongs here?

Tell us what it does and why it stands out.

Submit a project Star the repository