Frameworks

Search every project in one place

Press / to search. Tap a tag to filter. Click any row for details.

Filtering for

Row number				Tags
1	browser-use Frameworks	108,095	2026-08-06	Frameworks Web Scraping HTTP & Scraping	→
	Make websites accessible for AI agents with easy browser automation.
	browser-use/github.com/browser-use/browser-use /2026-08-06
2	crawl4ai Frameworks	77,038	2026-07-15	Frameworks Web Scraping HTTP & Scraping	→
	An open-source, LLM-friendly web crawler that provides lightning-fast, structured data extraction specifically designed for AI agents.
	unclecode/github.com/unclecode/crawl4ai /2026-07-15
3	scrapy Frameworks	63,678	2026-08-06	Frameworks Web Scraping HTTP & Scraping	→
	A fast high-level screen scraping and web crawling framework.
	scrapy/github.com/scrapy/scrapy /2026-08-06
4	mechanicalsoup Frameworks	4,882	2026-07-29	Frameworks Web Scraping HTTP & Scraping	→
	A Python library for automating interaction with websites.
	MechanicalSoup/github.com/MechanicalSoup/MechanicalSoup /2026-07-29
5	website-downloader Frameworks	167	2026-07-28	Frameworks Web Scraping HTTP & Scraping	→
	A modern wget --mirror / HTTrack alternative that turns whole websites into browsable offline copies.
	PKHarsimran/github.com/PKHarsimran/website-downloader /2026-07-28
6	crawlberg Frameworks	152	2026-08-06	Frameworks Web Scraping HTTP & Scraping	→
	A high-performance web crawling engine with a Rust core, headless-browser fallback, and built-in robots.txt and sitemap parsing.
	xberg-io/github.com/xberg-io/crawlberg /2026-08-06

Contribute

Know a project that belongs here?

Tell us what it does and why it stands out.

Submit a project Star the repository