crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf

86.4k
Stars
+2.1k
Gained
2.5%
Growth
Python
Language

🎭 Best For

⚖️ Compare With

🏷️ Topics & Ecosystem

ai ai-agents crawler data-extraction llm markdown mcp open-source playwright python rag scraper web-crawler web-crawling web-scraping

📊 Activity

Latest commit: 2026-10-26. Over the past 33 days, this repository gained 2.1k stars (+2.5% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.