MCP server and CLI that crawls websites for AI agents: finds the answer page 2x more often than Crawl4AI, 10x cheaper per answer than letting Claude crawl.
ForkPoint/agent-lighthouseLighthouse-style audits for AI-agent readiness, LLM crawlers, MCP clients, and the agentic web
SanggonBoy/PyreCrawlWeb browsing superpowers for AI agents - one MCP server to scrape, crawl, extract, map, search, batch, research & monitor the web. Self-hosted, no API keys. Free Firecrawl alternative.
houtini-ai/seo-auditThe complete technical SEO audit at conversation speed - Search Console + private crawl + DataForSEO merged into one prioritised, fix-writing audit inside Claude (MCP)
pinkpixel-dev/pulpie-mcpMCP server that turns web pages into clean Markdown, keeping tables, code blocks, and images intact. Agents can fetch pages, save docs to your project or a global library, and crawl whole doc sites.