MCP server and CLI for reading public web pages through resilient public routes.
View on GitHub ↗unlimited-search is a Python CLI and MCP server for reading public web content when a normal direct fetch is not enough. It combines platform public routes, browser-like HTTP identities, content fallbacks, public archive fallbacks, and media metadata extraction behind one local tool.
It is built for agents and automation that need usable text from public URLs. It is not intended to bypass logins, paywalls, CAPTCHA, private networks, account restrictions, IP bans, or access controls.
The command returns JSON with page content, a verdict, request metadata, and an attempt trace.
For MCP clients, install the package and register the stdio server:
Capability What it does --- --- Public platform routes Uses unauthenticated public APIs, feeds, or metadata routes before generic fetching. Browser-like fetching Tries multiple TLS/browser identities, URL variants, referer strategies, and response validation. Content fallbacks Recovers public text through Jina Reader, RSS/Atom discovery, and embedded page metadata. Archive fallbacks Falls back to Wayback and archive.today/archive.ph public snapshots when live reads fail. Media metadata Uses yt-dlp --dump-json for public media URLs without downloading media. MCP tools Exposes single-URL reads, batch reads, diagnostics, and media extraction to MCP clients.
See Platform coverage for the full support matrix and known gaps.
Flag Applies to Purpose --- --- --- --timeout SECONDS read, diagnose, media Set request timeout. --max-attempts N read, diagnose Limit generic HTTP-grid attempts. --max-content-chars N read Limit returned content s
From the project README.
Add the radar badge to your README — it shows your project was picked up by MCP Radar and links to this page:
[](https://mcp.liqiwa.com/s/flyingsquirrel0419--unlimited-search.html)
Search & apply to ~4,700 salary-transparent tech jobs across 7 countries (🇨🇭🇩🇪🇬🇧🇺🇸🇨🇦🇳🇱🇫🇷) from your terminal or AI agent — zero-dependency Python CLI + MCP server + Claude Code plugin
dheerajjha/mcp-migrateFind and fix what the MCP 2026-07-28 spec revision breaks in your server. 21 rules, 5 autofixers, and a readiness board.
mienetic/mnema🧠 Mnema — Long-term memory for AI via MCP × Vector DB. Pluggable backends, hybrid search, Auto Dream consolidation, CLI + REST API + SDK.
gokulnair2001/distillTurn any URL or HTML into clean, agent-ready Markdown — local, fast, deterministic. CLI + MCP server
sosoj92/jarvis-assistant-vocalAssistant vocal local en francais : Claude ou Ollama (offline), domotique Hue, OBS, agenda, navigateur, appels Twilio, serveur MCP. Python.
Riccardo8888/agent-linkAn end-to-end encrypted channel between coding agents, anywhere
The top new MCP servers of the week, every Monday. No spam, unsubscribe anytime.