Hardware-adaptive local LLM & cloud cascading gateway. Sub-5ms intelligent routing, 3-token lookahead failover, asymmetric verification, 1-click IDE config, and MCP for $0 token cost.
CascadeGateway ⚡ Hardware-Adaptive Local LLM & Cloud Cascading Architecture
CascadeGateway is an intelligent, hardware-adaptive cascading proxy that routes AI queries between local GPUs (via Ollama at $0 token cost) and frontier cloud models (Google Gemini, OpenAI, etc.).
It automatically detects your GPU hardware and physical VRAM on startup—whether running a flagship RTX 5090 (32GB), RTX 4090 (24GB), mainstream RTX 3080 (10GB), or Apple Silicon—and dynamically selects and sizes the optimal models without requiring manual reconfiguration.
🖥️ Always-On-Top Desktop HUD: Sleek, frameless, draggable obsidian overlay (0b0f19) that sits above your IDEs next to the clock or anywhere on screen. Displays live routing decisions (🟢 Local Builder, 🟣 Local Architect, 🔵 Asymmetric Verify, 🟠 Gemini Cloud), real-time VRAM gauge (GB, %, °C, W), decision latency (sub-5ms), prompt snippet, dollar savings counter, pin toggle, compact mini-mode, and 1-click mode switcher buttons. 🧠 Local GPU Architectural Reasoning: True multi-model orchestration on local silicon. System design, race condition, thread safety, and algorithmic queries are dispatched directly to the local reasoning model (deepseek-r1:14b or gemma4:26b) on the RTX 5090 rather than escaping to cloud tokens. Routine code generation is routed to qwen2.5-coder:32b. Hardware-Adaptive VRAM Sizing: Automatically profiles your GPU (nvidia-smi / Metal / CPU) and assigns the optimal model tier. Autonomous $0 Offload: Resolves 85–95% of routine coding, unit tests, refactoring, and QA directly on local VRAM. Dynamic Token Biasing Engine: A
From the project README.
Add the radar badge to your README — it shows your project was picked up by MCP Radar and links to this page:
[](https://mcp.liqiwa.com/s/jadberro--CascadeGateway.html)
dMoERA Creator Studio MCP Server: build, backtest, and deploy crypto trading strategies via AI agents
Alpha-Park/genpark-jev-typed-state-action-router-mcpNative Model Context Protocol (MCP) server providing typed state-action schema arbitration, deterministic action dispatch, and token-saving pre-escalation filters.
alphaparkinc/genpark-meta-muse-episodic-memory-graph-mcpNative Model Context Protocol (MCP) server fusing Meta ambient multimodal perception with Muse continuous episodic memory streams and Ebbinghaus recency decay.
alphaparkinc/genpark-jev-typed-state-action-router-mcpNative Model Context Protocol (MCP) server providing typed state-action schema arbitration, deterministic action dispatch, and token-saving pre-escalation filters.
Alpha-Park/genpark-meta-muse-episodic-memory-graph-mcpNative Model Context Protocol (MCP) server fusing Meta ambient multimodal perception with Muse continuous episodic memory streams and Ebbinghaus recency decay.
alphaparkinc/genpark-instinct-proactive-intent-reflex-skillInstinct AI-inspired zero-prompt proactive personal agent detecting user attention cues, computing intent probabilities, and executing guarded dry-run actions.
The top new MCP servers of the week, every Monday. No spam, unsubscribe anytime.