AI-augmented Playwright + pytest framework for testing MCP servers and UI flows, with optional self-healing, visual triage, fuzzing, and flaky-test analysis.
MCP Test Framework (Playwright + Python + AI)
An AI-augmented test automation framework for Model Context Protocol (MCP) servers and any UI in front of them, built on Playwright (Python) and pytest.
It gives you two things at once: 1. A normal, deterministic test framework (page objects, fixtures, MCP client, reporting) that works with zero AI dependency. 2. A set of opt-in AI modules (ai/) that plug into that framework to reduce maintenance burden and catch things static assertions miss — self-healing locators, visual regression triage, MCP fuzzing, flaky-test root-causing, and more.
Every AI feature is behind a flag in .env / config/settings.py and degrades gracefully (raises a clear error or skips) if ANTHROPICAPIKEY isn't set — the core suite never depends on AI to run.
Out of the box, tests/mcp/ runs against the bundled examples/demoserver.py (a ~40-line FastMCP server with example tools, a resource, and a prompt), so make test-mcp is green on a fresh clone with no external setup. To test your real server, point MCPSERVERCOMMAND / MCPSERVERARGS (or the mcpserver block in config/environments.yaml) at it — a python/python3 command is automatically resolved to the interpreter running pytest, so the server sees the same virtualenv.
TESTENV=staging pytest switches which block of config/environments.yaml is loaded.
By default, the UI examples point at https://rahulshettyacademy.com/practice. If you want to override it for local experimentation, set BASEURL before running pytest.
From the project README.
Add the radar badge to your README — it shows your project was picked up by MCP Radar and links to this page:
[](https://mcp.liqiwa.com/s/vidhyampp--MCP-Test-Framework.html)
Stop your AI from making things up — it proposes, deterministic tools decide, every claim checked against ground truth with evidence. Grounded facts and context survive resets. Reverse engineering is
zhuyansen/new-term-radarDaily radar for new AI terms: names of new models, products and repos, caught on X, Hugging Face, GitHub and sitemaps before keyword tools list them.
yzg1226/mcd-party-officer🍟 麦当劳门店派对成团调度 Skill — 把派对从「策划」推进到「办得成」：成团概率雷达 / 包场vs拼团 / 择日黄历 / 儿童营养指数 / 招募卡与邀请函
fellowgeek/mcp-memoryAn OKF-backed Model Context Protocol (MCP) server delivering persistent long-term memory and SQLite FTS5 search for AI agents.
hirotomasato/yowesGenerate realistic teacher documents (ID cards, licenses, letters) for 13 countries via MCP.
hujjun/mcd-saver-strategist麦当劳省钱点餐助手（麦门精算师）｜麦当劳优惠券组合优化 Skill：拉取麦当劳菜单与全部可用优惠券，算出最省的点餐组合，巨无霸套餐 ¥47 → ¥21.9（省 53%）。McDonalds MCP（麦当劳 MCP）coupon optimizer · McDonalds China MCP Server · Agent Skill for WorkBuddy · 麦当劳程序员创意开发大赛参赛作品
The top new MCP servers of the week, every Monday. No spam, unsubscribe anytime.