74
grade C
3 days ago
glama

robotstxt-ai-mcp

Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.

Install from

M8ven verifies MCPs across every public registry — install directly from whichever one you prefer.

// key findings
⚠️
Known vulnerabilities in dependencies: 1 high
Affects packages this MCP installs at runtime. Upgrade or remove the affected dependency.
No credential exfiltration, no sensitive file access, no obfuscation
Static analysis found nothing flowing your secrets to unexpected places.
Open source with a license and README
Anyone can audit the code, the license is declared, and the publisher documents what it does.
// full audit trail
The full breakdown of what we checked, the deductions that landed, the network hosts, the dependency advisories, and concrete fix guidance is available to verified publishers.
// improvement guidance — verified publishers only
We have 6 concrete improvements we can share with the publisher of this MCP. Each comes with specific guidance to raise the trust score.
// embed badge in your README
[![M8ven Score](https://m8ven.ai/badge/mcp/sharozdawa-robotstxt-ai-1bjk02)](https://m8ven.ai/mcp/sharozdawa-robotstxt-ai-1bjk02)
commit: 0df01d5b7d4b9e6b2b139b602fc08fc58a4848fb
code hash: 4e7fab667aee630b76f1a689b09d21e706ce1fb5e094df67b2f8fe52f08447f5
verified: 4/18/2026, 3:48:30 PM
view raw JSON →