74
/ 100
1 month ago
glama

TheCrawler

Open-source web scraper and extraction MCP server with JavaScript rendering, markdown output, PDF/DOCX parsing, structured errors, and validated extraction contract diagnostics for agents.

Is this your MCP?

Claim it to get a verified publisher badge, a free copy of our full audit findings, and direct contact for any high-priority issues we find.

Install from

M8ven verifies MCPs across every public registry — install directly from whichever one you prefer.

// key findings
No credential exfiltration, no sensitive file access, no obfuscation
Static analysis found nothing flowing your secrets to unexpected places.
Open source with a license and README
Anyone can audit the code, the license is declared, and the publisher documents what it does.
🔐
You'll be asked for 2 credentials: THECRAWLER_API_KEY, THECRAWLER_LLM_API_KEY
These are read from process.env at runtime. Make sure you trust where they’ll be sent.
// required environment variables
This server reads these from process.env. You'll be asked to provide them before it can run.
configCRAWLEE_LOG_LEVEL
🔐 secretTHECRAWLER_API_KEYlocal_test_key node dist/server.js --port 3000
🔐 secretTHECRAWLER_LLM_API_KEYSet as an Actor environment variable so the LLM key never lands in run inputs (visible in run history).
configTHECRAWLER_LLM_BASEURL
configTHECRAWLER_LLM_MODEL
// full audit trail
The full breakdown of what we checked, the deductions that landed, the network hosts, the dependency advisories, and concrete fix guidance is available to verified publishers.
// improvement guidance — verified publishers only
We have 4 concrete improvements we can share with the publisher of this MCP. Each comes with specific guidance to raise the trust score.
// embed badge in your README
[![M8ven Score](https://m8ven.ai/badge/mcp/manchittlab-thecrawler-gn07f2)](https://m8ven.ai/mcp/manchittlab-thecrawler-gn07f2)
commit: fb621a950828204ccc90aa9af617e75623fd1474
code hash: d6395c59d56a9fc316ba60b24eb17a914198f6a80aceb9c7d901a2ae2082606f
verified: 6/11/2026, 11:51:43 AM
view raw JSON →