mcp-evals

GitHub Action for evaluating MCP server tool calls using LLM-based scoring

→ mclenhard/mcp-evals· npm: mcp-evals· listed on npm

Is this your MCP?

Claim it to get a verified publisher badge, a free copy of our full audit findings, and direct contact for any high-priority issues we find.

Install from

npm

M8ven verifies MCPs across every public registry — install directly from whichever one you prefer.

// key findings

⚠️

Known vulnerabilities in dependencies: 4 high

Affects packages this MCP installs at runtime. Upgrade or remove the affected dependency.

⚠️

Tests do not pass

Either the test suite is broken or the code regressed. Either way the published behaviour can’t be verified by the publisher’s own tests.

✅

No credential exfiltration, no sensitive file access, no obfuscation

Static analysis found nothing flowing your secrets to unexpected places.

✅

Open source with a license and README

Anyone can audit the code, the license is declared, and the publisher documents what it does.

🔐

You'll be asked for 2 credentials: ANTHROPIC_API_KEY, OPENAI_API_KEY

These are read from process.env at runtime. Make sure you trust where they’ll be sent.

// required environment variables

This server reads these from process.env. You'll be asked to provide them before it can run.

🔐 secretANTHROPIC_API_KEY— Your Anthropic API key (required for Anthropic models)

🔐 secretOPENAI_API_KEY— openai_api_key: ${{ secrets. }}

// full audit trail

The full breakdown of what we checked, the deductions that landed, the network hosts, the dependency advisories, and concrete fix guidance is available to verified publishers.

// improvement guidance — verified publishers only

We have 5 concrete improvements we can share with the publisher of this MCP. Each comes with specific guidance to raise the trust score.

// embed badge in your README

[![M8ven Score](https://m8ven.ai/badge/mcp/mcp-evals-1d5r2k)](https://m8ven.ai/mcp/mcp-evals-1d5r2k)

commit: 97379638792b2b66bb3278493e2e495501ede39e

code hash: 19fedd4b461a331c43d34bc5f6fe73c4154a9005e708b331eb66c62a08d9462c

verified: 6/16/2026, 12:16:38 PM

view raw JSON →