Back to MCP Trust Indexm8ven
B
Emerging
89/100
2 days ago

MCPEval

MCP-based Agent Deep Evaluation System

→ SalesforceAIResearch/MCPEval· listed on github_code

Emerging. No concerning findings. Grades remain capped until the project builds reputation through adoption. Grades reflect the full trust pyramid: code, verification depth, and reputation. New projects cap at C until adoption is earned.

How we verified

Code Verified⚡ Live Monitored: not connected

Verified is a snapshot. Live keeps it current, and builds your track record.

⚡ Connect GitHub → continuous verification on every pushwhy connect →

Who stands behind it

SalesforceAIResearch

Source: github_code

Is this your MCP?

Claim it to get a verified publisher badge, a free copy of our full audit findings, and direct contact for any high-priority issues we find. Or connect your repo for our deepest verification, Live Monitored: read-only, revoke anytime. What we access →

⚡ Connect GitHub for Live Monitored

Install from

GitHub

M8ven verifies MCPs across every public registry — install directly from whichever one you prefer.

// key findings
🚨
Secret credentials may flow to a network call
1 flow detected: YELP_API_KEY. We can’t prove the destination matches the brand the credential belongs to.
🔐
You'll be asked for 8 credentials: FDA_API_KEY, PUBMED_API_KEY, BALLDONTLIE_API_KEY, SERPAPI_API_KEY, SERP_API_KEY, YELP_API_KEY, OPENAI_API_KEY, X_API_KEY
These are read from process.env at runtime. Make sure you trust where they’ll be sent.
// environment variables
To run this server yourself, you supply these values. They go in your own MCP client configuration and stay on your machine. The secret label means the value is sensitive, not that the server mishandles it.
configVERIFY_SSL
🔐 secretFDA_API_KEY
🔐 secretPUBMED_API_KEY
configMCP_TRANSPORT
🔐 secretBALLDONTLIE_API_KEY
🔐 secretSERPAPI_API_KEY[travel_assistant](mcp_servers/travel_assistant/) 6 Travel Flights, hotels, restaurants, local events. Requires , YELP_API_KEY.
🔐 secretSERP_API_KEY
🔐 secretYELP_API_KEY[travel_assistant](mcp_servers/travel_assistant/) 6 Travel Flights, hotels, restaurants, local events. Requires SERPAPI_API_KEY, .
configYOUTUBE_MOCK_MODE
🔐 secretOPENAI_API_KEYYOUR_OPENAI_API_KEY_HERE
configSFR_TLS_VERIFY
🔐 secretX_API_KEYcp .env.template .env # edit .env with your
configPROXY_PORT8008 uv run python server.py
configLOG_LEVEL
configMCPEVAL_DB_PATH
Deployment configuration, supplied by whoever hosts the server. Users are not asked for these.
deployPORT
// quality suggestions

Tool annotations

No tools have read-only/destructive annotations

Add readOnlyHint or destructiveHint annotations to every tool so hosts can warn users before invoking.

All four hints declared on every tool

94/94 tools missing one or more hints — search_books_by_title (missing: readOnlyHint, destructiveHint, idempotentHint, openWorldHint); search_authors_by_name (missing: readOnlyHint, destructiveHint, idempotentHint, openWorldHint); get_author_details (missing: readOnlyHint, destructiveHint, idempotentHint, openWorldHint), +91 more. OpenAI's directory rejects tools where any of the four hints are missing or non-boolean.

For every tool, set all four hints (readOnlyHint, destructiveHint, idempotentHint, openWorldHint) to explicit true/false values that match the handler’s actual behaviour.

Tool test coverage

Only 1/94 tools referenced in tests (1%)

Write tests that reference each tool by name so every tool has at least one test.

Secrets not logged

8 secret values sent to console.log

Redact or omit secret values from log output.

Claim the listing to review these findings one by one and send us a correction where you disagree, straight to the team. Claiming also means we tell you when the grade moves, and reach you first if we find anything urgent.

// full audit trail
The findings above are the summary. The full trail, every check we ran, each deduction, the network hosts observed and the dependency advisories, goes to verified publishers, along with an alert whenever a new one lands. Verified publishers can also review each finding and dispute it in one click. Publisher corrections have sharpened several of our checks this month, because the maintainer knows the codebase better than any scanner.
// improvement guidance — verified publishers only
We have 4 concrete improvements we can share with the publisher of this MCP. Each comes with specific guidance to raise the trust score.
// embed badge in your README
[![M8ven Score](https://m8ven.ai/badge/mcp/salesforceairesearch-mcpeval-iy2anh)](https://m8ven.ai/mcp/salesforceairesearch-mcpeval-iy2anh)
Shows your grade and updates automatically. Prefer no grade? Append ?variant=verified to the badge URL.
commit: 70e1f903175a255c2967615914240f60d4d12a50
code hash: 6a9f0f5f6811a4397c054ec7350345d7b4bcccad1327de9e6303fffe1fa376ba
verified: 8/16/2026, 6:52:39 PM
view raw JSON →
Check MCPs from inside your assistant
Tool Check · MCP

Vetting this one by hand? Tool Check is an MCP that scores other MCPs. Add it once and ask Claude, ChatGPT, or any MCP client to grade a server, surface CVEs, check the publisher, and suggest safer alternatives — before you install.

https://m8ven.ai/api/mcp/tool-check
check_toolsearch_toolscompare_toolsrecommend_alternativescheck_publisherreport_concern
How to add it →Free · no account needed · works in any MCP client