F
Warning
31/100
11 days ago

s18

Introducing s18 — an open-source agent runtime & orchestration framework for real AI systems. ⚡ Multi-agent workflows ⚡ Real-time streaming state ⚡ Scheduling + automation ⚡ MCP tool integrations ⚡ Local-first or cloud models ⚡ Observability built in

Warning. Serious findings were identified. Review the full report before connecting. Grades reflect the full trust pyramid: code, verification depth, and reputation. New projects cap at C until adoption is earned.

How we verified

⚡ Live Monitored: not connected

Verified is a snapshot. Live keeps it current, and builds your track record.

⚡ Connect GitHub → continuous verification on every pushwhy connect →

Who stands behind it

riteshverma

Source: github_code

Is this your MCP?

Claim it to get a verified publisher badge, a free copy of our full audit findings, and direct contact for any high-priority issues we find. Or connect your repo for our deepest verification, Live Monitored: read-only, revoke anytime. What we access →

Install from

M8ven verifies MCPs across every public registry — install directly from whichever one you prefer.

// key findings
⚠️
Tool descriptions don’t match what handlers do
1 tool describes read intent but its handler mutates — keyword_search (line 1096: result = subprocess.run(cmd, capture_output=True, text=True))
No credential exfiltration, no sensitive file access, no obfuscation
Static analysis found nothing flowing your secrets to unexpected places.
Open source with a license and README
Anyone can audit the code, the license is declared, and the publisher documents what it does.
🔐
You'll be asked for 4 credentials: GEMINI_API_KEY, AZURE_OPENAI_API_KEY, LLAMA_CPP_API_KEY, GOOGLE_API_KEY
These are read from process.env at runtime. Make sure you trust where they’ll be sent.
// environment variables
To run this server yourself, you supply these values. They go in your own MCP client configuration and stay on your machine. The secret label means the value is sensitive, not that the server mishandles it.
🔐 secretGEMINI_API_KEY
configAZURE_OPENAI_ENDPOINT
configOPENAI_API_VERSION
🔐 secretAZURE_OPENAI_API_KEY
🔐 secretLLAMA_CPP_API_KEY
configEXTERNAL_MOCKEHR_BASE_URL
configWISE_MOCKEHR_BASE_URL
configMOCKEHR_PRIMARY_SOURCE_LABEL
configMOCKEHR_HTTP_TIMEOUT_SECONDS
configAZURE_OPENAI_CHAT_DEPLOYMENT
configS18_SESSION_SUMMARY_SYNC
configS18_WORKSPACE_ROOT
configS18_PROFILE
configOLLAMA_BASE_URL
configOLLAMA_TIMEOUT
configLLAMA_CPP_BASE_URL
configLLAMA_CPP_TIMEOUT
configRUN_POLL_TIMEOUT_SECONDS
configMCP_TOOL_TIMEOUT_SECONDS
configMCP_MODE
configMCP_STARTUP_TIMEOUT_SECONDS
configMCP_STDIO_CONNECT_TIMEOUT_SECONDS
configMCP_REQUIRED_SERVERS
configSCHEDULER_TIMEZONE
configAZURE_OPENAI_EMBEDDING_DEPLOYMENT
configAUTH_ENABLED
configSUPABASE_JWT_AUDIENCE
configSUPABASE_LOGGING_ENABLED
configTENANCY_DEFAULT_TENANT_ID
configTENANCY_DEFAULT_TIER
configTENANCY_DEFAULT_DATA_REGION
configTENANCY_GROWTH_ROUTING_ENABLED
configS18_MODEL_PROVIDER
configAGENT_MODEL_PROVIDER
configS18_FORCE_GEMINI
configCELERY_BROKER_URL
configCELERY_RESULT_BACKEND
configS18_CELERY_RUNS_QUEUE
configS18_CELERY_INGEST_QUEUE
configS18_CELERY_TIMEZONE
configS18_CELERY_PREFETCH_MULTIPLIER
configAWS_REGION
configBEDROCK_EMBEDDING_MODEL_ID
configGOOGLE_CLOUD_PROJECT
configVERTEX_AI_LOCATION
configVERTEX_AI_EMBEDDING_MODEL
configVERTEX_AI_EMBEDDING_DIMENSION
configGEMINI_EMBEDDING_MODEL
configGEMINI_EMBEDDING_DIMENSION
configS18_FAISS_GPU_DEVICE
configS18_FAISS_GPU_MIN_VECTORS
configS18_RUN_EXECUTOR
configS18_HARNESS_STATE_DIR
configGEMINI_STATUS_EXPOSE_KEY_PREVIEW
🔐 secretGOOGLE_API_KEY
configCLAWBENCH_USE_OLLAMA
configCLAWBENCH_S18_MAX_STEPS
configCLAWBENCH_S18_MAX_LIFELINES
configCLAWBENCH_S18_MCP_MODE
configCLAWBENCH_OLLAMA_WAIT_SECONDS
configCLAWBENCH_OLLAMA_WARMUP_ATTEMPTS
configCLAWBENCH_KEEP_WORKSPACES
configAZURE_STORAGE_ACCOUNT
configAZURE_STORAGE_CONTAINER
configS3_BUCKET
configS3_KMS_KEY_ID
configGCS_BUCKET
configAZURE_SEARCH_ENDPOINT
configOPENSEARCH_ENDPOINT
configVERTEX_AI_INDEX_ENDPOINT_ID
configVERTEX_AI_DEPLOYED_INDEX_ID
configVERTEX_AI_INDEX_ID
Deployment configuration, supplied by whoever hosts the server. Users are not asked for these.
deploySUPABASE_ANON_KEY
deploySUPABASE_SERVICE_ROLE_KEY
deploySUPABASE_URL
// quality suggestions

Tool annotations

No tools have read-only/destructive annotations

Add readOnlyHint or destructiveHint annotations to every tool so hosts can warn users before invoking.

All four hints declared on every tool

21/21 tools missing one or more hints — dynamic_tool_378 (missing: readOnlyHint, destructiveHint, idempotentHint, openWorldHint); ping (missing: readOnlyHint, destructiveHint, idempotentHint, openWorldHint); web_search (missing: readOnlyHint, destructiveHint, idempotentHint, openWorldHint), +18 more. OpenAI's directory rejects tools where any of the four hints are missing or non-boolean.

For every tool, set all four hints (readOnlyHint, destructiveHint, idempotentHint, openWorldHint) to explicit true/false values that match the handler’s actual behaviour.

Destructive tools are labelled

1 tool perform destructive updates without destructiveHint — reindex_documents deletes at line 2164 (path.unlink())

Add destructiveHint:true to any tool whose handler calls .delete(), .upsert(), .update(), unlink, rm, DELETE, DROP, REPLACE INTO, or any operation that overwrites existing data.

Descriptions match behaviour

1 tool describes read intent but its handler mutates — keyword_search (line 1096: result = subprocess.run(cmd, capture_output=True, text=True))

Rename the tool, rewrite the description, or move the side-effect into a separate clearly-named tool.

Tool inputs are validated

17/20 tool handlers declare input schemas (85%)

Declare an inputSchema with zod/joi/yup on every tool definition.

Tool handlers catch errors

15/20 tool handlers wrap calls in try/catch (75%)

Wrap each tool handler body in try/catch and return a structured error response.

Tests exist

No test files found

Add tests that exercise each declared tool.

Shell command execution

1 child_process call — runs shell commands

Prefer library functions over shell-outs. If you must shell out, ensure all inputs are properly escaped.

Tool description accuracy

keyword_search: description implies read-only but handler writes/deletes/executes

Update tool descriptions to accurately reflect all capabilities — especially write, delete, or execute operations.

Claim the listing to review these findings one by one and send us a correction where you disagree, straight to the team. Claiming also means we tell you when the grade moves, and reach you first if we find anything urgent.

// full audit trail
The findings above are the summary. The full trail, every check we ran, each deduction, the network hosts observed and the dependency advisories, goes to verified publishers, along with an alert whenever a new one lands. Verified publishers can also review each finding and dispute it in one click. Publisher corrections have sharpened several of our checks this month, because the maintainer knows the codebase better than any scanner.
// improvement guidance — verified publishers only
We have 9 concrete improvements we can share with the publisher of this MCP. Each comes with specific guidance to raise the trust score.
// embed badge in your README
[![M8ven Verified](https://m8ven.ai/badge/mcp/riteshverma-s18-wxod2f?variant=verified)](https://m8ven.ai/mcp/riteshverma-s18-wxod2f)
Shows verification status without the grade. Want the grade badge instead? Remove ?variant=verified from the URL.
commit: d5d71ccc636880ed3c8abbe61b667467b9a93ba0
code hash: 46a793416a868f86ad417be71d7b3cdfc17dc1bc4ec5621c76958fe492405a99
verified: 8/8/2026, 8:04:32 AM
view raw JSON →
Check MCPs from inside your assistant
Tool Check · MCP

Vetting this one by hand? Tool Check is an MCP that scores other MCPs. Add it once and ask Claude, ChatGPT, or any MCP client to grade a server, surface CVEs, check the publisher, and suggest safer alternatives — before you install.

https://m8ven.ai/api/mcp/tool-check
check_toolsearch_toolscompare_toolsrecommend_alternativescheck_publisherreport_concern
How to add it →Free · no account needed · works in any MCP client