48
/ 100
1 month ago
github_topic

sample-genai-on-eks-starter-kitβœ“ Official

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: πŸš€ AI Gateway (LiteLLM) πŸ€– LLM Serving (vLLM, SGLang, Ollama) πŸ“Š Vector Databases, πŸ” Embedding Models (TEI) πŸ“ˆ Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

Is this your MCP?

Claim it to get a verified publisher badge, a free copy of our full audit findings, and direct contact for any high-priority issues we find.

Install from

M8ven verifies MCPs across every public registry β€” install directly from whichever one you prefer.

// key findings
βœ…
No credential exfiltration, no sensitive file access, no obfuscation
Static analysis found nothing flowing your secrets to unexpected places.
βœ…
Open source with a license and README
Anyone can audit the code, the license is declared, and the publisher documents what it does.
πŸ”
You'll be asked for 8 credentials: BRIDGE_AUTH_TOKEN, HF_TOKEN, LITELLM_API_KEY, LITELLM_UI_PASSWORD, MLFLOW_PASSWORD, OPENAI_API_KEY, OPENWEBUI_ADMIN_PASSWORD, PHOENIX_API_KEY
These are read from process.env at runtime. Make sure you trust where they’ll be sent.
// required environment variables
This server reads these from process.env. You'll be asked to provide them before it can run.
configAWS_REGION
πŸ” secretBRIDGE_AUTH_TOKEN
configDOMAINβ€” ? Enter value for :
configEKS_CLUSTER_NAMEβ€” βœ” Enter value for : genai-on-eks
configEKS_MODEβ€” EKS mode, auto (default) or standard
πŸ” secretHF_TOKENβ€” Hugging Face [user access token](https://huggingface.co/docs/hub/en/security-tokens)
πŸ” secretLITELLM_API_KEY
configLITELLM_BASE_URL
configLITELLM_MODEL_NAME
πŸ” secretLITELLM_UI_PASSWORD
configLITELLM_UI_USERNAME
πŸ” secretMLFLOW_PASSWORD
configMLFLOW_USERNAME
πŸ” secretOPENAI_API_KEY
configOPENWEBUI_ADMIN_EMAIL
πŸ” secretOPENWEBUI_ADMIN_PASSWORD
πŸ” secretPHOENIX_API_KEY
configPLATFORM
configREGIONβ€” βœ” Enter value for : us-west-2
// full audit trail
The full breakdown of what we checked, the deductions that landed, the network hosts, the dependency advisories, and concrete fix guidance is available to verified publishers.
// improvement guidance β€” verified publishers only
We have 1 concrete improvement we can share with the publisher of this MCP. Each comes with specific guidance to raise the trust score.
// embed badge in your README
[![M8ven Score](https://m8ven.ai/badge/mcp/aws-samples-sample-genai-on-eks-starter-kit-h48zwo)](https://m8ven.ai/mcp/aws-samples-sample-genai-on-eks-starter-kit-h48zwo)
commit: 8864543f3fa49b1fb1468f28ccfa15a019cd8b93
code hash: f55c048c6566937716440caa06305129a471e724b353e39de65e6b403cd11884
verified: 6/14/2026, 10:46:46 AM
view raw JSON β†’