LLM Gateway

Unified gateway for managing multiple LLM providers with automatic model selection, semantic caching, and cost optimization featur

dicklesworthstone 154
Claude CodeClaude DesktopGeneric
View source ↗

A unified gateway server for managing interactions with multiple LLM providers (OpenAI, Anthropic, DeepSeek, Gemini) with built-in cost optimization, caching, and monitoring. Features include automatic model selection based on task requirements, semantic caching to reduce redundant API calls, detailed usage analytics, and a CLI for direct interaction. The implementation focuses on reliability with comprehensive error handling, request retries, and rate limiting, making it particularly valuable for production deployments that need to balance performance and costs across multiple LLM providers.

Source

Repository: https://github.com/dicklesworthstone/ultimate_mcp_server

Maintain LLM Gateway?

Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.

[LLM Gateway on getagentictools](https://getagentictools.com/mcp/dicklesworthstone-ultimate-mcp-server?ref=badge)