LLM Gateway
Unified gateway for managing multiple LLM providers with automatic model selection, semantic caching, and cost optimization featur
A unified gateway server for managing interactions with multiple LLM providers (OpenAI, Anthropic, DeepSeek, Gemini) with built-in cost optimization, caching, and monitoring. Features include automatic model selection based on task requirements, semantic caching to reduce redundant API calls, detailed usage analytics, and a CLI for direct interaction. The implementation focuses on reliability with comprehensive error handling, request retries, and rate limiting, making it particularly valuable for production deployments that need to balance performance and costs across multiple LLM providers.
Source
Repository: https://github.com/dicklesworthstone/ultimate_mcp_server
Maintain LLM Gateway?
Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.
[LLM Gateway on getagentictools](https://getagentictools.com/mcp/dicklesworthstone-ultimate-mcp-server?ref=badge)