TheMCPCompany

TheMCPCompany is a research benchmark implementation that creates MCP servers for real-world enterprise services including GitLab, Plane, RocketChat, ownCloud, and Azure, providing over 18,000 tools for evaluating tool-calling agents. Built by researchers at BatsResearch, it transforms REST APIs into MCP servers using FastMCP and includes both oracle tool selection and retrieval-based tool discovery mechanisms. The implementation features Docker containerization, dynamic authentication handling, OpenAPI spec processing with regex fixes and schema validation, and specialized wrappers for Azure services that dynamically update base URLs. Designed for academic research on agent capabilities, it enables comparison between browser-based and tool-based agents across complex enterprise workflows, making it useful for benchmarking LLM tool-calling performance, studying tool retrieval effectiveness, and evaluating agent reasoning in multi-service environments.

Source

Repository: https://github.com/reza-esfandiarpoor/the-mcp-company