Companies in the category 'LLM Gateway'
These are companies that provide an open source gateway for managing and routing requests to large language models.
Enterprise AI gateway for LLMs and agents
TrueFoundry provides an enterprise AI gateway for governing access to LLMs, MCP servers, and agents. The platform combines gateway controls with LLM operations, model serving, tracing, and observability capabilities for enterprise teams. Its MIT-licensed TrueForge project is an open-source agent harness that connects models, tools, MCP servers, sandboxes, and infrastructure.
Unified API for large language models (LLMs)
OpenRouter provides a platform for accessing and using large language models (LLMs) through a unified API. It focuses on simplifying the integration of various LLMs for enterprises, enabling them to leverage AI technologies effectively.
Creator of Bitfrost, an AI gateway platform
Maxim AI builds Bifrost, an open-source high-performance AI gateway that provides unified access to 23+ LLM providers through a single OpenAI-compatible API, with automatic failover, load balancing, semantic caching, and enterprise guardrails. The company also offers a commercial AI evaluation and observability platform that helps engineering teams test, simulate, and monitor AI agents and applications throughout the development lifecycle.
Lightweight LLM gateway for enterprises
LiteLLM specializes in providing lightweight and efficient large language models (LLMs) for enterprises. Their core products are built on advanced AI technologies, focusing on scalability and performance. The company primarily serves enterprise clients.
COSS Weekly Newsletter
Stay up to date with the latest news, funding rounds, and announcements from the COSS universe.
Check out COSS Weekly on the web
