LLM Gateway

介紹

透過統一的 API 介面，路由、管理並分析您在多家提供者的 LLM 請求。

AI 翻譯

取自儲存庫 README

README

正在載入完整 README。 以下為已儲存的摘錄。

LLM Gateway is an open-source API gateway for Large Language Models (LLMs). It acts as a middleware between your applications and various LLM providers, allowing you to: • Route requests to multiple LLM providers (OpenAI, Anthropic, Google Vertex AI, and others) • Manage API keys for different providers in one place • Track token usage and costs across all your LLM interactions • Analyze performance metrics to optimize your LLM usage