Open Source AI Gateway Logo

Open Source AI Gateway

Configurable API gateway for multiple LLM providers

10k 热度 AI开发平台 API Gateway AI Providers Open Source Docker gRPC HTTP
访问官网
Open Source AI Gateway 截图

软件新闻

使用指南

What is Open Source AI Gateway?

Open Source AI Gateway enables seamless integration and management of multiple LLM providers like OpenAI, Anthropic, and Cohere through a single configurable API interface, enhancing performance with built-in analytics, guardrails, caching, and administrative controls.

How to use Open Source AI Gateway?

To use Open Source AI Gateway, configure your API settings in a Config.toml file, run the gateway container with Docker, and begin making API requests through HTTP or gRPC.

Open Source AI Gateway's Core Features

Multi-Provider Support

HTTP or gRPC interfaces

Smart Failover

Intelligent Caching

Rate Limiting

Admin Dashboard

Content Guardrails

Enterprise Logging

Open Source AI Gateway's Use Cases

#1

Manage API requests to multiple LLM providers through a single interface.

#2

Automatically switch between LLM providers for high availability.

FAQ from Open Source AI Gateway

What LLM providers are supported by Open Source AI Gateway?

Is Open Source AI Gateway easy to configure?

How does the intelligent caching feature work?

Open Source AI Gateway Company

Open Source AI Gateway Company name:

Open Source AI Gateway

.

Open Source AI Gateway Github

Open Source AI Gateway Github Link:

https://github.com/wx-yz/ai-gateway

你可能还感兴趣

Anything Logo

Anything

无需编码的AI移动和网页应用生成器。
Rebolt Logo

Rebolt

无需编码的 AI 平台，通过与 AI 对话构建应用和代理。
Deforge Logo

Deforge

可视化无代码平台，用于构建和部署人工智能代理。
Disco.dev Logo

Disco.dev

最简单的方法来启动、测试和重混开源 MCP 服务器以用于 AI 代理...
Sesterce Cloud Logo

Sesterce Cloud

欧洲GPU云平台，提供高性能、主权和节能的基础设施，用于AI训练...