Open Source AI Gateway Logo

Open Source AI Gateway

Configurable API gateway for multiple LLM providers

10k 热度 AI开发平台 API Gateway AI Providers Open Source Docker gRPC HTTP
访问官网
Open Source AI Gateway 截图

软件新闻

VMware nods to AI but looks to long-term

发布日期:2025-09-11

Owner of VMware, Broadcom, announced that its VMware Cloud Foundation platform is now AI native at the VMware Explore conference a few weeks ago. It was the latest move by the company to keep up to speed with the rest of the technology industry’s wide and rapid adoption of large language models, yet came as […] The post VMware nods to AI but looks to long-term appeared first on AI News.

Yext Scout Guides Brands Through AI Search Challenges

发布日期:2025-09-11

Customers are discovering brands and learning about products and services in new ways from traditional search to AI search, to AI agents and more, the discovery journey has completely changed, and brands need to adapt to the new paradigm. Launched earlier this year, Yext Scout is an AI search and competitive intelligence agent that’s designed […] The post Yext Scout Guides Brands Through AI Search Challenges appeared first on AI News.

SoundHound Vision AI:当语音助手获得视觉能力,多模态交互迎来新突破

发布日期:2025-08-12

语音AI领域的领军企业SoundHound近日发布革命性Vision AI系统,将视觉识别与语音技术深度融合。这项技术突破让AI能够同时处理视觉和听觉信息,实现真正意义上的多模态交互。从汽车导航到工业维修,从零售盘点到餐饮点单,Vision AI正在重新定义人机交互的边界,为各行业带来更自然、更智能的解决方案。

使用指南

What is Open Source AI Gateway?

Open Source AI Gateway enables seamless integration and management of multiple LLM providers like OpenAI, Anthropic, and Cohere through a single configurable API interface, enhancing performance with built-in analytics, guardrails, caching, and administrative controls.

How to use Open Source AI Gateway?

To use Open Source AI Gateway, configure your API settings in a Config.toml file, run the gateway container with Docker, and begin making API requests through HTTP or gRPC.

Open Source AI Gateway's Core Features

Multi-Provider Support

HTTP or gRPC interfaces

Smart Failover

Intelligent Caching

Rate Limiting

Admin Dashboard

Content Guardrails

Enterprise Logging

Open Source AI Gateway's Use Cases

#1

Manage API requests to multiple LLM providers through a single interface.

#2

Automatically switch between LLM providers for high availability.

FAQ from Open Source AI Gateway

What LLM providers are supported by Open Source AI Gateway?

Is Open Source AI Gateway easy to configure?

How does the intelligent caching feature work?

Open Source AI Gateway Company

Open Source AI Gateway Company name:

Open Source AI Gateway

.

Open Source AI Gateway Github

Open Source AI Gateway Github Link:

https://github.com/wx-yz/ai-gateway

你可能还感兴趣