Open Source AI Gateway Logo

Open Source AI Gateway

Configurable API gateway for multiple LLM providers

10k 热度 AI开发平台 API Gateway AI Providers Open Source Docker gRPC HTTP
访问官网
Open Source AI Gateway 截图

软件新闻

Huawei details open-source AI development roadmap at Huawei Connect 2025

发布日期:2025-09-29

Open-source AI development took centre stage at Huawei Connect 2025 last week, with Huawei laying out implementation timelines and the technical specifics around making its entire AI software stack publicly available by year-end. The announcements came with context that matters to developers: frank acknowledgement of past friction, specific commitments about what components will be released, […] The post Huawei details open-source AI development roadmap at Huawei Connect 2025 appeared first on AI News.

CAMIA privacy attack reveals what AI models memorise

发布日期:2025-09-26

Researchers have developed a new attack that reveals privacy vulnerabilities by determining whether your data was used to train AI models. The method, named CAMIA (Context-Aware Membership Inference Attack), was developed by researchers from Brave and the National University of Singapore and is far more effective than previous attempts at probing the ‘memory’ of AI […] The post CAMIA privacy attack reveals what AI models memorise appeared first on AI News.

Samsung benchmarks real productivity of enterprise AI models

发布日期:2025-09-25

Samsung is overcoming limitations of existing benchmarks to better assess the real-world productivity of AI models in enterprise settings. The new system, developed by Samsung Research and named TRUEBench, aims to address the growing disparity between theoretical AI performance and its actual utility in the workplace. As businesses worldwide accelerate their adoption of large language […] The post Samsung benchmarks real productivity of enterprise AI models appeared first on AI News.

Inside Huawei’s plan to make thousands of AI chips think like one computer

发布日期:2025-09-25

Imagine connecting thousands of powerful AI chips scattered in dozens of server cabinets and making them work together as if they were a single, massive computer. That is exactly what Huawei demonstrated at HUAWEI CONNECT 2025, where the company unveiled a breakthrough in AI infrastructure architecture that could reshape how the world builds and scales […] The post Inside Huawei’s plan to make thousands of AI chips think like one computer appeared first on AI News.

Generative AI in retail: Adoption comes at high security cost

发布日期:2025-09-24

The retail industry is among the leaders in generative AI adoption, but a new report highlights the security costs that accompany it. According to cybersecurity firm Netskope, the retail sector has all but universally adopted the technology, with 95% of organisations now using generative AI applications. That’s a huge jump from 73% just a year […] The post Generative AI in retail: Adoption comes at high security cost appeared first on AI News.

OpenAI and Nvidia plan $100B chip deal for AI future

发布日期:2025-09-24

OpenAI and Nvidia have signed a letter of intent for a $100B partnership that could reshape how AI systems are trained and deployed. The plan calls for at least 10 gigawatts of Nvidia hardware to support OpenAI’s next-generation AI infrastructure, which will train and run future models aimed at superintelligence. To support the rollout, Nvidia […] The post OpenAI and Nvidia plan $100B chip deal for AI future appeared first on AI News.

Governing the age of agentic AI: Balancing autonomy and accountability  

发布日期:2025-09-24

Author: Rodrigo Coutinho, Co-Founder and AI Product Manager at OutSystems AI has moved beyond pilot projects and future promises. Today, it’s embedded in industries, with more than three-quarters of organisations (78%) now using AI in at least one business function. The next leap, however, is agentic AI: systems that don’t just provide insights or automate […] The post Governing the age of agentic AI: Balancing autonomy and accountability   appeared first on AI News.

使用指南

What is Open Source AI Gateway?

Open Source AI Gateway enables seamless integration and management of multiple LLM providers like OpenAI, Anthropic, and Cohere through a single configurable API interface, enhancing performance with built-in analytics, guardrails, caching, and administrative controls.

How to use Open Source AI Gateway?

To use Open Source AI Gateway, configure your API settings in a Config.toml file, run the gateway container with Docker, and begin making API requests through HTTP or gRPC.

Open Source AI Gateway's Core Features

Multi-Provider Support

HTTP or gRPC interfaces

Smart Failover

Intelligent Caching

Rate Limiting

Admin Dashboard

Content Guardrails

Enterprise Logging

Open Source AI Gateway's Use Cases

#1

Manage API requests to multiple LLM providers through a single interface.

#2

Automatically switch between LLM providers for high availability.

FAQ from Open Source AI Gateway

What LLM providers are supported by Open Source AI Gateway?

Is Open Source AI Gateway easy to configure?

How does the intelligent caching feature work?

Open Source AI Gateway Company

Open Source AI Gateway Company name:

Open Source AI Gateway

.

Open Source AI Gateway Github

Open Source AI Gateway Github Link:

https://github.com/wx-yz/ai-gateway

你可能还感兴趣