Open sourceActive

Apache APISIX AI Gateway

Open-source LLM gateway and proxy for model routing, load balancing, retries, fallback, token rate limiting, security, and observability.

Open source page ↗

Field note

What it does

Apache APISIX AI Gateway manages API and AI traffic together with 20+ model providers, 100+ gateway plugins, and zero vendor lock-in.

Capabilities

Available capabilities

Security Observability Model Routing Retries and Fallback Token Rate Limiting Load Balancing

Tags

Tags

Open source AI Gateway LLM

Ways to use it

Ways to use it

No integrations filed yet.

Product features

Product features

Compatibility with Apache APISIX

Compatibility with Golang

Developing with the Go Runner SDK

Development

Getting started

Prerequisites

Setting up APISIX (debugging)

Setting up APISIX (running)

Setting up directly

Setting up in container