Find tools › Open-source projects › Test & monitor AI apps

gateway
Open-source project · by Portkey-AI
A server between your app and AI companies that retries or switches providers when one fails.
For developersPopular3,540 installs a month
What it costs
Free and open source; you may pay for the AI model it uses.
Use it to
- Fall back to a second AI provider when the first is down
- Spread requests across several providers to avoid limits
- Add safety checks to what your app sends and receives
How to start
Install Node.js, which includes the npx command.
In a terminal, run
npx @portkey-ai/gatewayto start the gateway on your computer.Point your app's AI requests at the gateway instead of directly at the provider.
Note that some team and governance features are only in the paid version.
Before you install
- Checked by a personWe read what it does before listing it.
- License: MITYou are allowed to use it under these terms.
- Last updated 2026-05-25
More detail
Portkey AI Gateway is an open-source server that routes requests from your app to many AI model providers through one OpenAI-compatible API, with retries, fallbacks, load balancing and configurable guardrails.
Developers use it to make AI apps more reliable (automatic retries and fallbacks) and to enforce rules on inputs and outputs without writing that logic themselves. It also includes a local log console and an MCP gateway.
Similar tools
Descriptions are written in plain English from each project's own documentation and refreshed by our agent; this one was last checked 2026-09-29. Spotted a mistake? · Open in Find tools · © 2026 Which AI Map