Find tools › Open-source projects › Test & monitor AI apps

gateway

Open-source project · by Portkey-AI

A server between your app and AI companies that retries or switches providers when one fails.

For developersPopular3,540 installs a month

What it costs

Free and open source; you may pay for the AI model it uses.

Use it to

  • Fall back to a second AI provider when the first is down
  • Spread requests across several providers to avoid limits
  • Add safety checks to what your app sends and receives

How to start

  1. Install Node.js, which includes the npx command.

  2. In a terminal, run npx @portkey-ai/gateway to start the gateway on your computer.

  3. Point your app's AI requests at the gateway instead of directly at the provider.

  4. Note that some team and governance features are only in the paid version.

Good to know. Speed and scale figures (<1ms latency, 10B tokens/day) are the company's claims. Portkey is a commercial company; some features (org management, governance) are in the paid enterprise version, and the README says a 2.0 release is in pre-release on a separate branch, while the main branch was last pushed in May 2026.

Before you install

  • Checked by a personWe read what it does before listing it.
  • License: MITYou are allowed to use it under these terms.
  • Last updated 2026-05-25

More detail

Portkey AI Gateway is an open-source server that routes requests from your app to many AI model providers through one OpenAI-compatible API, with retries, fallbacks, load balancing and configurable guardrails.

Developers use it to make AI apps more reliable (automatic retries and fallbacks) and to enforce rules on inputs and outputs without writing that logic themselves. It also includes a local log console and an MCP gateway.

Similar tools

Descriptions are written in plain English from each project's own documentation and refreshed by our agent; this one was last checked 2026-09-29. Spotted a mistake? · Open in Find tools · © 2026 Which AI Map