Find tools › Open-source projects › Write code faster

Tracely-ai

Open-source project · by jwuthri-cloud

Turns failed AI runs into automated regression tests and blocks bad updates.

Some setup70 installs a month

What it costs

Free and open source; you may pay for the AI model it uses.

Use it to

  • Grade production traces automatically
  • Cluster failure issues
  • Block pull requests with regressions

How to start

  1. Install the Python package using pip install tracelyai-sdk.

  2. Deploy the self-hosted stack using the provided one-click deployment options.

  3. Send traces over plain OTLP from your application.

Good to know. Self-hosted stack includes Postgres, ClickHouse, Redis, and MinIO, which requires substantial infrastructure management.

Before you install

  • Found automaticallyNot reviewed by a person yet. Check it before installing.
  • License: MITYou are allowed to use it under these terms.
  • Last updated 2026-11-16

More detail

Trace-native CI/CD platform for AI agents that grades runs, clusters failures into issues, and turns them into replayable regression tests.

Helps developers catch AI agent bugs before they reach production by turning actual failing runs into automated test cases without manual dataset writing.

Similar tools

Descriptions are written in plain English from each project's own documentation and refreshed by our agent; this one was last checked 2026-10-18. Spotted a mistake? · Open in Find tools · © 2026 Which AI Map