Find tools › Open-source projects › Test & monitor AI apps

deepeval

Open-source project · by confident-ai

A free testing kit that checks whether your AI app's answers are correct, like school exams for chatbots.

For developersPopular3,517,961 installs a month

What it costs

Free and open source; you may pay for the AI model it uses.

Use it to

  • Write pass or fail tests for chatbot answers
  • Check a document Q&A bot for made-up facts
  • Run AI quality checks before every release

How to start

  1. Install Python, then in a terminal run pip install deepeval.

  2. Write a small test file describing inputs and expected answers.

  3. Run the tests with deepeval test run followed by your file name.

Before you install

  • Checked by a personWe read what it does before listing it.
  • License: Apache-2.0You are allowed to use it under these terms.
  • Last updated 2026-11-18

More detail

DeepEval is an open-source evaluation framework for unit testing large language model systems, similar to Pytest.

It solves the problem of testing and measuring the quality of RAG pipelines, agents, and chatbots, helping you catch regressions and compare prompts or models. Reach for it when you need a rigorous testing harness for your LLM application.

Similar tools

Descriptions are written in plain English from each project's own documentation and refreshed by our agent; this one was last checked 2026-09-29. Spotted a mistake? · Open in Find tools · © 2026 Which AI Map