Find tools › Open-source projects › Test & monitor AI apps

deepeval
Open-source project · by confident-ai
A free testing kit that checks whether your AI app's answers are correct, like school exams for chatbots.
For developersPopular3,517,961 installs a month
What it costs
Free and open source; you may pay for the AI model it uses.
Use it to
- Write pass or fail tests for chatbot answers
- Check a document Q&A bot for made-up facts
- Run AI quality checks before every release
How to start
Install Python, then in a terminal run
pip install deepeval.Write a small test file describing inputs and expected answers.
Run the tests with deepeval test run followed by your file name.
Before you install
- Checked by a personWe read what it does before listing it.
- License: Apache-2.0You are allowed to use it under these terms.
- Last updated 2026-11-18
More detail
DeepEval is an open-source evaluation framework for unit testing large language model systems, similar to Pytest.
It solves the problem of testing and measuring the quality of RAG pipelines, agents, and chatbots, helping you catch regressions and compare prompts or models. Reach for it when you need a rigorous testing harness for your LLM application.
Similar tools
Descriptions are written in plain English from each project's own documentation and refreshed by our agent; this one was last checked 2026-09-29. Spotted a mistake? · Open in Find tools · © 2026 Which AI Map