Find tools › Open-source projects › Keep data private

Bonsai-demo

Open-source project · by PrismML-Eng

Run the Bonsai reasoning model locally on your own hardware.

Some setupWell known

What it costs

Free and open source; you may pay for the AI model it uses.

Use it to

  • Run reasoning models locally
  • Analyze images and PDFs privately
  • Test local tool calling

How to start

  1. Clone the repository using git clone

  2. Run ./setup.sh to download the model and dependencies

  3. Start the local server with ./scripts/start_llama_server.sh

  4. Open http://localhost:8080 in your browser to chat

Good to know. Requires custom binaries from a fork rather than stock llama.cpp, and processing large models locally requires substantial RAM or a capable GPU.

Before you install

  • Found automaticallyNot reviewed by a person yet. Check it before installing.
  • License: Apache-2.0You are allowed to use it under these terms.
  • Last updated 2026-11-05

More detail

Run the Bonsai 2 27B reasoning model locally on your own computer with support for vision and tool calling.

When you want to run a powerful open reasoning model locally on your own hardware without sending data to external cloud providers.

Similar tools

Descriptions are written in plain English from each project's own documentation and refreshed by our agent; this one was last checked 2026-09-29. Spotted a mistake? · Open in Find tools · © 2026 Which AI Map