Tools · Local AI apps
KoboldCpp
thecontinuitylayer.com/tools/local-ai-apps/koboldcppFiction writers and role-players
Single-file runner · LostRuins
KoboldCpp is a single executable that runs GGUF models with a built-in web interface, KoboldAI Lite. There is nothing to install: download one file and run it.
It is built for long-form writing and role-play, with memory, world info, author's notes and support for imported character cards. It can also generate images with Stable Diffusion and Flux models, and it serves an OpenAI-compatible API alongside its own.
Specs
| Price | Free and open source (AGPL-3.0) |
|---|---|
| Runs | GGUF text models plus image generation, built on llama.cpp |
| Platforms | Windows, Linux, Apple Silicon Mac; more from source |
| Difficulty | Easy to start, many settings |
| API | OpenAI-compatible at /v1, KoboldAI API, others |
| License | AGPL-3.0 |
Good for
- Fiction and role-play
- A portable setup on a USB stick
Not for
- Document chat or business use (use AnythingLLM or Open WebUI)
See also
We last reviewed KoboldCpp on 6 November 2026. Prices and specs change; check github.com before you buy or sign up. Figures we could not confirm on the vendor's own page read “not published” or “varies”.
Vendor source: https://github.com/LostRuins/koboldcpp