llama.cpp

The Open Source AI Toolbox: Runtimes, UIs, RAG, Fine-Tuning, Evaluation and Observability

The open source tools I use and recommend for running, serving, building on, fine-tuning and evaluating open models, with each tool's license stated.