ggml-org/llama.cpp
llama.cpp
LLM inference in C/C++ on almost any hardware.
Open sourceActiveAn afternoon
“LLM inference in C/C++” — from the project
The license, in plain English
- License
- MIT · OSI-approved
- Use it at work?
- Yes — use it anywhere, including in commercial products.
- Share your changes?
- No. Keep the copyright notice and you’re done.
Our reading, not legal advice — the repository’s LICENSE file is the source of truth.
Alternatives
ollama
Ollama
Run open-weight models locally with one command.
Open source★ 185,220vllm-projectvLLM
High-throughput LLM serving.
Open source★ 95,852mudlerLocalAI
Drop-in OpenAI-compatible API for local models.
Open source★ 50,046AUTOMATIC1111Stable Diffusion web UI
The classic browser UI for Stable Diffusion models.
Open source★ 165,171langgeniusDify
Build LLM apps and agents with a visual workflow.
License unclear★ 159,908open-webuiOpen WebUI
A ChatGPT-style interface for local and remote models.
License unclear★ 157,146