vllm-project/vllm
vLLM
High-throughput LLM serving.
Open sourceActiveAn ops project
“A high-throughput and memory-efficient inference and serving engine for LLMs” — from the project
The license, in plain English
- License
- Apache 2.0 · OSI-approved
- Use it at work?
- Yes — use it anywhere, including in commercial products.
- Share your changes?
- No. Keep the copyright notice and you’re done.
Our reading, not legal advice — the repository’s LICENSE file is the source of truth.
Alternatives
ollama
Ollama
Run open-weight models locally with one command.
Open source★ 185,220ggml-orgllama.cpp
LLM inference in C/C++ on almost any hardware.
Open source★ 132,752mudlerLocalAI
Drop-in OpenAI-compatible API for local models.
Open source★ 50,046AUTOMATIC1111Stable Diffusion web UI
The classic browser UI for Stable Diffusion models.
Open source★ 165,171langgeniusDify
Build LLM apps and agents with a visual workflow.
License unclear★ 159,908open-webuiOpen WebUI
A ChatGPT-style interface for local and remote models.
License unclear★ 157,146