llama.cpp
Run large language models locally on CPU or GPU
No screenshot yet
About llama.cpp
llama.cpp is the inference engine behind many local AI apps. It runs GGUF language models on ordinary CPUs and most GPUs, and ships a command-line chat tool and llama-server, which adds a web chat page and an OpenAI-compatible API.
Found in
Alternatives to llama.cpp
184kGitHub starsOllama
Run open large language models on your own machine
156kGitHub starsOpen WebUI
Self-hosted chat interface for local and remote AI models
138kGitHub starsComfyUI
Node-based workflows for local image and video generation
83kGitHub starsLobeHub
AI chat workspace with agents, plugins and a knowledge base
