GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node

llama-cpp

Past 7d, sorted by best first
2 results Markdown version
10/13 6
raketenkater/ggrun v3.2.11
Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API.
Go 281☆ 217d old #golang #llm #go #llama-cpp #cuda
10/13 4
off-grid-ai/Off Grid AI v0.0.114-beta.1
Offline on-device AI suite for chat, image generation, vision, speech-to-text, and tool calling across mobile and macOS, using local GGUF and hardware acceleration.
TypeScript 3237☆ 258d old #javascript #typescript #llama-cpp #edge-ai #local-ai