llama-cpp

Past 14d, sorted by best first

10/03	7	lordmathis/llamactl v0.22.0 Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard. Go 156☆ 444d old #golang #llm #go #llama-cpp #llamacpp
10/13	6	raketenkater/ggrun v3.2.11 Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API. Go 281☆ 217d old #golang #llm #go #llama-cpp #cuda
10/13	4	off-grid-ai/Off Grid AI v0.0.114-beta.1 Offline on-device AI suite for chat, image generation, vision, speech-to-text, and tool calling across mobile and macOS, using local GGUF and hardware acceleration. TypeScript 3237☆ 258d old #javascript #typescript #llama-cpp #edge-ai #local-ai
10/05	3	mybigday/llama.rn v0.13.0-rc.7 React Native binding for running LLaMA model inference with multimodal support including vision and audio. C 1057☆ 1167d old #c++ #react-native #android #react #llm