llama-cpp

Past 7d, sorted by best first

08/21	7	off-grid-ai/Off Grid AI v0.0.107 Offline on-device AI suite for chat, image generation, vision, speech-to-text, and tool calling across mobile and macOS, using local GGUF and hardware acceleration. TypeScript 3006☆ 210d old #javascript #typescript #llama-cpp #edge-ai #local-ai
08/20	6	raketenkater/ggrun v3.2.8 Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API. Go 266☆ 169d old #golang #llm #go #llama-cpp #cuda
08/23	4	mybigday/llama.rn v0.13.0-rc.1 React Native binding for running LLaMA model inference with multimodal support including vision and audio. C++ 1026☆ 1120d old #c++ #react-native #android #react #llm