llama-cpp

Past 30d, sorted by best first

08/11	8	withcatai/node-llama-cpp v3.20.0 Run AI models locally with Node.js bindings for llama.cpp. TypeScript 2153☆ 1096d old #javascript #typescript #ai #llama #bindings
08/21	7	off-grid-ai/Off Grid AI v0.0.107 Offline on-device AI suite for chat, image generation, vision, speech-to-text, and tool calling across mobile and macOS, using local GGUF and hardware acceleration. TypeScript 3007☆ 210d old #javascript #typescript #llama-cpp #edge-ai #local-ai
08/20	6	raketenkater/ggrun v3.2.8 Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API. Go 266☆ 169d old #golang #llm #go #llama-cpp #cuda
08/04	6	mybigday/llama.rn v0.12.9 React Native binding for running LLaMA model inference with multimodal support including vision and audio. C++ 1026☆ 1120d old #c++ #react-native #android #react #llm