llama-cpp

Past 30d, sorted by best first

09/27	8	withcatai/node-llama-cpp v3.22.0 Run AI models locally with Node.js bindings for llama.cpp. TypeScript 2187☆ 1148d old #javascript #typescript #ai #llama #bindings
10/03	7	lordmathis/llamactl v0.22.0 Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard. Go 156☆ 444d old #golang #llm #go #llama-cpp #llamacpp
09/26	7	off-grid-ai/Off Grid AI v0.0.111 Offline on-device AI suite for chat, image generation, vision, speech-to-text, and tool calling across mobile and macOS, using local GGUF and hardware acceleration. TypeScript 3195☆ 247d old #javascript #typescript #llama-cpp #edge-ai #local-ai
09/23	6	raketenkater/ggrun v3.2.10 Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API. Go 279☆ 203d old #golang #llm #go #llama-cpp #cuda
10/05	3	mybigday/llama.rn v0.13.0-rc.7 React Native binding for running LLaMA model inference with multimodal support including vision and audio. C 1057☆ 1166d old #c++ #react-native #android #react #llm