GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node

gguf

Past 30d, sorted by best first
7 results Markdown version
08/23 8
AtomicBot-ai/atomic-agent v0.4.0
Local operator agent for llama.cpp that controls browser, files, shell, tasks, and approvals while keeping data and models local.
TypeScript 2428☆ 128d old #javascript #typescript #cli #agents #agentic-ai
08/25 7
lone-cloud/Gerbil v1.28.0
Desktop app for running Large Language Models locally with cross-platform support and integrated image generation.
TypeScript 472☆ 381d old #javascript #electron #typescript #llm #desktop
08/21 7
off-grid-ai/Off Grid AI v0.0.107
Offline on-device AI suite for chat, image generation, vision, speech-to-text, and tool calling across mobile and macOS, using local GGUF and hardware acceleration.
TypeScript 3011☆ 211d old #javascript #typescript #llama-cpp #edge-ai #local-ai
08/20 6
raketenkater/ggrun v3.2.8
Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API.
Go 267☆ 169d old #golang #llm #go #llama-cpp #cuda
08/27 5
mattn/tensai v0.0.10
Tiny machine-learning framework for Go, implementing forward passes, backpropagation, and optimization with optional SIMD and WebGPU acceleration.
08/21 4
off-grid-ai/Off Grid AI v0.0.43
Local-first AI runtime with a studio and an OpenAI-compatible gateway, running open multimodal models entirely on-device with an optional always-on assistant layer.
TypeScript 82☆ 221d old #javascript #electron #typescript #llm #local-first
08/20 4
defilantech/LLMKube llmkube-0.9.19
Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.
Go 196☆ 284d old #golang #ai #kubernetes #go #gpu