GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node

gguf

Past 30d, sorted by best first
10 results Markdown version
09/26 7
off-grid-ai/Off Grid AI v0.0.111
Offline on-device AI suite for chat, image generation, vision, speech-to-text, and tool calling across mobile and macOS, using local GGUF and hardware acceleration.
TypeScript 3195☆ 247d old #javascript #typescript #llama-cpp #edge-ai #local-ai
09/19 7
kelindar/Semantic Search v0.5.0
Go library for embedded vector search and GGUF BERT-based semantic embeddings with optional GPU acceleration.
Go 559☆ 721d old #golang #ai #go #embeddings #gpu
10/08 6
nathaninline/AJEAN v0.18.0
AJEAN is a home AI assistant single-binary setup with chat, persistent memory, tools, web and browser control, and end-to-end encrypted remote access.
Go 68☆ 126d old #golang #go #chatbot #cuda #ai-assistant
10/07 6
AtomicBot-ai/atomic-agent v0.6.7
Local operator agent for llama.cpp that controls browser, files, shell, tasks, and approvals while keeping data and models local.
TypeScript 3228☆ 172d old #javascript #typescript #cli #agents #agentic-ai
10/02 6
htobty/ReadyLLM v0.3.0
Visual interface for deploying, monitoring, and tuning local LLMs, with hardware-aware parameter search and ComfyUI-based image and video generation.
Python 106☆ 38d old #python #llm #fastapi #comfyui #gguf
09/23 6
raketenkater/ggrun v3.2.10
Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API.
Go 279☆ 203d old #golang #llm #go #llama-cpp #cuda
09/18 6
lone-cloud/Gerbil v1.28.4
Desktop app for running Large Language Models locally with cross-platform support and integrated image generation.
TypeScript 473☆ 404d old #javascript #electron #typescript #llm #desktop
10/07 5
defilantech/LLMKube llmkube-0.10.2
Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.
Go 232☆ 333d old #golang #ai #kubernetes #go #gpu
10/07 4
mattn/tensai v0.0.35
Tiny machine-learning framework for Go, implementing forward passes, backpropagation, and optimization with optional SIMD and WebGPU acceleration.
Go 112☆ 53d old #golang #go #deep-learning #gguf #avx2
09/25 4
off-grid-ai/Off Grid AI v0.0.51
Local-first AI runtime with a studio and an OpenAI-compatible gateway, running open multimodal models entirely on-device with an optional always-on assistant layer.
TypeScript 114☆ 250d old #javascript #electron #typescript #llm #local-first