GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node

gguf

Past 14d, sorted by best first
7 results Markdown version
10/13 6
raketenkater/ggrun v3.2.11
Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API.
Go 281☆ 217d old #golang #llm #go #llama-cpp #cuda
10/13 6
AtomicBot-ai/atomic-agent v0.6.8
Local operator agent for llama.cpp that controls browser, files, shell, tasks, and approvals while keeping data and models local.
TypeScript 3324☆ 176d old #javascript #typescript #cli #agents #agentic-ai
10/08 6
nathaninline/AJEAN v0.18.0
AJEAN is a home AI assistant single-binary setup with chat, persistent memory, tools, web and browser control, and end-to-end encrypted remote access.
Go 78☆ 127d old #golang #go #chatbot #cuda #ai-assistant
10/02 6
htobty/ReadyLLM v0.3.0
Visual interface for deploying, monitoring, and tuning local LLMs, with hardware-aware parameter search and ComfyUI-based image and video generation.
Python 106☆ 38d old #python #llm #fastapi #comfyui #gguf
10/07 5
defilantech/LLMKube llmkube-0.10.2
Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.
Go 232☆ 333d old #golang #ai #kubernetes #go #gpu
10/13 4
off-grid-ai/Off Grid AI v0.0.114-beta.1
Offline on-device AI suite for chat, image generation, vision, speech-to-text, and tool calling across mobile and macOS, using local GGUF and hardware acceleration.
TypeScript 3238☆ 259d old #javascript #typescript #llama-cpp #edge-ai #local-ai
10/07 4
mattn/tensai v0.0.35
Tiny machine-learning framework for Go, implementing forward passes, backpropagation, and optimization with optional SIMD and WebGPU acceleration.
Go 112☆ 53d old #golang #go #deep-learning #gguf #avx2