GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node

llama-cpp

Past 14d, sorted by best first
1 results Markdown version
06/11 8
raketenkater/llm-server v3.0.0
Hardware-detecting launcher that tunes and starts GGUF inference servers with automatic GPU placement, backend selection, and OpenAI-compatible serving.
Go 223☆ 94d old #golang #llm #go #llama-cpp #cuda