llama-cpp

Past 7d, sorted by best first, all versions

06/11

raketenkater/llm-server v3.0.0

Hardware-detecting launcher that tunes and starts GGUF inference servers with automatic GPU placement, backend selection, and OpenAI-compatible serving.

Go 223☆ 94d old #golang #llm #go #llama-cpp #cuda