localllm

Past 7d, sorted by best first, all versions

03/13

mostlygeek/llama-swap v198

Reliable on-demand model switching between local OpenAI-compatible inference servers without restarting applications.

Go 2812☆ 529d old #golang #go #llama #llamacpp #localllm