GitHub Release Tracker

08/25

9

ollama/Ollama v0.33.0

Tool for running and managing large language models.

Go 179532☆ 1157d old #golang #llm #go #llama #llama2

08/20

9

mudler/LocalAI v4.9.0

Self-hosted alternative to popular AI APIs for local inferencing on consumer-grade hardware.

Go 48700☆ 1257d old #golang #api #ai #llm #go

08/25

7

lone-cloud/Gerbil v1.28.0

Desktop app for running Large Language Models locally with cross-platform support and integrated image generation.

TypeScript 472☆ 380d old #javascript #electron #typescript #llm #desktop

08/25

7

hybridgroup/yzma v1.25.0

Go-based library for hardware-accelerated local inference with llama.cpp integration.

Go 568☆ 339d old #golang #llm #go #llama #llamacpp

08/23

7

yoshoku/llama_cpp.rb v0.28.0

Ruby bindings for llama.cpp, enabling easy integration of the library in Ruby applications.

C 236☆ 1242d old #ruby #ai #llm #gem #c

08/24

6

helixml/HelixML 2.12.6

Private GenAI stack for deploying AI agents with support for RAG, API calls, vision, and efficient GPU scheduling.

Go 802☆ 1045d old #golang #self-hosted #api #llm #openai

08/27

5

goccy/go-llama v0.2.3

Pure Go inference engine for GGUF models, built from llama.cpp compiled to WebAssembly and translated to Go without wasm runtime.

Go 146☆ 26d old #golang #ai #llm #go #llama

08/26

5

tetherto/QVAC sdk-v0.18.2

Local-first, cross-platform SDK for building peer-to-peer AI apps with local model inference, speech, translation, and RAG.

TypeScript 551☆ 236d old #javascript #typescript #ai #llm #llama

08/23

4

mybigday/llama.rn v0.13.0-rc.1

React Native binding for running LLaMA model inference with multimodal support including vision and audio.

C++ 1026☆ 1120d old #c++ #react-native #android #react #llm

08/23

4

mostlygeek/llama-swap v251

Reliable on-demand model switching between local OpenAI-compatible inference servers without restarting applications.

Go 5483☆ 692d old #golang #go #llama #llamacpp #localllm

08/25	9	ollama/Ollama v0.33.0 Tool for running and managing large language models. Go 179532☆ 1157d old #golang #llm #go #llama #llama2
08/20	9	mudler/LocalAI v4.9.0 Self-hosted alternative to popular AI APIs for local inferencing on consumer-grade hardware. Go 48700☆ 1257d old #golang #api #ai #llm #go
08/25	7	lone-cloud/Gerbil v1.28.0 Desktop app for running Large Language Models locally with cross-platform support and integrated image generation. TypeScript 472☆ 380d old #javascript #electron #typescript #llm #desktop
08/25	7	hybridgroup/yzma v1.25.0 Go-based library for hardware-accelerated local inference with llama.cpp integration. Go 568☆ 339d old #golang #llm #go #llama #llamacpp
08/23	7	yoshoku/llama_cpp.rb v0.28.0 Ruby bindings for llama.cpp, enabling easy integration of the library in Ruby applications. C 236☆ 1242d old #ruby #ai #llm #gem #c
08/24	6	helixml/HelixML 2.12.6 Private GenAI stack for deploying AI agents with support for RAG, API calls, vision, and efficient GPU scheduling. Go 802☆ 1045d old #golang #self-hosted #api #llm #openai
08/27	5	goccy/go-llama v0.2.3 Pure Go inference engine for GGUF models, built from llama.cpp compiled to WebAssembly and translated to Go without wasm runtime. Go 146☆ 26d old #golang #ai #llm #go #llama
08/26	5	tetherto/QVAC sdk-v0.18.2 Local-first, cross-platform SDK for building peer-to-peer AI apps with local model inference, speech, translation, and RAG. TypeScript 551☆ 236d old #javascript #typescript #ai #llm #llama
08/23	4	mybigday/llama.rn v0.13.0-rc.1 React Native binding for running LLaMA model inference with multimodal support including vision and audio. C++ 1026☆ 1120d old #c++ #react-native #android #react #llm
08/23	4	mostlygeek/llama-swap v251 Reliable on-demand model switching between local OpenAI-compatible inference servers without restarting applications. Go 5483☆ 692d old #golang #go #llama #llamacpp #localllm