GitHub Release Tracker

10/06

9

ollama/Ollama v0.40.0

Tool for running and managing large language models.

Go 182847☆ 1204d old #golang #llm #go #llama #llama2

10/02

9

mudler/LocalAI v4.11.0

Self-hosted alternative to popular AI APIs for local inferencing on consumer-grade hardware.

Go 49445☆ 1300d old #golang #api #ai #llm #go

10/06

7

hybridgroup/yzma v1.29.0

Go-based library for hardware-accelerated local inference with llama.cpp integration.

Go 651☆ 383d old #golang #llm #go #llama #llamacpp

10/04

6

tetherto/QVAC sdk-v0.21.0

Local-first, cross-platform SDK for building peer-to-peer AI apps with local model inference, speech, translation, and RAG.

TypeScript 686☆ 282d old #javascript #typescript #ai #llm #llama

10/07

5

helixml/HelixML 2.12.33

Private GenAI stack for deploying AI agents with support for RAG, API calls, vision, and efficient GPU scheduling.

Go 819☆ 1091d old #golang #self-hosted #api #llm #openai

10/12

4

mostlygeek/llama-swap v264

Reliable on-demand model switching between local OpenAI-compatible inference servers without restarting applications.

Go 5935☆ 738d old #golang #go #llama #llamacpp #localllm

10/05

3

mybigday/llama.rn v0.13.0-rc.7

React Native binding for running LLaMA model inference with multimodal support including vision and audio.

C 1057☆ 1167d old #c++ #react-native #android #react #llm

10/06	9	ollama/Ollama v0.40.0 Tool for running and managing large language models. Go 182847☆ 1204d old #golang #llm #go #llama #llama2
10/02	9	mudler/LocalAI v4.11.0 Self-hosted alternative to popular AI APIs for local inferencing on consumer-grade hardware. Go 49445☆ 1300d old #golang #api #ai #llm #go
10/06	7	hybridgroup/yzma v1.29.0 Go-based library for hardware-accelerated local inference with llama.cpp integration. Go 651☆ 383d old #golang #llm #go #llama #llamacpp
10/04	6	tetherto/QVAC sdk-v0.21.0 Local-first, cross-platform SDK for building peer-to-peer AI apps with local model inference, speech, translation, and RAG. TypeScript 686☆ 282d old #javascript #typescript #ai #llm #llama
10/07	5	helixml/HelixML 2.12.33 Private GenAI stack for deploying AI agents with support for RAG, API calls, vision, and efficient GPU scheduling. Go 819☆ 1091d old #golang #self-hosted #api #llm #openai
10/12	4	mostlygeek/llama-swap v264 Reliable on-demand model switching between local OpenAI-compatible inference servers without restarting applications. Go 5935☆ 738d old #golang #go #llama #llamacpp #localllm
10/05	3	mybigday/llama.rn v0.13.0-rc.7 React Native binding for running LLaMA model inference with multimodal support including vision and audio. C 1057☆ 1167d old #c++ #react-native #android #react #llm