GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node
24h 7d 14d 30d | Newest Best Latest version only Popular

inference

Past 7d, sorted by best first
4 results Markdown version
10/09 7
kibae/pg_onnx v1.31.0
ONNX Runtime integration enabling machine learning inference within PostgreSQL databases.
C++ 63☆ 1121d old #c++ #ai #deep-learning #cuda #contributions-welcome
10/09 6
kaito-project/AIKit v0.23.2
Platform to host, deploy, build, and fine-tune large language models with OpenAI API compatibility.
Go 539☆ 1120d old #golang #docker #llm #go #large-language-models
10/09 5
RunanywhereAI/RunAnywhere cpp-desktop-v0.20.39
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
C++ 10319☆ 449d old #swift #c++ #llm #ios #kotlin
10/07 5
defilantech/LLMKube llmkube-0.10.2
Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.
Go 232☆ 333d old #golang #ai #kubernetes #go #gpu