GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node

inference

Past 14d, sorted by best first
5 results Markdown version
10/09 7
kibae/pg_onnx v1.31.0
ONNX Runtime integration enabling machine learning inference within PostgreSQL databases.
10/09 6
kaito-project/AIKit v0.23.2
Platform to host, deploy, build, and fine-tune large language models with OpenAI API compatibility.
10/05 6
RunanywhereAI/RunAnywhere cpp-desktop-v0.20.37...
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
C++ 10319☆ 449d old #swift #c++ #llm #ios #kotlin
10/07 5
defilantech/LLMKube llmkube-0.10.2
Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.
Go 232☆ 333d old #golang #ai #kubernetes #go #gpu
10/05 5
NVIDIA/NVIDIA Cloud Functions (NVCF) deploy/helm/nvca-ope...
Platform for deploying, managing, and running GPU-accelerated inference, streaming, and batch workloads across worker clusters.