* [pg\_onnx v1.31.0](https://github.com/kibae/pg_onnx) – ONNX Runtime integration enabling machine learning inference within PostgreSQL databases.

* [AIKit v0.23.2](https://github.com/kaito-project/aikit) – Platform to host, deploy, build, and fine-tune large language models with OpenAI API compatibility.

* [RunAnywhere cpp-desktop-v0.20.39](https://github.com/RunanywhereAI/runanywhere-sdks) – On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.

* [LLMKube llmkube-0.10.2](https://github.com/defilantech/LLMKube) – Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.