GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node

inference

Past 7d, sorted by best first
3 results Markdown version
08/27 6
RunanywhereAI/RunAnywhere v0.20.31
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
C++ 10279☆ 403d old #swift #c++ #llm #ios #kotlin
08/24 6
NVIDIA/NVIDIA Cloud Functions (NVCF) deploy/helm/containe...
Platform for deploying, managing, and running GPU-accelerated inference, streaming, and batch workloads across worker clusters.
08/27 3
infercrane/InferCrane v1.0.0-rc.1
InferCrane provides an evidence-gated release lifecycle for self-hosted models behind a stable OpenAI-compatible endpoint, covering deploy, observe, scale, optimize, and safe promotion.
Go 64☆ 20d old #golang #aws #go #gcp #inference