| 09/28 | 8 |
Browser-based peer-to-peer LLM inference that pools model layers across devices in a room for fast chat and in-tab coding agents.
|
| 10/09 | 7 |
ONNX Runtime integration enabling machine learning inference within PostgreSQL databases.
|
| 09/27 | 7 |
llm-d Router provides load and prefix-cache aware inference routing with prioritization and flow control, supporting standalone and Gateway API deployment via an endpoint picker.
|
| 09/18 | 7 |
Platform to host, deploy, build, and fine-tune large language models with OpenAI API compatibility.
|
| 10/09 | 6 |
Platform to host, deploy, build, and fine-tune large language models with OpenAI API compatibility.
|
| 10/09 | 6 |
Platform to host, deploy, build, and fine-tune large language models with OpenAI API compatibility.
|
| 10/05 | 6 |
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
|
| 10/04 | 6 |
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
|
| 10/04 | 6 |
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
|
| 10/03 | 6 |
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
|
| 10/03 | 6 |
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
|
| 09/23 | 6 |
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
|
| 09/23 | 6 |
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
|
| 09/14 | 6 |
Platform for deploying, managing, and running GPU-accelerated inference, streaming, and batch workloads across worker clusters.
|
| 10/09 | 5 |
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
|
| 10/07 | 5 |
Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.
|
| 10/05 | 5 |
Platform for deploying, managing, and running GPU-accelerated inference, streaming, and batch workloads across worker clusters.
|
| 09/30 | 5 |
Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.
|
| 09/23 | 5 |
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
|
| 10/03 | 4 |
Platform for deploying, managing, and running GPU-accelerated inference, streaming, and batch workloads across worker clusters.
|
| 09/25 | 4 |
Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.
|
| 09/19 | 4 |
Platform for deploying, managing, and running GPU-accelerated inference, streaming, and batch workloads across worker clusters.
|
| 09/17 | 4 |
Kubernetes operator managing self-hosted LLM inference on NVIDIA GPUs and Apple Silicon, with autoscaling, model routing, and OpenAI-compatible API.
|
| 09/13 | 4 |
Platform for deploying, managing, and running GPU-accelerated inference, streaming, and batch workloads across worker clusters.
|
| 09/24 | 3 |
Platform for deploying, managing, and running GPU-accelerated inference, streaming, and batch workloads across worker clusters.
|
| 09/21 | 3 |
llm-d Router provides load and prefix-cache aware inference routing with prioritization and flow control, supporting standalone and Gateway API deployment via an endpoint picker.
|
| 09/20 | 3 |
Platform for deploying, managing, and running GPU-accelerated inference, streaming, and batch workloads across worker clusters.
|