GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node
24h 7d 14d 30d | Newest Best Latest version only Popular

incubating

Past 14d, sorted by best first
2 results Markdown version
05/31 5
llm-d/vLLM Simulator v0.9.1
Lightweight simulator emulating LLM inference HTTP endpoints and Prometheus metrics for development and testing.
Go 138☆ 418d old #golang #go #incubating
05/25 5
llm-d/KV-Cache v0.8.1
Distributed KV tensor cache indexer and routing library for KV-cache-aware LLM inference scheduling.
Go 150☆ 396d old #golang #ai #go #incubating