huggingface-transformers

Past 30d, sorted by best first, all versions

06/05

vllm-project/vLLM Semantic Router v0.3.0

System-level router that routes and manages requests across heterogeneous LLMs with signal-driven decisions, semantic caching, and security.

Go 4323☆ 290d old #golang #go #huggingface-candle #bert-classification #huggingface-transformers