llm-inference

Past 14d, sorted by best first

08/26	5	tetherto/QVAC sdk-v0.18.2 Local-first, cross-platform SDK for building peer-to-peer AI apps with local model inference, speech, translation, and RAG. TypeScript 554☆ 237d old #javascript #typescript #ai #llm #llama
08/17	3	Avarok-Cybersecurity/Atlas Inference Engine b236 Pure Rust LLM inference engine focused on fast, hardware-optimized local model execution across GPUs and CPUs. JavaScript 650☆ 104d old #javascript #cuda #llm-inference #gb10 #mamba