local-llm

Past 14d, sorted by best first

09/28	8	Nehanth/pooled v1.0.0 Browser-based peer-to-peer LLM inference that pools model layers across devices in a room for fast chat and in-tab coding agents. JavaScript 568☆ 34d old #javascript #browser #llm #inference #local-llm
10/06	6	yoloyash/overtchat mobile-v1.13.0 Lightweight self-hosted chat client focused on fast startup, low resource use, and BYO API keys or local models, with optional web search and mobile support. TypeScript 119☆ 157d old #javascript #typescript #react #nextjs #llm
10/02	6	htobty/ReadyLLM v0.3.0 Visual interface for deploying, monitoring, and tuning local LLMs, with hardware-aware parameter search and ComfyUI-based image and video generation. Python 106☆ 38d old #python #llm #fastapi #comfyui #gguf
10/11	4	mjasnikovs/pi-task v0.42.56 Deterministic spec-orchestration for local models, running fixed refine→research→grill→compose→critique pipeline with crash-safe persisted checkpoints and bundled web/docs/fetch worker tools. TypeScript 143☆ 131d old #javascript #bun #typescript #agent-tools #coding-agent