GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node

llm

Past 30d, sorted by best first
150 results Markdown version
07/29 10
langfuse/Langfuse v4.0.0
LLM engineering platform for collaboratively developing, monitoring, evaluating, and debugging AI applications.
08/25 9
ollama/Ollama v0.33.0
Tool for running and managing large language models.
Go 179530☆ 1157d old #golang #llm #go #llama #llama2
08/25 9
langgenius/Dify 1.17.0
Platform for developing large language model applications with AI workflows, model management, and observability.
TypeScript 153623☆ 1233d old #javascript #python #typescript #ai #llm
08/21 9
CopilotKit/CopilotKit v1.69.0
Tool for building integrated AI assistants and agents that operate within user applications.
TypeScript 37068☆ 1165d old #javascript #typescript #reactjs #react #nextjs
08/21 9
OpenHands/Agent Canvas v1.15.0
Self-hosted developer control center that runs coding agents across local, remote, or cloud backends and automates everyday engineering workflows.
TypeScript 85228☆ 897d old #javascript #typescript #llm #chatgpt #agent
08/20 9
mudler/LocalAI v4.9.0
Self-hosted alternative to popular AI APIs for local inferencing on consumer-grade hardware.
Go 48700☆ 1257d old #golang #api #ai #llm #go
08/19 9
infiniflow/RAGFlow v0.27.0
RAG engine combining large language models with document understanding for accurate question answering and citation.
Go 89293☆ 988d old #golang #typescript #ai #llm #go
08/19 9
ax-llm/Ax 24.0.0
End-to-end streaming framework for building multi-modal agents with typed signatures.
TypeScript 2885☆ 1280d old #javascript #typescript #ai #llm #openai
08/18 9
esengine/Reasonix v1.29.0
DeepSeek-native AI coding agent for your terminal, engineered around prefix-cache stability to keep token costs low across long sessions.
Go 35204☆ 128d old #javascript #golang #typescript #llm #go
08/16 9
labring/FastGPT v4.16.0
Knowledge-based platform leveraging LLMs for data processing, retrieval, and AI workflow orchestration.
TypeScript 29479☆ 1281d old #javascript #typescript #react #nextjs #llm
08/15 9
EKKOLearnAI/Hermes Studio v1.0.0
Hermes Studio is a desktop app, local runtime, and web console for managing Hermes Agent chat, models, profiles, automation jobs, and analytics while keeping everything local.
TypeScript 10623☆ 138d old #javascript #typescript #dashboard #llm #chat-ui
08/13 9
Mintplex-Labs/AnythingLLM v1.16.0
Full-stack application for turning documents into context for LLMs with multi-user management.
JavaScript 64980☆ 1174d old #javascript #llm #ollama #rag #lmstudio
08/05 9
CherryHQ/Cherry Studio v2.0.0
Desktop client supporting multiple LLM providers, available on Windows, Mac, and Linux.
TypeScript 51116☆ 825d old #javascript #typescript #llm #openai #assistant
08/04 9
yamadashy/Repomix v1.18.0
Tool for packing entire repositories into AI-friendly formats.
TypeScript 27770☆ 759d old #javascript #typescript #ai #llm #generative-ai
08/03 9
TencentCloud/TencentDB Agent Memory v2.0.0
TencentDB Agent Memory provides symbolic short-term and layered long-term memory for AI agents to retain context and reduce token usage without external APIs.
TypeScript 24670☆ 142d old #javascript #typescript #llm #agent #memory
07/29 9
synthetic-sciences/OpenScience v2.0.0
Model-agnostic AI workbench that loops through literature review, hypothesis building, code and experiment execution, and research write-ups in a browser workspace.
TypeScript 3343☆ 55d old #javascript #bun #typescript #cli #ai
08/26 8
guangxiangdebizi/FinanceMCP (Synapse) - MCP v4.11.0
MCP integrating Tushare and Binance APIs to provide real-time multi-asset financial data and news for language models.
TypeScript 652☆ 474d old #javascript #finance #typescript #data #llm
08/25 8
lidge-jun/opencodex v2.33.0
Lightweight local proxy that translates Codex Responses API into multiple LLM providers with full support for streaming, tools, reasoning tokens, and images.
TypeScript 12255☆ 69d old #javascript #typescript #llm #claude #gemini
08/24 8
taracodlabs/Aiden v4.21.0
Local-first AI operating system for Windows, Linux, WSL, and macOS with 1,400+ skills, 80+ tools, and provider routing.
TypeScript 790☆ 171d old #javascript #electron #typescript #llm #windows
08/24 8
conorbronsdon/avoid-ai-writing v3.26.0
Audit and rewrite content to remove AI writing patterns, with detect-only or edit-in-place modes and configurable voice profiles for agent skills.
08/24 8
theopenco/LLM Gateway v1.14.0
API gateway that routes and manages requests across multiple LLM providers with an OpenAI-compatible API, usage analytics, and cost tracking.
TypeScript 1576☆ 501d old #javascript #typescript #ai #llm #llms
08/20 8
langchain-ai/LangChain langchain-fireworks=...
Framework for building agents and LLM-powered applications with modular components and integrations.
Python 145090☆ 1410d old #python #ai #llm #langchain #anthropic
08/18 8
frontman-ai/Frontman v3.1.0
Browser-based tool that edits a project's frontend source code from live UI interactions and natural-language instructions.
ReScript 676☆ 330d old #ai #llm #agent #rescript #ai-coding
08/18 8
manojmallick/SigMap v8.28.0
Finds relevant files in a codebase and supplies compact function and class signatures to AI models to reduce tokens and improve answers.
JavaScript 615☆ 145d old #javascript #nodejs #node #llm #claude
08/17 8
r-uby-dev/llm.rb v15.0.0
Advanced Ruby AI runtime for building capable applications with multiple LLM providers, streaming, tool calls, and RAG support.
Ruby 137☆ 693d old #ruby #ai #llm #llm-framework #llm-agents
08/16 8
open-multi-agent/Open Multi-Agent v1.16.0
TypeScript-native multi-agent orchestration that decomposes goals into parallel task DAGs and synthesizes results.
TypeScript 6830☆ 148d old #javascript #typescript #llm #claude #ai-agents
08/11 8
Ryan-yang125/ChatLLM Web v3.0.0
Private local AI chat app running a Llama model in-browser with WebGPU via MLC WebLLM, with streaming, search, and persistent conversations.
TypeScript 629☆ 1209d old #javascript #typescript #reactjs #react #llm
08/10 8
Deuz-AI/Deuz SDK v2.0.0
Zero-dependency TypeScript runtime for production AI agents, providing durable execution, persistent memory, tool calling, approvals, and resumable runs across Node, Bun, Deno, and edge.
TypeScript 128☆ 74d old #javascript #typescript #llm #openai #anthropic
08/07 8
upstash/Context7 MCP @upstash/context7-mc...
Fetches up-to-date documentation and code examples for prompts in LLMs.
TypeScript 61280☆ 518d old #javascript #typescript #llm #mcp #mcp-server
08/06 8
trpc-group/tRPC-Agent-Go v1.11.0
Go framework for building autonomous intelligent agents with multi-agent orchestration, persistent memory, and tool integration.
Go 1726☆ 467d old #golang #ai #llm #go #agent
08/05 8
Compact, human-readable serialization format optimized for structured data in large language model inputs with reduced token usage.
TypeScript 25116☆ 290d old #javascript #typescript #llm #serialization #data-format
08/04 8
promptfoo/Promptfoo 0.122.0
Developer-friendly local tool for testing, evaluating, and securing large language model applications.
TypeScript 24599☆ 1216d old #javascript #typescript #llm #llmops #prompt-engineering
08/02 8
PurpleDoubleD/Locally Uncensored v2.6.0
Plug-and-play local AI desktop app offering chat, agent workflows, and image/video generation with auto-detected local model backends.
TypeScript 999☆ 132d old #javascript #typescript #ai #llm #image-generation
08/01 8
boxed-dev/CogniDB v4.0.0
CogniDB is a Python natural-language to SQL library that generates secure, SELECT-oriented queries with validation, allowlists, and auditing for PostgreSQL, MySQL, and SQLite.
Python 217☆ 604d old #python #mysql #llm #database #anthropic
08/01 8
mengxi-ream/Read Frog v1.45.0
AI-powered browser extension for immersive language learning with translation and article analysis.
07/31 8
kortix-ai/Kortix v0.12.0
Autonomous company OS where Linux-sandboxed AI agents run code, manage files, and automate operations 24/7.
TypeScript 20140☆ 690d old #javascript #typescript #ai #llm #ai-agents
07/29 8
vercel/AI SDK @ai-sdk/minimax@2.0....
TypeScript toolkit for building AI-powered applications with popular frameworks.
07/29 8
rekog-labs/NestJS MCP Server Module v2.0.0
NestJS module that exposes tools, resources, and prompts using the Model Context Protocol.
TypeScript 698☆ 571d old #javascript #typescript #nestjs #llm #llms
08/27 7
dataease/SQLBot v1.10.1
RAG-based conversational data analysis and Text-to-SQL generation using large language models.
JavaScript 6690☆ 493d old #javascript #llm #rag #deepseek #sqlbot
08/26 7
maximhq/Bifrost plugins/telemetry/v1...
High-performance AI gateway offering multi-provider access with automatic failover, load balancing, and zero-downtime deployments.
Go 7593☆ 526d old #golang #llm #go #mcp #gateway
08/26 7
gglucass/Headroom v0.9.0
Local-first desktop tray app that routes coding clients through a token-saving optimization pipeline and shows savings analytics, primarily for Claude Code.
Rust 523☆ 150d old #ai #llm #rust #anthropic #developer-tools
08/26 7
PM-Shawn/Abu v0.42.0
Privacy-first desktop AI coworking app with multi-model support, agent skills, IM integration, MCP/Playwright, scheduling, and built-in security controls.
TypeScript 349☆ 171d old #javascript #typescript #llm #claude #automation
08/26 7
codexu/NoteGen note-gen-v0.36.0
Cross-platform Markdown note-taking application using AI to organize fragmented knowledge into readable notes.
TypeScript 12689☆ 751d old #javascript #typescript #react #nextjs #llm
08/26 7
mastra-ai/Mastra @mastra/core@1.62.0
Opinionated TypeScript framework for building AI applications and features quickly.
TypeScript 27507☆ 750d old #javascript #typescript #ai #llm #agents
08/26 7
trefeon/freebuff-proxy v1.2.0
High-performance OpenAI-compatible gateway and protocol bridge that manages sessions, pools tokens, and forwards chat completions with SSE streaming and TLS stealth.
Go 139☆ 16d old #golang #llm #openai #go #proxy
08/26 7
linshenkx/Prompt Optimizer v2.11.9
Tool for enhancing prompt quality to improve AI interaction results.
TypeScript 33385☆ 561d old #javascript #typescript #llm #prompt #prompt-engineering
08/25 7
lone-cloud/Gerbil v1.28.0
Desktop app for running Large Language Models locally with cross-platform support and integrated image generation.
TypeScript 472☆ 380d old #javascript #electron #typescript #llm #desktop
08/25 7
kizuna-ai-lab/Sokuji v0.39.0
Desktop application providing live speech translation and audio routing using multiple AI-powered APIs.
TypeScript 1133☆ 500d old #javascript #chrome-extension #typescript #ai #llm
08/25 7
hybridgroup/yzma v1.25.0
Go-based library for hardware-accelerated local inference with llama.cpp integration.
Go 568☆ 339d old #golang #llm #go #llama #llamacpp
08/25 7
jundizhou/easy-stock v0.9.0
Local-first A 股行情分析与AI智能投研代理,支持日常共识与短线研判。
08/24 7
tg-prplx/Vellium v1.1.0
Desktop chat app using Electron, local Express API, and SQLite for roleplay and creative-writing LLM workflows.
TypeScript 112☆ 189d old #javascript #electron #typescript #reactjs #react
08/24 7
MemTensor/Memmy v1.1.0
Memory hub and local agent runtime that provides shared long-term personal context across multiple AI agents.
TypeScript 999☆ 41d old #javascript #typescript #ai #llm #agent
08/24 7
FB208/yibiao-simple v2.25.19
Out-of-the-box AI bid writing and checking tool with knowledge base and duplicate detection.
JavaScript 2548☆ 388d old #javascript #electron #typescript #ai #llm
08/23 7
ibrahimqureshae/MDFlux v0.3.0
MDFlux is a local-first desktop tool that converts many document types and scanned PDFs into clean, AI-ready Markdown with OCR and optional cleanup.
Python 409☆ 65d old #python #llm #svelte #markdown #local-first
08/23 7
liliang-cn/CortexDB v2.74.0
Pure-Go, single-file embedded AI memory and knowledge graph library that provides hybrid vector and lexical retrieval, RDF/SPARQL graph features, and MCP tools via SQLite.
Go 250☆ 382d old #golang #llm #go #rag #vector-search
08/23 7
yoshoku/llama_cpp.rb v0.28.0
Ruby bindings for llama.cpp, enabling easy integration of the library in Ruby applications.
C 236☆ 1242d old #ruby #ai #llm #gem #c
08/22 7
cyanheads/obsidian-mcp-server v3.5.0
MCP server for Obsidian vaults that reads, writes, searches, and surgically edits notes, tags, and frontmatter via the Local REST API plugin.
TypeScript 667☆ 577d old #javascript #typescript #llm #note-taking #mcp
08/21 7
ix-infrastructure/Ix v0.10.0
Command-line tool that parses a codebase into a persistent queryable symbol, call, and import graph for efficient AI and human reasoning.
TypeScript 805☆ 177d old #javascript #typescript #cli #ai #llm
08/21 7
nobodywho-ooo/NobodyWho nobodywho-flutter-v3...
Inference engine for running LLMs locally and efficiently on any device.
Rust 1078☆ 723d old #llm #rust #godot #godot-engine #godot-plugin
08/20 7
AhmadHassan-BTed/OpenOPC-Shadow-Adapter v1.0.0
High-concurrency Temporal bridge for OpenOPC that enables non-blocking human sign-off and remote BYOC execution via a shadow portal and SQLite WAL state parking.
08/19 7
CopilotKit/aimock v1.39.0
Mock infrastructure for testing AI applications' external services like LLMs, multimedia APIs, agent protocols, and vector databases.
TypeScript 896☆ 174d old #javascript #typescript #llm #openai #mcp
08/18 7
tomasz-tomczyk/Crit v0.19.0
GitHub PR-style browser UI for reviewing agent-generated files with inline comments and round-to-round diffs.
Go 949☆ 190d old #golang #cli #llm #go #markdown
08/18 7
SAP/SAP Cloud SDK for AI v2.15.0
SDK for integrating SAP AI Core, SAP Generative AI Hub, and orchestration services into JavaScript/TypeScript applications.
TypeScript 122☆ 796d old #javascript #typescript #ai #llm #orchestration
08/16 7
gmickel/GNO v1.35.0
Local knowledge engine for notes, code, PDFs, and Office docs with hybrid search, citations, and verified, explainable answers via CLI, Web UI, REST API, SDK, and MCP.
TypeScript 106☆ 245d old #javascript #bun #typescript #cli #llm
08/15 7
YosefHayim/eBay API MCP Server v1.15.0
MCP server providing AI assistants comprehensive access to eBay Sell APIs with 325 tools for inventory, fulfillment, marketing, and analytics.
TypeScript 124☆ 281d old #javascript #typescript #ai #llm #chatgpt
08/15 7
agentforce314/ClawCodex v1.6.0
Production-oriented Python rebuild of Claude Code featuring a reliable CLI coding agent with token-efficient execution, deterministic token compression, and a DeepSeek prompt-cache adapter.
TypeScript 864☆ 121d old #javascript #typescript #llm #claude #agent
08/14 7
RunanywhereAI/RunAnywhere v0.20.19
On-device mobile SDKs for running LLMs, speech-to-text, and text-to-speech locally.
C++ 10281☆ 401d old #swift #c++ #llm #ios #kotlin
08/13 7
Javis603/Token Monitor v0.44.0
Desktop widget that monitors live token usage and AI tool limits across multiple AI coding tools with real-time multi-device sync and usage history breakdowns.
JavaScript 1347☆ 87d old #javascript #llm #ai-tools #claude-code #codex
08/13 7
chaitin/PandaWiki v3.86.5
AI-driven knowledge base system for quickly building intelligent product documentation, technical documents, FAQs, and blog systems.
TypeScript 10127☆ 460d old #javascript #typescript #ai #llm #document
08/12 7
growthxai/Output v0.11.0
TypeScript framework for building and orchestrating AI workflows and agent-driven development with integrated prompts, tracing, evals, and secrets management.
08/12 7
mkbhardwas12/PrismOS-AI v0.6.0
PrismOS-AI is a desktop AI that answers questions from local Ollama models, stores knowledge on disk, and works offline with a multi-agent pipeline.
Rust 234☆ 168d old #ai #llm #rust #ollama #local-first
08/11 7
ooples/Token Optimizer MCP v5.7.0
Model Context Protocol server that optimizes Claude Code context usage using caching, Brotli compression, and smart tool replacements for large text and file operations.
JavaScript 497☆ 320d old #javascript #typescript #ai #llm #claude
08/10 7
echoVic/Blade Code v0.10.0
AI CLI and web UI coding agent with 20+ tools, MCP support, and configurable providers for model-driven coding workflows.
TypeScript 176☆ 454d old #javascript #typescript #cli #ai #llm
08/09 7
open-gitagent/Gitagent v2.1.0
Gitagent is a git-native multimodal AI agent framework where identity, rules, memory, tools, and skills live as version-controlled files.
TypeScript 643☆ 159d old #javascript #typescript #llm #assistant #anthropic
08/08 7
WiseriaAI/Pie v1.3.0
An AI assistant for Chrome that automates browser tasks from plain-language instructions by reading pages, planning steps, and executing native tool actions in a sidebar.
08/07 7
Tencent/WeKnora v0.7.2
LLM-powered framework for deep document understanding, semantic retrieval, and context-aware answers using the RAG paradigm.
Go 19853☆ 388d old #golang #ai #llm #go #agent
08/05 7
decocms/MCP Mesh v4.187.0
Control plane routing MCP client traffic through one governed endpoint with auth, RBAC, policy enforcement, and observability.
TypeScript 401☆ 531d old #javascript #typescript #ai #llm #agents
08/05 7
Canner/Wren AI 0.29.2
Generative Business Intelligence agent that allows teams to interact with data for generating insights, reports, and visualizations.
Python 17379☆ 895d old #postgresql #python #typescript #postgres #llm
08/05 7
mouseart2025/AI Reader V2 v0.73.0
Novel-analysis visualization tool producing character relationship graphs, maps, timelines and encyclopedias with local and cloud LLM support.
Python 245☆ 185d old #python #llm #fastapi #knowledge-graph #nlp
08/03 7
helixml/HelixML 2.12.0
Private GenAI stack for deploying AI agents with support for RAG, API calls, vision, and efficient GPU scheduling.
Go 802☆ 1045d old #golang #self-hosted #api #llm #openai
08/03 7
VoltAgent/VoltAgent @voltagent/mcp-serve...
TypeScript framework for building and orchestrating AI agents with modular components and standardized patterns.
TypeScript 10282☆ 475d old #javascript #typescript #ai #llm #agents
08/03 7
BlockRunAI/BlockRun MCP v0.35.0
MCP server providing real-time markets, research, X/Twitter, and crypto data for Claude without API keys on a pay-per-call basis.
TypeScript 473☆ 209d old #javascript #typescript #ai #llm #mcp
08/01 7
guaardvark/Guaardvark v2.7.0
Self-hosted AI workstation providing autonomous screen agents, multi-tier neural routing, media generation, upscaling, RAG, voice interface, and local tool execution.
Python 123☆ 151d old #python #ai #llm #flask #ai-agents
08/01 7
7anX/AgentScan v1.1.0
HTTP-based scanner that discovers exposed MCP servers, A2A Agent Cards, and open LLM APIs using one command-line workflow.
Go 99☆ 47d old #golang #llm #go #agent #a2a
07/29 7
epam/DIAL Chat 0.48.0
Default UI for DIAL offering conversation interface, IDP support, model side-by-side comparison, extensions and theming.
TypeScript 505☆ 1082d old #javascript #typescript #llm #ai-dial
07/28 7
vellum-ai/Vellum Assistant v0.11.0
Personal AI assistant that learns your preferences, maintains structured memory, acts proactively, and enforces strict trust and sandboxed tools.
TypeScript 999☆ 177d old #javascript #macos #typescript #llm #openai
08/27 6
yoloyash/overtchat v0.17.0
Lightweight self-hosted chat client focused on fast startup, low resource use, and BYO API keys or local models, with optional web search and mobile support.
TypeScript 77☆ 111d old #javascript #typescript #react #nextjs #llm
08/25 6
sgasser/PasteGuard v0.9.3
OpenAI-compatible privacy proxy that masks personal data and secrets before they reach external LLMs.
TypeScript 738☆ 231d old #javascript #typescript #llm #openai #anthropic
08/25 6
iOfficeAI/AionUi v2.1.61
Modern GUI for multi-model AI chat with integrated file management and Excel processing.
TypeScript 32315☆ 385d old #javascript #typescript #ai #llm #gemini
08/24 6
MemTensor/MemOS memos-local-plugin-v...
Memory operating system for LLMs and AI agents providing unified store/retrieve/manage, multi-modal long-term memory and skill reuse.
TypeScript 10957☆ 415d old #javascript #typescript #llm #agent #memory
08/24 6
ktsoator/or v0.6.16
Modular Go toolkit with provider-neutral language model access and stateful agent tool loops with typed streaming events.
Go 290☆ 67d old #golang #llm #generative-ai #go #agent
08/23 6
libre-webui/Libre WebUI v0.28.0
Privacy-first self-hosted chat interface connecting to local and cloud AI providers with a plugin system and no telemetry or tracking.
TypeScript 74☆ 465d old #javascript #self-hosted #typescript #llm #ollama
08/23 6
heshengtao/Super-Agent-Party v0.4.3
3D AI desktop companion platform with modular LLM enhancements, multi-terminal deployment, and cross-platform compatibility.
JavaScript 2600☆ 534d old #javascript #llm #agent #rag #mcp
08/22 6
xberg-io/liter-llm v1.18.1
A lighter, faster, safer universal LLM API client built with a Rust core and many native language bindings, with a drop-in OpenAI-compatible proxy.
08/21 6
Pinvou/Pinvou Agent v0.8.6
Desktop AI agent workspace that connects models with tools and personal knowledge to produce and manage real deliverable artifacts.
08/21 6
PiSugar/Whisplay-AI-Chatbot v2.1.2
Pocket-sized AI chatbot device built for Raspberry Pi Zero 2w with push-to-talk voice interaction, wake-word, and image generation.
TypeScript 501☆ 472d old #javascript #typescript #ai #llm #chatbot
08/20 6
raketenkater/ggrun v3.2.8
Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API.
Go 266☆ 169d old #golang #llm #go #llama-cpp #cuda
08/20 6
DEEIX-AI/DEEIX Chat v0.3.6
Enterprise AI workspace unifying model routing, multimodal chat, file/RAG workflows, tools, billing, identity, and operations.
Go 1329☆ 95d old #golang #ai #llm #go #open-source
08/20 6
Mars-Sea/dsh-commandcode-provider v0.6.0
Unofficial DeepSeek Harness provider plugin that adds a Command Code provider route with live model catalog, plan/deal annotations, and reasoning-effort plus vision support.
08/19 6
wecode-ai/Wegent wework-v0.2.0
Self-hostable platform for building and running AI agent teams across chat, coding, knowledge, and automation with shared capabilities and local execution via Wework.
TypeScript 714☆ 229d old #javascript #typescript #ai #llm #agent
08/16 6
he-yufeng/RepoWiki v0.3.2
RepoWiki generates structured wiki documentation for local or GitHub codebases from a CLI or web interface, exporting Markdown, JSON, or self-contained HTML with terminal Q&A.
Python 254☆ 134d old #documentation #python #cli #llm #deepwiki
08/16 6
av/Harbor v0.5.5
Containerized toolkit to run local LLM backends, frontends, and related services with minimal configuration.
08/14 6
raindrop-ai/Raindrop Workshop v0.1.19
Local debugger that streams agent traces, runs evals against code, and supports self-healing repair loops.
TypeScript 977☆ 107d old #javascript #typescript #llm #tracing #raindrop
08/11 6
oliver-kriska/scribe v0.5.0
Single-binary CLI that continuously extracts and indexes git, coding-agent sessions, and iMessage bookmarks into an LLM-written wiki for semantic search.
Go 58☆ 119d old #golang #llm #go #cron #claude-code
08/10 6
ferro-labs/Ferro Labs AI Gateway v1.4.2
High-performance Go-based AI gateway routing OpenAI-compatible LLM requests across 30+ providers with caching, guardrails, and cost controls.
Go 242☆ 180d old #golang #llm #go #llmops #ai-gateway
08/10 6
tetherto/QVAC sdk-v0.17.0
Local-first, cross-platform SDK for building peer-to-peer AI apps with local model inference, speech, translation, and RAG.
TypeScript 551☆ 236d old #javascript #typescript #ai #llm #llama
08/08 6
kaito-project/AIKit v0.22.1
Platform to host, deploy, build, and fine-tune large language models with OpenAI API compatibility.
08/06 6
hung-yueh/react-native-litert-lm v0.6.0
React Native library for high-performance on-device LLM inference with LiteRT-LM and Nitro Modules, featuring crash-free memory handling and structured outputs.
C++ 54☆ 217d old #c++ #android #llm #ios #on-device-ai
08/04 6
Prism-Shadow/PenguinHarness v0.2.1
Automated agent builder that creates self-evolving agents from prompts, supports RAG app scaffolding, and improves via benchmarking and traceable self-optimization.
TypeScript 997☆ 20d old #javascript #typescript #ai #llm #agent
08/04 6
mybigday/llama.rn v0.12.9
React Native binding for running LLaMA model inference with multimodal support including vision and audio.
C++ 1026☆ 1120d old #c++ #react-native #android #react #llm
08/01 6
Agent-Field/AgentField v0.1.119
Control-plane infrastructure that deploys, scales, and secures autonomous AI agents as observable, identity-aware backend services.
Go 2529☆ 295d old #golang #ai #llm #go #agent
08/01 6
vstorm-co/Full-Stack AI Agent Template 0.2.19
Production-ready FastAPI+Next.js template for building type-safe AI/LLM agents with streaming, auth, observability, multi-DB support, and 20+ integrations.
Python 1696☆ 232d old #docker #python #llm #fastapi #ai-agents
07/30 6
openeverest/OpenEverest v1.16.2
Cloud-native, multi-database platform for automated provisioning, deployment, scaling, and management on Kubernetes.
TypeScript 865☆ 945d old #javascript #typescript #llm #kubernetes #open-source
07/30 6
adham90/RubyLLM::Agents v3.15.1
Rails engine providing an agent DSL, execution tracking, cost analytics, reliability controls, and a real-time dashboard for LLM-powered agents.
Ruby 133☆ 248d old #ruby #rails #dashboard #llm #monitoring
07/29 6
adaline/Adaline Gateway v1.12.1
Fully local, production-ready SDK that provides a unified interface for calling over 300 LLMs with batching, caching, and extensibility.
TypeScript 602☆ 654d old #javascript #typescript #ai #llm #language-model
08/27 5
goccy/go-llama v0.2.3
Pure Go inference engine for GGUF models, built from llama.cpp compiled to WebAssembly and translated to Go without wasm runtime.
Go 144☆ 26d old #golang #ai #llm #go #llama
08/26 5
whiteguo233/OpenBiliClaw extension-v0.3.212
Local, private, self-improving content discovery agent that learns from interactions to find videos and posts across Bilibili, Xiaohongshu, Douyin, YouTube, and more.
Python 3056☆ 173d old #python #llm #open-source #bilibili #ai-agent
08/26 5
elevenlabs/ElevenLabs Monorepo for NPM Package @elevenlabs/react@1....
Monorepo managing multiple npm packages under the @elevenlabs scope.
TypeScript 111☆ 644d old #javascript #typescript #reactjs #react #llm
08/26 5
xiayu1987/Noobot v4.2.5
Self-hosted AI agent workspace providing isolated sessions, tool calling, multi-model routing, MCP connectors, and multi-agent workflows via web and desktop clients.
JavaScript 76☆ 132d old #javascript #electron #llm #mcp #ai-agent
08/25 5
mamawai/WhatIfIBought v2.0.4
Live arena where LLM trading agents trade real market data with virtual money while exposing every thought, tool call, and post-trade review.
08/24 5
genai-io/San v1.22.5
Terminal-native unified runtime for specialized AI agents built on pluggable LLMs, search backends, personas, and skills.
Go 75☆ 721d old #golang #llm #go #automation #ai-agents
08/23 5
zendev-sh/GoAI v0.9.7
Go SDK providing a unified API for 25+ AI providers with streaming, structured output, and MCP support.
Go 186☆ 159d old #golang #ai #llm #go #ai-tools
08/21 5
Protocol-Lattice/Lattice v1.14.8
Go agent framework with graph-aware memory, UTCP-native tools, and multi-agent orchestration.
Go 253☆ 315d old #golang #llm #go #rag #agents
08/20 5
shenmintao/Marginalia v0.3.6
Local-first research agent that ingests messy personal knowledge, keeps it in a folder tree, reads original source windows, and generates cited answers with durable notes.
08/19 5
i-am-bee/BeeAI Framework python_v0.1.83
Toolkit for building intelligent, autonomous agents and multi-agent systems with reasoning and collaboration capabilities.
Python 3384☆ 727d old #python #framework #ai #llm #agents
08/19 5
tingly-dev/Tingly Box v0.260819.0
High-performance desktop LLM proxy that unifies access to many models and providers via a single OpenAI-compatible API.
Go 344☆ 279d old #golang #llm #go #agent #proxy
08/14 5
baalimago/clai v1.10.22
Command-line context feeder for LLMs, enabling vendor-agnostic conversations, profiles, and Unix-like piping workflows.
Go 146☆ 897d old #golang #cli #ai #llm #go
08/11 5
sammcj/Ingest v0.15.6
Parses code, text files, and websites into a single markdown prompt suitable for LLM ingestion.
Go 384☆ 745d old #golang #ai #llm #go #codegen
08/11 5
usewhale/Whale v0.1.66
Blazingly fast terminal-first AI coding agent for DeepSeek, featuring long-context support, MCP tools, and programmable dynamic workflows.
Go 936☆ 99d old #golang #llm #go #terminal #deepseek
08/10 5
berelevant-ai/slopless v0.2.36
Deterministic English Markdown linter with a zero-config textlint preset and CLI that flags AI-sounding prose slop for iterative rewriting.
TypeScript 321☆ 93d old #javascript #linter #typescript #cli #ai
08/10 5
zkwi/VoxType v0.12.1
Privacy-conscious Windows voice typing app that provides live captions, uses a cloud ASR provider, optionally runs light LLM editing, then pastes text.
Rust 60☆ 139d old #llm #rust #asr #dictation #doubao
08/10 5
gollem-dev/gollem v0.28.1
Go framework for agentic AI apps, offering unified LLM generation and embeddings, tool integration via MCP, session management, and structured outputs.
Go 191☆ 478d old #golang #llm #go #ai-agents
08/02 5
timmyy123/LLM Hub studio-v1
Mobile app for on-device LLM chat, image generation, and video generation, featuring an autonomous AI agent with local-first privacy and offline media tools.
TypeScript 529☆ 391d old #javascript #typescript #ai #llm #llama
08/02 5
livetennisapi/livetennisapi-mcp v1.2.3
Live Tennis API MCP server that provides real-time scores, player and fixture lookup, plus odds and model win-probability tools for LLM agents.
JavaScript 214☆ 15d old #javascript #ai #llm #claude #mcp
07/30 5
kevin333353/Jobsmith v0.1.8
A multi-agent AI job search co-pilot for Taiwan that automates job discovery, resume checks, tailored applications, and interview practice via CLI and Windows app.
Python 138☆ 39d old #python #llm #fastapi #langgraph #ai-agents
08/24 4
coddy-project/Coddy 0.9.79
Coddy is a distroless-friendly Go-based general-purpose agent harness with a ReAct loop, ACP/HTTP/Telegram interfaces, MCP and skills integration, and long-term memory.
Go 126☆ 156d old #golang #cli #llm #go #agent
08/21 4
off-grid-ai/Off Grid AI v0.0.43
Local-first AI runtime with a studio and an OpenAI-compatible gateway, running open multimodal models entirely on-device with an optional always-on assistant layer.
TypeScript 82☆ 220d old #javascript #electron #typescript #llm #local-first
08/20 4
Anionex/nano banana pro🍌 v0.9.0-rc.4
AI-native PPT generation app that turns ideas, outlines, documents, and images into editable PPTX with template control and conversational refinement.
TypeScript 15498☆ 268d old #javascript #typescript #llm #ai-slides #ai-ppt-maker
08/18 4
truffle-ai/Dexto @dexto/tools-filesys...
Universal intelligence layer that orchestrates LLMs, tools, and data to build stateful, multimodal agentic applications.
TypeScript 647☆ 513d old #javascript #typescript #llm #mcp #ai-tools
08/16 4
code-yeongyu/senpi v2026.8.16
Opinionated TypeScript monorepo fork of pi-mono that provides a curated coding-agent runtime with builtin extensions and core tweaks.
TypeScript 405☆ 170d old #javascript #typescript #cli #llm #agent
07/30 4
andreiramani/pgvector 0.8.6_13
PostgreSQL extension compiled for Microsoft Windows x64 enabling vector operations.
187☆ 726d old #postgresql #postgres #llm # #rag
08/26 3
PostgreSQL MCP server enabling SQL queries from MCP-compatible clients, with a natural-language agent plus CLI and web UIs.
Go 219☆ 302d old #golang #postgresql #postgres #ai #llm
08/21 3
mikjee/warpdrv v0.6.17-beta
Desktop toolkit for managing llama-server instances and chatting with local LLMs, featuring a rich UI, voice, MCP tools, and workflow helpers like RAG and agents.
TypeScript 71☆ 159d old #javascript #typescript #reactjs #react #ai
08/21 3
nullpointexception-i/AgentSphere v1.0.70-alpha
LLM-driven AI agent orchestration platform that coordinates a perception–planning–execution–feedback loop with tool, MCP, CLI, and browser capabilities.
Java 121☆ 64d old #java #reactjs #react #llm #agent
08/19 3
Rheosoph/Flow-Like beta-v0.1.8
Rust-powered visual workflow automation platform running locally on devices with strong typing and full execution tracing.
Rust 938☆ 555d old #javascript #typescript #llm #rust #workflow
08/13 3
statelyai/Stately Agent @statelyai/agent@2.0...
State-machine-powered LLM agent logic built on XState, where model decisions and tool effects run within explicit, inspectable control flow.
TypeScript 450☆ 976d old #javascript #typescript #ai #llm #agents
08/06 3
seuros/ActionMCP action_mcp/v0.200.2
Ruby gem providing Model Context Protocol server support for Rails applications with network-based deployments.
Ruby 117☆ 539d old #ruby #ai #llm #mcp #mcp-server
08/03 3
lgy1027/Matrix Live Diarizer v0.2.0-beta
Local-first live meeting transcription with on-device diarization, streaming captions, and optional voice matching, exporting results as SRT, VTT, and JSON.
Python 174☆ 149d old #docker #python #llm #fastapi #asr
07/30 3
nodetool-ai/NodeTool v0.7.1-nightly.20260...
Visual platform for building and deploying AI workflows, agents, and multimodal pipelines via drag-and-drop nodes.
TypeScript 491☆ 882d old #javascript #typescript #ai #llm #openai
08/19 2
sgl-project/RoleBasedGroup (RBG) v0.8.0-alpha.5
Kubernetes API for orchestrating distributed, stateful LLM inference with multi-role collaboration and built-in service discovery.
Go 284☆ 361d old #golang #llm #go #k8s #sglang