GitHub Release Tracker

08/21

8

NVIDIA/NVIDIA GPU Operator v26.7.0

Automates installation and lifecycle management of GPU drivers, container runtimes, and monitoring on Kubernetes nodes.

Go 2847☆ 2735d old #golang #kubernetes #go #gpu #cuda

08/13

8

replicate/Cog v0.22.0

Tool for packaging machine learning models in production-ready containers.

Go 9460☆ 2001d old #golang #docker #go #deep-learning #machine-learning

08/20

6

raketenkater/ggrun v3.2.8

Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API.

Go 266☆ 169d old #golang #llm #go #llama-cpp #cuda

08/12

6

kibae/pg_onnx v1.29.0

ONNX Runtime integration enabling machine learning inference within PostgreSQL databases.

C++ 61☆ 1063d old #c++ #ai #deep-learning #cuda #contributions-welcome

08/23

5

sonots/Cumo v0.5.10

CUDA-aware GPU-optimized numerical library compatible with Ruby Numo for enhanced performance.

C 99☆ 3207d old #ruby #c #cuda #numo #scicentific-computing

08/17

3

Avarok-Cybersecurity/Atlas Inference Engine b236

Pure Rust LLM inference engine focused on fast, hardware-optimized local model execution across GPUs and CPUs.

JavaScript 650☆ 104d old #javascript #cuda #llm-inference #gb10 #mamba

08/16

3

beam-cloud/Beta9 gateway-0.1.757

Fast serverless runtime for GPU inference, isolated sandboxes, and scalable background jobs.

Go 1744☆ 1006d old #golang #generative-ai #go #gpu #cuda

08/21	8	NVIDIA/NVIDIA GPU Operator v26.7.0 Automates installation and lifecycle management of GPU drivers, container runtimes, and monitoring on Kubernetes nodes. Go 2847☆ 2735d old #golang #kubernetes #go #gpu #cuda
08/13	8	replicate/Cog v0.22.0 Tool for packaging machine learning models in production-ready containers. Go 9460☆ 2001d old #golang #docker #go #deep-learning #machine-learning
08/20	6	raketenkater/ggrun v3.2.8 Auto-tuned launcher that measures multi-GPU hardware for GGUF models, picks an optimal llama.cpp/ik_llama.cpp backend, and serves an OpenAI-compatible API. Go 266☆ 169d old #golang #llm #go #llama-cpp #cuda
08/12	6	kibae/pg_onnx v1.29.0 ONNX Runtime integration enabling machine learning inference within PostgreSQL databases. C++ 61☆ 1063d old #c++ #ai #deep-learning #cuda #contributions-welcome
08/23	5	sonots/Cumo v0.5.10 CUDA-aware GPU-optimized numerical library compatible with Ruby Numo for enhanced performance. C 99☆ 3207d old #ruby #c #cuda #numo #scicentific-computing
08/17	3	Avarok-Cybersecurity/Atlas Inference Engine b236 Pure Rust LLM inference engine focused on fast, hardware-optimized local model execution across GPUs and CPUs. JavaScript 650☆ 104d old #javascript #cuda #llm-inference #gb10 #mamba
08/16	3	beam-cloud/Beta9 gateway-0.1.757 Fast serverless runtime for GPU inference, isolated sandboxes, and scalable background jobs. Go 1744☆ 1006d old #golang #generative-ai #go #gpu #cuda