on-device-ai

Past 1d, sorted by best first, all versions

10/16	8	qualcomm/GenieX v0.9.0 On-device Gen AI inference runtime for Qualcomm Snapdragon that runs GGUF and precompiled models on Hexagon NPU, Adreno GPU, or CPU via multiple interfaces. Go 8441☆ 792d old #golang #llm #go #sdk #on-device-ai
10/17	7	qualcomm/GenieX v0.9.1 On-device Gen AI inference runtime for Qualcomm Snapdragon that runs GGUF and precompiled models on Hexagon NPU, Adreno GPU, or CPU via multiple interfaces. Go 8441☆ 792d old #golang #llm #go #sdk #on-device-ai
10/17	6	hung-yueh/react-native-litert-lm v0.8.0 React Native library for high-performance on-device LLM inference with LiteRT-LM and Nitro Modules, featuring crash-free memory handling and structured outputs. TypeScript 62☆ 269d old #javascript #c++ #typescript #android #llm