#gpu

gittensor-ai-lab/sparkinfer

C++

94

health

Fastest MoE/LLM inference runtime for consumer and edge Blackwell GPUs. SN74 on Gittensor.

apache/tvm

Python

91

health

Open Machine Learning Compiler Framework

apache/tvm-ffi

C++

90

health

Open ABI and FFI for Machine Learning Systems

koide3/gtsam_points

C++

89

health

A collection of GTSAM factors and optimizers for point cloud SLAM

zeux/meshoptimizer

C++

89

health

Mesh optimization library that makes meshes smaller and faster to render

meta-pytorch/torchrec

Python

88

health

Pytorch domain library for recommendation systems

NVIDIA/TransformerEngine

Python

88

health

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

orhun/ratty

Rust

88

health

A GPU-rendered terminal emulator with inline 3D graphics 🐀🧀

ashvardanian/StringZilla

C

88

health

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

luigifcruz/CyberEther

C++

88

health

High-performance GPU-accelerated signal processing and visualization framework that runs anywhere.

i42output/neoGFX

C++

88

health

Cross-platform GPU-oriented C++ application/game framework

kennss/SiliconScope

Swift

88

health

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

seerge/g-helper

C#

88

health

Lightweight Armoury Crate alternative for Asus laptops with nearly the same functionality. Works with ROG Zephyrus, Flow, TUF, Strix, Scar, ProArt, Vivobook, Zenbook, Expertbook, ROG Ally, and more.

NVIDIA/cudnn-frontend

Python

87

health

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

NVIDIA/cudf

C++

86

health

cuDF - GPU DataFrame Library

KytyPS5/KytyPS5

C++

86

health

PlayStation 5 emulator for Windows, Linux and MacOS

lemonade-sdk/lemonade

C++

86

health

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

tenstorrent/tt-metal

Python

80

health

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

NVIDIA/aicr

Go

79

health

Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes

Wangmerlyn/KeepGPU

Python

49

health

KeepGPU is a simple CLI app that keeps your GPUs running.