Sign in with GitHub

← Back to Discover

flashinfer-ai/flashinfer

PythonApache-2.0activepopular

Health

FlashInfer: Kernel Library for LLM Serving

Stars5.6k

Forks979

Open Issues589

Contributors979

Last Push3d ago

Health Breakdown

Activity

25

Community

25

Maintenance

12

Popularity

25

#attention#cuda#distributed-inference#gpu#jit#large-large-models#llm-inference#moe#nvidia#pytorch

View on GitHub ↗Issues (589) ↗Pull Requests ↗

Community

flashinfer-ai/flashinfer

PythonApache 2.0

FlashInfer: Kernel Library for LLM Serving

activepopular

★ 5.6k979 contributors3d ago

More Python repos

isaac-sim/IsaacLab

Unified framework for robot learning built on NVIDIA Isaac Sim

home-assistant/core

:house_with_garden: Open source home automation that puts local control and privacy first.

hardikvasa/google-images-download

Python Script to download hundreds of images from 'Google Images'. It is a ready-to-run code!