python3Packages.flashinfer-python
flashinfer-python 0.7.1 · pkgs/development/python-modules/flashinfer-python/default.nix
Health
Risk
risk 0 ok
Version
0.7.1 no newer release known to repology
Channels
Hydra
no finished build of nixpkgs/unstable/python3Packages.flashinfer-python.x86_64-linux
Advisories
none open
Packaging
meta complete
Packagewhat each field means
Description
Library and kernel generator for Large Language Models
Long description
FlashInfer is a library and kernel generator for Large Language Models
that provides high-performance implementation of LLM GPU kernels such as
FlashAttention, PageAttention and LoRA. FlashInfer focus on LLM serving
and inference, and delivers state-of-the-art performance across diverse
scenarios.
Homepage
Download page
License
Platforms
31 platforms: Linux, Darwin
Main program
flashinferSource provenance
not set: built from source
Outputs
out distStatus
not broken, not insecure, free
Maintainers
Teams
Version bumps 1all open bumps
python3Packages.flashinfer-python: 0.7.1 -> 0.7.2
#574635 by GaetanLepage · opened 1d ago · checks pass
Pull requests 2
python3Packages.flashinfer-python: 0.7.1 -> 0.7.2
#574635 by GaetanLepage · opened 1d ago · checks pass
Closed or merged in the synced window 2
Issues 0
None open.