Empirical Study Maps Failure Modes in LLM GPU Kernel Libraries
Researchers manually analyzed 300 GitHub issue reports, discussions, and fixes across seven GPU kernel libraries used in LLM systems: FlashInfer, FlashAttention, Triton, CUTLASS, DeepGEMM, xFormers, and bitsandbytes. The...