Zyphra ZYFA: FP8 FlashAttention for AMD MI355X, Up to 1.76x Faster
Zyphra released ZYFA, an open-source FP8 and BF16 prefill attention kernel library for AMD Instinct MI355X GPUs. It achieves 1.16-1.76x speedups over AMD's AITER on real model activations, with lower FP8 error. The...