Products
Zyphra ZYFA: FP8 FlashAttention for AMD MI355X, Up to 1.76x Faster
Zyphra released ZYFA, an open-source FP8 and BF16 prefill attention kernel library for AMD Instinct MI355X GPUs. It achieves 1.16-1.76x speedups over AMD's AITER on real model activations, with lower FP8 error. The performance gains come from a lean softmax approximation and a two-wave ping-pong schedule that better overlap matrix and vector operations.
AMD Instinctattention kernelsFP8 inference