NVIDIA Shows 3 Ways to Speed Up MoE Inference on DGX Spark, Lifting Ling-3.0-flash Throughput 42.5%
NVIDIA's technical blog details three optimizations for mixture-of-experts (MoE) inference on a single DGX Spark desktop system, using Ant Group's Ling-3.0-flash model. The optimizations—Humming MXFP4 MoE kerne...