Workload-Static Optical Circuit Switching for Scalable LLM Inference Decode
This paper proposes using workload-static optical circuit switching (OCS) for LLM inference decode, exploiting the fixed communication structure of decode to pre-configure circuits per deployment. Co-designed with model...