LM-SimBench: A Unified Framework, Dataset, and Benchmark for Large Language Model Training Simulation
LM-SimBench is a unified framework, profiling dataset, and benchmark for evaluating LLM training simulators. It decomposes simulation into functional stages from model compilation to schedule-level aggregation and connec...