AWS launches SageMaker JumpStart Model Leaderboard for comparing foundation models
AWS has introduced the SageMaker JumpStart Model Leaderboard, a view inside SageMaker Studio that compares open-weight foundation models on quality, speed and cost. It reports AWS-run scores on BIG-Bench Hard, GPQA Diamond and MMLU-Pro, plus measured latency, throughput and instance cost for each deployment configuration. At launch the leaderboard covers 70+ models from providers including Meta, Google, Qwen, IBM and Arcee. Users can filter, sort, and deploy a model matching the configuration they compared.