Fixing evaluation bias for model selection on Amazon Bedrock
AWS and Property Finder describe how 96.8% of evaluation labels had been inherited from the incumbent model, biasing comparisons against alternatives. They built expert-annotated ground truth and used iterative prompt op...