Matched-Pair Study Finds Earth-Observation Pretraining Is Not Uniformly Better
A new arXiv study compares five matched pairs of Earth-observation and generic vision encoders across 14 frozen models and five RGB scene-classification datasets. EO pretraining significantly helped SatDINO, Scale-MAE and RemoteCLIP, but significantly hurt DINOv3-SAT and SatMAE on linear probing, with DINOv3-SAT dropping by up to 22.5 points. Two MAEs pretrained on the same fMoW-RGB imagery produced opposite outcomes, and gains or losses were largest with 1-5% labels. The authors conclude that satellite pretraining is not a reliable selection criterion and that candidate checkpoints should be validated on target data.
It gives AI practitioners a concrete, controlled warning that Earth-observation foundation models can underperform generic encoders depending on the checkpoint and task.
Comments & Questions (0)
No comments yet
Be the first to comment!