Research
Matched-Pair Study Finds Earth-Observation Pretraining Is Not Uniformly Better
A new arXiv study compares five matched pairs of Earth-observation and generic vision encoders across 14 frozen models and five RGB scene-classification datasets. EO pretraining significantly helped SatDINO, Scale-MAE and RemoteCLIP, but significantly hurt DINOv3-SAT and SatMAE on linear probing, with DINOv3-SAT dropping by up to 22.5 points. Two MAEs pretrained on the same fMoW-RGB imagery produced opposite outcomes, and gains or losses were largest with 1-5% labels. The authors conclude that satellite pretraining is not a reliable selection criterion and that candidate checkpoints should be validated on target data.
Earth observationfoundation modelsrepresentation learning