Research Editor selected
MoREGT: Agent-Guided Mixture-of-Relational-Experts Boosts Cross-Database Generalization
The paper introduces MoREGT, a mixture-of-relational-experts graph transformer for cross-database generalization, which represents rows and cells as tokens and uses column metadata for expert routing. A label-blind LLM agent adds validated derived columns from target database schema and statistics. On 21 RelBench tasks, MoREGT outperforms the Relational Transformer pretrained on the same databases and achieves higher mean AUROC and lower nMAE than RT-J, which pretrains on about 400 times more databases.
Why it matters: This presents a concrete architectural and agent-based method that improves cross-database generalization with less pretraining data, offering practical value for relational learning.
Relational foundation modelsCross-database transferMixture-of-experts