Mitigating Support-Set Target Leakage in Relational In-Context Learning
September 30, 2026
Relational foundation models suffer from support-set target leakage when labeled examples contain features unavailable during queries. The study proposes using Integrated Gradients to detect and remove 14 synthetic leaker types, improving the reliability of relational in-context inference on RelBench databases.
HOW THIS AFFECTS YOU
●
builderYou can use Integrated Gradients to audit your support sets for features that might cause deceptive performance gains.
●
researcherThis provides a framework for identifying specific failure modes in relational ICL.