arXiv Machine Learning
4d ago

A Comparative Study of Importance Attribution to Columns in Deep Learning over Relational Databases

The paper presents a systematic comparison of importance‑attribution methods for deep learning models that operate on relational databases. It evaluates four methods—Monte Carlo Shapley, Kernel SHAP, single‑attribute impact, and mask learning—across regression and classification tasks using GraphSAGE and Relational Graph Transformers. The study finds that method choice affects attribute rankings and score distributions, with single‑attribute impact often matching Shapley‑based methods at lower cost, especially in regression settings.

By Hila Levi-Yosefi, Shunit Agmon, Ester Livshits, Agapi Rissaki, Benny Kimelfeld
arXiv Machine Learning
Aug 27

Why Does Graph Learning Fail to Fully Benefit from a Text Teacher?

The paper examines a multimodal approach that combines a self‑supervised GNN encoder with an alternating optimization scheme involving a language‑model teacher. Despite the expectation that this joint strategy would enhance predictive performance, the authors find that the combined model fails to deliver significant gains. They identify six key factors—ranging from anchor strength trade‑offs to misaligned representation spaces—that explain why the integration of text knowledge does not fully benefit graph learning.

By Fumiaki Kimino (SOKENDAI), Ryoma Sato (SOKENDAI, National Institute of Informatics)