arXiv Machine Learning

Symmetric Divergence and Normalized Similarity: A Unified Topological Framework for Representation Analysis

arXiv:2606. 06342v1 Announce Type: cross Abstract: Topological Data Analysis (TDA) offers a principled, intrinsic lens for comparing neural representations.

arXiv Computer Vision
Sep 21

Graph-Augmented Topological Internalization with Dual-Stream Classifiers for Medical Report Generation

The paper introduces GDMRG, a Graph-Augmented Dual-Stream Medical Report Generation framework that incorporates a Topological Knowledge Internalization module using a Graph Convolutional Network to encode disease co-occurrence priors. It employs a dual-stream classifier—one branch generating diagnostic prompts under topological constraints and an auxiliary branch dynamically calibrating decision boundaries for imbalanced samples—alongside a Diagnosis-Guided Spatial Attention mechanism to align visual features with clinical semantics. Experiments on MIMIC-CXR show competitive clinical efficacy and natural language fluency, with strong zero-shot performance on IU X-Ray.

By Moyu Tang, Shangkun Sima, Chupei Tang, Junxiao Kong, Di Wang, Tianchi Lu
arXiv AI
Jun 24

Mind the Heads: Topological Representation Alignment for Multimodal LLMs

arXiv:2606. 23885v1 Announce Type: cross Abstract: Representation alignment has emerged as an effective approach to improve Multimodal Large Language Models (MLLMs) by regularizing their internal representations toward those of an external vision encoder.

By Davide Caffagni, Alberto Compagnoni, Federico Melis, Sara Sarto, Pier Luigi Dovesi, Mark Granroth-Wilding, Marcella Cornia, Lorenzo Baraldi