Multimodal models

Vision-language models, speech and cross-modal systems that read, look and listen in the same forward pass.

8,964 stories · RSS feed

arXiv AI
Jul 16

Groc-PO: Grounded Context Preference Optimization for Truthful Multimodal LLMs

arXiv:2607. 13712v1 Announce Type: cross Abstract: Despite the rapid progress of Multimodal Large Language Models (MLLMs), they still suffer from untruthfulness issues, such as visual hallucinations, content fabrication, and unfaithful reasoning, which substantially undermine their faithfulness and practical utility.

By Zhixiao Zheng, Zheren Fu, Zhiyuan Yao, Chunxiao Liu, Dongming Zhang, Zhendong Mao
arXiv Machine Learning
Jul 16

A novel unsupervised machine learning strategy to handle multimodal cardiac PET/MRI data

arXiv:2607. 13936v1 Announce Type: cross Abstract: Arrhythmogenic left ventricular cardiomyopathy is a genetic myocardial disease difficult to diagnose due to the lack of gold standard criteria.

By Brunnhilde Ponsi (Nantes Universit\'e, CHU Nantes, Nantes, France, CRCI2NA, INSERM UMR 1307, Nantes, France), Thomas Carlier (Nantes Universit\'e, CHU Nantes, Nantes, France, CRCI2NA, INSERM UMR 1307, Nantes, France), Lara Marteau (Nantes Universit\'e, CHU Nantes, Nantes, France, Cardiology Department, INSERM UMR 1307, CIC 1413, l'institut du Thorax, Nantes, France), Aur\'elien Monnet (Siemens Healthineers France, Courbevoie, France), Thomas Eug\`ene (Nantes Universit\'e, CHU Nantes, Nantes, France, CRCI2NA, INSERM UMR 1307, Nantes, France), Jean-Michel Serfaty (Nantes Universit\'e, CHU Nantes, Nantes, France, Radiology Department, l'institut du Thorax, Nantes, France), Nicolas Piriou (Nantes Universit\'e, CHU Nantes, Nantes, France, Cardiology Department, INSERM UMR 1307, CIC 1413, l'institut du Thorax, Nantes, France), Hatem Necib (Nantes Universit\'e, CHU Nantes, Nantes, France, CRCI2NA, INSERM UMR 1307, Nantes, France)
arXiv Machine Learning
Jul 16

Multimodal Empirical Bayes Variational Autoencoders for Joint Longitudinal and Time-to-Event Modeling

arXiv:2607. 13984v1 Announce Type: cross Abstract: Longitudinal tumor measurements, dropout information, and genetic covariates provide complementary information about treatment response, but integrating these data sources within a single population modeling framework remains challenging.

By Anders Sj\"oberg, Nils Olsson, Marcus Baaz, Mats Jirstrand
arXiv Machine Learning
Jul 16

RF-Informed Graph Neural Networks for Accurate and Data-Efficient Circuit Performance Prediction

arXiv:2508. 16403v3 Announce Type: replace Abstract: Accurately predicting the performance of active radio frequency (RF) circuits is essential for modern wireless systems but remains challenging due to highly nonlinear behavior and the high computational cost of traditional simulation tools.

By Anahita Asadi, Leonid Popryho, Inna Partin-Vaisband
arXiv AI
Jul 16

UESF-Bench: Benchmarking and Probing for Unified Embodied Seeking and Following

arXiv:2607. 13621v1 Announce Type: new Abstract: Language-guided human following is an important capability for embodied agents, but existing benchmarks typically assume that the target person is visible at the start of an episode.

By Kun Yu, Jianhua Yang, Yixiang Chen, Changwei Wang, Hongyuan Yu, Yan Huang, Fushuo Huo, Ya Jing, Zhumin Chen, Keji He