arXiv Computation and Language By Yunseo Lee, Hyun Jun Kim, Heeseung Shin, Changwon Lim

Towards Clinically Faithful Medical Image Captioning via Enhanced Vision-Language Alignment

Read the original on arXiv Computation and Language →

arXiv:2608. 19825v1 Announce Type: cross Abstract: Medical image captioning is a technique that accelerates early-stage diagnostic workflows and enhances the interpretability of medical diagnostic AI systems.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computer Vision
Oct 5

DEPICT: Scoring Text-to-Image Alignment by Answer Agreement

DEPICT is a new training‑free metric for evaluating text‑to‑image alignment. It replaces fixed reference answers with an agreement rule that compares image‑based and caption‑only responses, weighting questions by how decisively the caption determines them. By merging this agreement score with a holistic score, DEPICT improves negation accuracy dramatically and outperforms existing training‑free metrics while matching or exceeding fine‑tuned evaluators on several benchmarks.

By Vasco Ramos, Sandra Godinho Silva, Joao Magalhaes, Ricardo Rei, Pedro Henrique Martins
arXiv AI
Sep 28

ViSTA: A Simple Bridge Extends Visual Alignment to Clinical Time-Series Understanding in Multimodal LLMs

ViSTA is a lightweight adapter that adds irregular numerical measurements to a pretrained vision‑language model’s chart representations, enabling accurate clinical time‑series prediction without altering the base model’s parameters. On the MIMIC‑IV dataset, ViSTA outperforms other adaptations across four metrics for acute kidney injury and mortality prediction, achieving an AUC of 0.7376 with only 0.516 million trainable parameters. It also delivers strong temporal question‑answering performance, reaching 69.27% accuracy with significantly fewer trainable parameters than low‑rank adaptation methods.

By Junyi Gao, Yu Shi, Pingzhao Hu, Ewen M Harrison