arXiv AI

CytoCLIP: Learning Cytoarchitectural Characteristics in Developing Human Brain Using Contrastive Language Image Pre-Training

arXiv:2601. 12282v2 Announce Type: replace-cross Abstract: The functions of different regions of the human brain are closely linked to their distinct cytoarchitecture, which is defined by the spatial arrangement and morphology of the cells.

arXiv Computer Vision
Oct 9

PixVL: Self-Supervised Training of Pixel-Level MLLMs via a Unified Mask--Text Consistency Cycle

PixVL introduces a self‑supervised post‑training framework for pixel‑level multimodal large language models, addressing the scarcity of mask‑text pairs and optimization interference between region segmentation and region understanding. It employs a unified Mask‑Text Consistency Cycle that generates and self‑verifies regional descriptions using confuser‑aware semantic verification and cross‑view verification, while a quality‑coupled bidirectional learning strategy turns segmentation and understanding into mutual generators and verifiers. Experiments show that PixVL improves performance on both region understanding and segmentation tasks.

By Yicheng Xiao, Haoxuan Ma, Caorui Li, Yucheng Wu, Weijie Wang, Haoxiao Wang, Shuang Chen, Fan Yang, Haiyun Guo, Jinqiao Wang
arXiv Machine Learning
Aug 12

Retrieval-Augmented Vision Foundation Models for Robust Leukemia Cell Classification across Multiple Microscopy Datasets

arXiv:2608. 10657v1 Announce Type: cross Abstract: Leukemia cell image classification is challenged by real-world domain shifts from acquisition, staining, illumination, and site protocols, causing single-dataset models to generalize poorly in real clinical scenarios.

By Carlos Zamora, Hiram Zuniga, Ulises Orozco-Rosas, Kenia Picos
arXiv AI
Aug 28

From Reasoning to Pixels: Grounded Medical Multimodal LLMs for VQA and Segmentation

The paper introduces MedREAL, a unified framework that aligns linguistic reasoning with spatial grounding for medical visual question answering and segmentation. MedREAL employs Seg Anchored Reasoning Pooling (SARP) to extract semantic evidence from segmentation tokens and a Reasoning-to-Visual (R2V) fusion mechanism to integrate these features into a segmentation pipeline. Using the newly created MedRAVS-13K dataset, MedREAL achieves superior performance, reporting 68.49% gIoU and 70.47% cIoU, and generates evidence masks that consistently match textual diagnoses.

By Haowen Gu, Gensheng Pei, Junzhu Mao, Qiong Wang, Mingwu Ren, Yazhou Yao
Hugging Face Trending Papers
Aug 18

TEAMS: Text-prompted spatiotEmporal dual-heAd Mamba Snake

The paper introduces TEAMS, a vision‑language Mamba snake framework that enhances deep snake instance segmentation. It adds a Spatiotemporal Snake Evolution Strategy to handle complex shapes, a Contour Morphology‑Aware Mamba to improve fine‑grained detail capture, and a Text‑prompted Collaborative Dual‑Head Snake to integrate textual cues and reduce detection errors. Experiments on five medical imaging datasets show TEAMS surpasses existing methods, achieving significant gains in mDice and mBF metrics.

Hugging Face Trending Papers
Jun 3

Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction

Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, their correspondence with the hierarchical organization of the human visual cortex remains an open question.

arXiv Computer Vision
Oct 8

Geometry-Supervised Visual Representation Learning for Multi-Phenotype Lesion Interpretation in Medical VLMs

The paper introduces PureVision, a geometry‑supervised framework for medical vision‑language models that tackles the challenge of interpreting multi‑phenotype lesions. It comprises PureEyes, which imposes geometric constraints to preserve anatomical hierarchies and phenotypic subclass relationships, and PureNeurons, which aggregates lesion‑specific anatomical and phenotypic evidence in a learned latent space. Experiments on LIDC‑IDRI, CBIS‑DDSM, and 3DReasonKnee show that PureVision enhances lesion grounding and phenotype characterization in visual question answering and radiology report generation.

By Hao Wang, Qiwei Zeng, Shuchang Ye, Jinghao Lin, Yuezhe Yang, Yige Peng, Jinman Kim, Lei Bi