Hugging Face Trending Papers

Not All Patches are Equal: Sampling Matters for Visible-Infrared Pre-Training

Read the original on Hugging Face Trending Papers →

Visible-infrared (VIS-IR) alignment is a key pre-training task for robust multi-sensor perception. Most existing methods use uniform patch-wise contrastive learning, but this can be unreliable in VIS-IR data because imaging-physics differences make some spatially paired regions inherently less comparable, and aligning them with equal strength hinders representation learning and downstream transfer.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

Hugging Face Trending Papers
Aug 13

P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation

Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textural features remains a fundamental challenge. Existing prior-guided methods often rely on static constraints that induce optimization conflicts or utilize extrinsic semantic priors from large-scale foundation models (e.

arXiv AI
Sep 17

Ranking Infrared-Visible Fusion the Way Humans Do: A Learned Pairwise Preference Measure

The paper introduces the Learned Perceptual Image Fusion Measure (LPIFM), a model trained on dense human pairwise comparisons to assess infrared-visible image fusion. LPIFM jointly processes both source images and fused candidates using a shared hierarchical encoder, triadic interaction, and a tie-aware objective, achieving high agreement with human judgments and outperforming 19 conventional metrics. The authors release a large comparison corpus, model weights, and code, demonstrating LPIFM’s rapid adaptability to new fusion-evaluation protocols.

By Haoran Liu, Mingzhe Liu, Peng Li, Guibin Zan