arXiv AI

Distilling Vision-Language Models for On-Device Fire Understanding

arXiv AI
Sep 10

SAFIRE: Safety-Critical Benchmark for Fine-grained Fire and Smoke Understanding in Multimodal LLMs

SAFIRE is a large-scale benchmark for fire and smoke understanding in multimodal large language models (MLLMs), featuring 83,000 captioned images across 20 scenarios and 193,000 multiple-choice VQA questions derived from a 9.7K-image subset. The benchmark evaluates 10 dimensions of performance, from basic perception to higher-order reasoning, and employs a GPT‑5.4-assisted verification pipeline to ensure annotation quality. Experiments on ten open-source MLLMs (8B–38B) reveal an average accuracy of 61.9%, highlighting significant gaps in safety-critical reasoning, while fine-tuning vision encoders on just 7% of SAFIRE data boosts fire-scene classification accuracy from 20.1% to 64.5%. All resources are publicly available at https://risys-lab.github.io/SAFIRE/.

By Pengfei Li, Naufal Suryanto, Sicheng Zhang, Mohammad Alsharid, Muzammal Naseer
arXiv Computer Vision
Sep 11

Beyond Benchmarks: Using VLMs to Reveal Systematic Classification Failures Under Real World Conditions

The paper investigates using Vision Language Models (VLMs) to accelerate verification and validation (V&V) of classification models by automatically detecting systematic errors. It introduces a VLM-based error slice detection (ESD) method that groups and labels errors, demonstrating its ability to identify perturbations in a non-military dataset and to cluster images by surroundings in a military context. The study highlights challenges such as underrepresentation of defence data in VLM training and limited contextual diversity, and suggests that while fully automated V&V is not yet feasible, VLMs could speed up the process in the future.

By Dieuwertje Alblas, Alma M. Liezenga, Jan Erik van Woerden, Fedor Taggenbrock, Dalia Aljawaheri, Klamer Schutte
arXiv AI
Sep 1

Toward Generalizable Deep Learning Based Peatland Fire Detection via Walsh Hadamard Transform and Domain Adaptation

arXiv:2603.02465v2 Announce Type: replace-cross Abstract: Machine learning-based wildfire detection has advanced significantly using deep learning models trained on large wildfire image and video dat...

By Emadeldeen Hamdan, Ahmad Faiz Tharima, Mohd Zahirasri Mohd Tohir, Dayang Nur Sakinah Musa, Erdem Koyuncu, Adam J. Watts, Ahmet Enis Cetin
arXiv Computer Vision
Aug 24

Semantically Compatible Knowledge Distillation for Cross-Domain Object Detection with Vision Foundation Models

The paper introduces Semantic Localization-Enhanced Teacher (SLE‑T), a knowledge‑distillation framework that aligns spatial‑scale and semantic features between a Vision Foundation Model (VFM) teacher and a student detector for cross‑domain object detection. SLE‑T employs a lightweight SLE Adapter that injects pretrained local‑texture priors into DINOv2 and reformulates its features into dense, spatially and semantically compatible representations, enabling effective pseudo‑label learning or feature alignment. Experiments on three domain‑adaptive object detection benchmarks show that SLE‑T with DINOv2‑B achieves state‑of‑the‑art performance while using only a quarter of the training time and less GPU memory compared to the larger DINOv2‑G teacher.

By Qifeng Zhang, Ting Xiang, Zeyuan Bai, Changjian Chen
arXiv Machine Learning
2d ago

A Sentinel-2 benchmark dataset for deep-learning active-fire segmentation across 25 California wildfires

The article introduces an open image dataset for active‑fire segmentation in satellite imagery, comprising 2,148 image‑mask pairs from 25 California wildfires captured between July 2020 and August 2026. Each 512×512 pixel, three‑channel image is a Sentinel‑2 Level‑2A composite of bands B12, B11, and B8A, with a fixed linear rendering applied uniformly. Masks distinguish background, short‑wave‑infrared rule‑based active fire, and invalid observations, and the dataset includes chip‑level metadata, an incident‑disjoint split, and a mask‑blind analyst review of 233 test chips.

By Shreyan Mitra, Mohammadreza Narimani, Parastoo Farajpoor