arXiv AI

Region-Guided Food-Package Evidence Extraction and Abstention-Aware Draft R3337 Screening with Selective VLM Review

arXiv AI
Oct 9

Improving Image-Based Nutrition Estimation Through Multimodal Food-Item Verification and Recovery

The paper presents a framework that enhances single-image nutrition estimation by using multimodal large language models to inventory visible foods and verify both food identity and the suitability of proposed 2D regions for portion estimation. A whole-image review identifies gaps and triggers a single targeted recovery pass, after which recovered regions are re-verified and reconciled into a final item set. The approach, which requires no task-specific fine-tuning, improves item-level grounding, mass accuracy, energy accuracy, and item-identity precision and recall compared to a retrieval baseline.

By Jingbo Yue, Bruce Coburn, Jinge Ma, Jui-Feng Chi, Fengqing Zhu
arXiv Computer Vision
4d ago

ReuScope: Auditing Data Reuse and Evaluation Sensitivity in Capsule Vision 2024

ReuScope is a protocol designed to audit data reuse and evaluation sensitivity, demonstrated on Capsule Vision 2024. It measures data relationships and compares model performance when altering the evaluation population or training data while keeping predictions constant. The study finds that removing training rows linked to Kvasir-Capsule significantly lowers public‑validation accuracy, indicating sensitivity to source removal rather than leakage inflation.

By Eunseob Choi, Kyeonghun Kim, Hyuk-Jae Lee, Nam-Joon Kim
arXiv AI
Jun 9

NutriMLLM: Multimodal Large Language Models for Dietary Micronutrient Analysis

arXiv:2606. 08948v1 Announce Type: cross Abstract: Comprehensive estimation of dietary micronutrients from food images could improve clinical nutrition care, but training such models requires large multimodal datasets linking diverse foods to complete nutrient profiles.

By Runze Yan, Minxiao Wang, Jiaying Lu, Darren Liu, Xiao Hu, Hanqi Luo
arXiv AI
6d ago

When the Same Prompt Gives Different Answers (and the Same Answer Isn't Always Right): A Taxonomy of Failure Mechanisms, Testing, and Mitigation Strategies for LLM-Assisted Evidence Synthesis Read-and-Evaluate Tasks

The paper introduces TRAILS, a taxonomy of 38 mechanisms that can compromise the reliability of large language model (LLM) read‑and‑evaluate tasks in evidence synthesis, such as study screening, data extraction, risk‑of‑bias assessment, and critical appraisal. It explains how these mechanisms can cause inconsistent or hidden failures across repeated LLM runs and outlines deployment settings, testing approaches, and mitigation strategies for each. The authors argue that repeatability or accuracy alone does not guarantee trustworthy judgments, emphasizing the need for human evaluation to verify that decisions are evidence‑based, free from external influence, and reproducible.

By Carole Lunny, Ian Goodman, Stefano Berrone, Connor TA Brenna, Emma K Reid, Ivan Perez-Neri, Shailesh Kolekar, Nityanand Jain, Ashwin Kamath, Lucas HCC Santos, Yulia Otmakhova, Heba Hussein, Diana M Cespedes, Gioia Dahdal, Salmaan Kanji
arXiv Computation and Language
2d ago

Halal-NeSyNet: Clause-Scoped Neuro-Symbolic Cross-Attention for Automated Food Ingredient Auditing and Risk-Aware Halal Logistics Triage

Halal-NeSyNet is a neuro‑symbolic model that uses a DistilBERT encoder and a 16‑dimensional rule‑derived symbolic vector to audit food ingredient clauses for Halal compliance. It was evaluated on a benchmark of 3,199 items, achieving over 97 % accuracy and 99.7 % counterfactual consistency, far surpassing text‑only baselines. The model’s performance demonstrates the importance of clause‑scoped symbolic features for accurate risk‑aware Halal logistics triage.

By Mochamad Rizal Fauzan, Naila Nursyifa, Irgi Surya