arXiv AI

LinePilot Digitizer: Line-Plot Recovery with Manual and Automatic Calibration

LinePilot Digitizer is a tool for extracting numerical data from line plots, offering three calibration modes—standard, enhanced, and OCR—that combine continuous color-based curve recovery with flexible calibration. The authors introduce DigitizerBench, a benchmark that systematically evaluates digitizer performance across signal, rendering, and plot-structure factors, using a failure-penalized capped normalized root-mean-square error metric. Results show that LinePilot (OCR) and LinePilot (enhanced) achieve the lowest error rates and highest trusted usability on their respective benchmark subsets, demonstrating the effectiveness of the calibration modes and the benchmark’s factor analysis capabilities.

arXiv Computer Vision
Sep 4

OCR-EDR: Rendering-Aware Diagnosis and Repair for Closed-Loop OCR Improvement

OCR-EDR is a rendering‑aware framework that diagnoses and repairs OCR errors by comparing an editable OCR prediction with its rendered image. It jointly assesses consistency, localizes genuine errors, and applies executable edits, optionally requesting updated renderings for iterative reassessment. On the newly constructed OCRErrBench, the DocEDR model achieves 94.78% diagnostic accuracy and repairs 86.23% of erroneous inputs, improving formula metrics by up to 30.99 percentage points on benchmark datasets.

By Linnan Zhao, Kang Liu, Hao Yu, Jiabo Zhan, Chong Sun, Chen Li
Hugging Face Trending Papers
Sep 3

OCR-EDR: Rendering-Aware Diagnosis and Repair for Closed-Loop OCR Improvement

OCR-EDR is a rendering‑aware framework that diagnoses and repairs OCR errors by jointly evaluating an OCR prediction, its editable form, and the rendered image of the source document. It localizes genuine mistakes while preserving valid or rendering‑equivalent predictions, then applies executable edits and iteratively reassesses with updated renderings. On the newly constructed OCRErrBench, the DocEDR model achieves 94.78% diagnostic accuracy and repairs 86.23% of errors, boosting formula metrics by up to 30.99 percentage points and improving CDM scores on several OCR systems.

arXiv Computer Vision
5d ago

PlotPick: AI-powered batch extraction of numerical data from scientific figures

PlotPick is an open‑source tool that employs vision‑language models (VLMs) to batch‑extract tabular data from scientific figures. In benchmarks on synthetic chart datasets (ChartX and PlotQA), nine VLMs generally outperform the dedicated chart‑to‑table model DePlot, especially on box plots and horizontal bar charts. The tool’s figure detection, output formatting, and default model (Claude Haiku 4.5) were not evaluated, and accuracy on real biomedical figures remains unverified.

By Tommy Carstensen
arXiv Machine Learning
Sep 17

SAM-on-the-Curve: Sharpness-Aware Mode Connectivity for Robust Weight-Space Interpolation

The paper introduces Sharp Mode Connectivity (SMC), a new formulation of mode connectivity that optimizes for flatness in the entire local neighborhood of a weight-space path rather than just along the path itself. By applying a sharpness-aware approximation to a minimax objective, SMC produces low-loss curves that remain robust to distribution shifts, achieving significant accuracy gains on CIFAR‑10‑C and outperforming standard mode connectivity on several architectures.

By Alejandro Calatrava, Xu Zhang, Ren Wang
arXiv Machine Learning
Oct 5

VisAudit: Evaluating Multimodal Agents for Visual Diagnosis and Repair

VisAudit is a new benchmark that tests multimodal agents on visual diagnosis, repair, and verification tasks. It presents agents with rendered charts and auxiliary evidence—such as source data, intended summaries, and code—to iteratively detect defects, modify the visualization, and confirm successful repairs. The benchmark includes 1,900 flawed charts across 21 types and 10 flaw categories, plus 300 correct charts, and shows that current models recover only about 47.4% of flawed charts autonomously.

By Shicheng Liu, Adam Kahirov, Qi Zhang, Zhimin Hu, Song Wang, Junhong Lin, Julian Shun, Yada Zhu
arXiv AI
Sep 1

FigMirror: Ground It, Code It, Plot It

FigMirror is a new framework that converts scientific figures into executable code, enabling the creation of new plots that preserve the visual style of a reference figure. It achieves this by using Grounded Measurement to locate visual elements via coordinates and measure their properties through code, overcoming limitations of pixel‑level optimization used by prior methods. The authors also introduce PlotTwin‑Bench, a benchmark with fine‑grained code and image‑level style metrics, and demonstrate that FigMirror consistently outperforms existing style‑transfer approaches.

By Xiaohan Zhao, Jiacheng Liu, Yaxin Luo, Zhiqiang Shen
arXiv AI
Oct 1

ChartDensity-Bench: Benchmarking MLLMs for Numerical Data Reconstruction under Visual Density

ChartDensity-Bench is a benchmark designed to evaluate multimodal large language models (MLLMs) on their ability to reconstruct structured numerical data from scientific charts that vary in visual density. The benchmark uses charts paired with source-level ground-truth data and systematically changes the number of simultaneously presented charts (k = 1, 3, 6, 9) to assess how density affects reconstruction performance. A multi‑dimensional evaluation framework measures structural reliability, reconstruction completeness, parseability, and numerical fidelity, revealing that numerical reconstruction generally worsens as visual density increases, with varying degrees of degradation across different models.

By Xinhe Wu, Yadong Jin
arXiv AI
Aug 26

MatReplace: A Reference-Free, Conditioning-Aligned Benchmark for Material Replacement in Interior Scenes

MatReplace is a new reference‑free benchmark for evaluating material replacement in interior scenes, assessing edits on local material correctness, global lighting harmony, outside preservation, and inside structure. It offers three tracks that vary the conditioning signal—instruction only, instruction plus region mask, and material reference image—allowing systematic comparison of different editing approaches. Results show that while closed‑source editors excel at named‑material rendering, grounding materials from pixel references remains a significant challenge.

By Mingzhe Du, Thong Thanh Nguyen, Nguyen Tran Cong Duy, See-Kiong Ng, Luu Anh Tuan