arXiv Computation and Language By Yixuan Huang, Danish Pruthi, Bhuwan Dhingra

Multimodal AI Detection for Math-Heavy Scientific Text

Read the original on arXiv Computation and Language →

The paper introduces SnapJudge, an image‑based AI detection system for math‑heavy scientific text, trained on screenshots of LaTeX‑generated PDFs. It shows that existing text‑only detectors like Pangram 4 lose accuracy as mathematical content increases, while fine‑tuned LaTeX detectors recover performance. SnapJudge achieves 92–93% detection rates at a 0.1% false‑positive rate, outperforming both Pangram 4 and text‑based models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Oct 12

Measuring Artifact Reliance in Machine-Generated Text Detectors

The study evaluates machine‑generated text detectors on scientific literature, finding that many detectors perform near perfectly on certain benchmarks due to superficial formatting cues rather than genuine linguistic differences. A logistic regression using 27 superficial features achieved macro‑F1 scores between 0.833 and 0.997, outperforming other detectors on arXiv subsets. The most powerful cue was the PDF extraction artifact—human texts preserve line breaks while generated texts appear as a single block—allowing classification at 0.996 AUC. By introducing format counterfactuals and normalizing formatting, the authors demonstrate that re‑wrapping machine‑written abstracts can flip 20–27% of detector decisions, reducing the generalization gap and improving out‑of‑domain performance.

By Anastasia Voznyuk, Andrey Grabovoy
arXiv AI
Oct 16

Loud and Clear: Making Visual Evidence Count in Multimodal Document RAG

The paper introduces Loud and Clear (LoC), a method that enhances multimodal document retrieval-augmented generation by fully utilizing visual token capacity and refining retrieved pages to highlight evidence. LoC combines higher-resolution pages with OCR of query-relevant regions, achieving significant accuracy gains over eight prior methods on multiple benchmarks. The study demonstrates that the way retrieved pages are presented to the generator is a critical bottleneck beyond retrieval itself.

By Eunchan Jo, Seounghyun Jang, Sangwoo Mo