arXiv Computer Vision
Sep 22

All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Experts

The paper introduces an all‑in‑one multilingual scene text recognizer called ScriptMoE, which uses a script‑aware mixture‑of‑experts architecture to handle 10 scripts and 229 languages. It is built on a new large‑scale synthetic dataset, TextMuSS‑10M, and evaluated on the TextMuSS‑Bench, achieving 82.06% accuracy—1.31% higher than the best baseline. When integrated into the PP‑OCRv5 pipeline, ScriptMoE raises the end‑to‑end multilingual F1 score from 65.71% to 80.89%, slightly surpassing the best vision‑language model while using far fewer parameters.

By Xingsong Ye, Yongkun Du, Jiaxin Zhang, Zhixian Li, Chong Sun, Chen Li, Jing Lyu, Lianwen Jin, Zhineng Chen
arXiv Computation and Language
2d ago

From Zero to OCR: A Data-Centric Framework for Unsupported Low-Resource Scripts

The paper introduces a data‑centric framework that enables end‑to‑end OCR for low‑resource scripts using only an unannotated text corpus and digital fonts, eliminating the need for manually annotated training images. A synthetic data engine generates realistic word, line, and page images with accurate script shaping, which are then used to train a YOLOv8 word detector and a convolutional recurrent recognizer via connectionist temporal classification. Applied to the Kashmiri Perso‑Arabic Nastaliq script, the system achieves a 0.39% character error rate on held‑out words and provides publicly released models, code, and a synthetic dataset of 285,864 text‑line images.

By Faizan Iqbal, Haq Nawaz Malik, Hafsah Pervaiz
Hugging Face Trending Papers
Aug 19

Impact of Iterative Fine-Tuning on Transcription Accuracy in Complex Historical Sanskrit Manuscripts

The paper presents a local traditional OCR pipeline that can be iteratively fine‑tuned on both layout and appearance levels of complex historical Sanskrit manuscripts. By adapting to the specific manuscript distribution, the pipeline improves transcription accuracy across subsequent pages, reducing the need for costly human annotation. The authors apply the method to three manuscripts, release a dataset with detailed layout and Unicode annotations in PAGE‑XML format, and benchmark the results against leading multimodal large language models.

arXiv AI
Aug 20

Impact of Iterative Fine-Tuning on Transcription Accuracy in Complex Historical Sanskrit Manuscripts

The paper presents a local traditional OCR pipeline that can be iteratively fine‑tuned on both layout and appearance levels of complex historical Sanskrit manuscripts. By adapting to the specific manuscript distribution, the pipeline reduces human annotation effort and improves transcription accuracy across subsequent pages. The authors apply this method to three manuscripts, release a dataset with detailed layout and Unicode annotations in PAGE‑XML format, and benchmark the pipeline against leading multimodal large language models.

By Kartik Chincholikar, Kaushik Gopalan, Mihir Hasabnis