Pharos-ESG: A Framework for Multimodal Parsing, Contextual Narration, and Hierarchical Labeling of ESG Report

Pharos-ESG is a unified framework that converts ESG reports into structured representations using multimodal parsing, contextual narration, and hierarchical labeling. It incorporates a reading‑order model based on layout flow, hierarchy‑aware segmentation guided by table‑of‑contents anchors, and a multimodal aggregation pipeline that turns visual elements into coherent natural language. The framework adds ESG, GRI, and sentiment labels and outperforms existing document parsing systems and general multimodal models, while also releasing Aurora‑ESG, a large‑scale public dataset of ESG reports with detailed layout and semantic annotations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• computer-vision
• multimodal
• benchmarks