arXiv AI

SciText2Eq: Assessing LLMs for Explainable Equation Generation for Scientific Creativity

arXiv:2606. 16003v1 Announce Type: new Abstract: This work investigates the ability of large language models (LLMs) to generate mathematical equations from scientific texts.

arXiv Machine Learning
Jul 28

MioFFAn: an Annotation Software for Formula Formalization with LLM Automation Capabilities

arXiv:2607. 22552v1 Announce Type: cross Abstract: The automatic translation of mathematical expressions in scientific literature into executable symbolic code (a process we refer to as Formula Formalization) is hindered by a severe scarcity of high-quality, ground-truth datasets specialized for technical scientific domains.

By Nicolas Sibuet, Horacio Saggion, Riccardo Rossi
Hugging Face Trending Papers
Jul 14

Can LLMs Write Reliable Rubrics? A Meta-Evaluation for Experiment Reproduction

Rubric-based evaluation is a promising approach for assessing open-ended outputs from LLM-based research agents, particularly in paper reproduction, where direct paper-to-repository comparison is prone to hallucination. However, constructing paper-specific rubrics requires substantial expert effort, limiting the scalability of benchmarks such as PaperBench.