arXiv AI By Xuyao Feng, Antonis Bikakis

Pairwise Logical Selection of Enthymeme Completions under Semantic-Link Uncertainty

Read the original on arXiv AI →

The paper presents a neuro‑symbolic approach for selecting the correct omitted component in enthymemes, extending prior work from missing‑premise to missing‑claim selection. It replaces binary entailment with logical‑resistance scores and introduces the Possible‑World Atom‑Link Formalization (PWAL), which marginalizes over alternative semantic‑link configurations while keeping translated formulae fixed. Experiments on five tasks show that PWAL improves strict accuracy by up to 30.86 percentage points and reduces tie rates significantly, while also providing a transparent trace of each comparison.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 2

Ontology-Grounded, Reasoner-Verified Benchmarks for Evaluating LLM Reasoning in Scientific AI

The paper introduces a pipeline that automatically creates ontology‑grounded multiple‑choice question benchmarks for evaluating large language models (LLMs) on logical reasoning tasks in scientific AI. By using OWL 2 ontologies, correct answers are guaranteed by design and distractors are generated and formally verified as incorrect through an OWL reasoner. Experiments on three ontologies—Pizza, PMDco, and DOID—yielded 112, 2,491, and 15,216 MCQs, respectively, with high natural‑language quality and challenging zero‑shot performance for six LLMs.

By Nishtha N. Vaidya, Stephan Grimm, Thomas Hubauer, Thomas A. Runkler