← Back to all news
arXiv AI By Aliakbar Nafar, Kristen Brent Venable, Zijun Cui, Parisa Kordjamshidi

Extracting Probabilistic Knowledge from Large Language Models for Bayesian Network Parameterization

Read the original on arXiv AI →

The paper investigates how Large Language Models can be used to approximate domain expert priors for Bayesian Networks by extracting probabilistic knowledge about real‑world events. Experiments on eighty publicly available networks across domains such as healthcare and finance show that LLM‑derived conditional probabilities outperform random, uniform, and next‑token baselines. The authors also demonstrate that these LLM‑generated priors can refine data‑driven distributions, especially when data is scarce, and provide the first comprehensive baseline for evaluating LLM performance in probabilistic knowledge extraction.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Machine Learning
Jun 18

Structured Inference with Large Language Gibbs

arXiv:2606. 19264v1 Announce Type: new Abstract: The knowledge encoded in large language models (LLMs) can serve as a substrate for structured reasoning over variables describing a complex world, but accessing this knowledge in a probabilistically coherent manner poses a difficult inference problem.

By Sanghyeok Choi, Henry Gouk, Esmeralda S. Whitammer
llms
More like this →
arXiv AI
Oct 23

From Prompts to Posteriors: Can LLM Agents Perform Bayesian Inference in Context?

The paper investigates whether large language models (LLMs) can perform principled Bayesian inference when updating beliefs in context. By creating an evaluation framework that includes qualitative epistemological tests, quantitative benchmarks, and analyses of downstream impacts, the authors find that LLMs typically violate Bayes' rule but that their performance improves dramatically when equipped with advanced reasoning and code‑execution tools, allowing them to approximate analytically intractable posteriors. The study suggests that appropriately tool‑augmented LLMs could already be leveraged to accelerate scientific discovery through complex belief updates.

By Linus Filbry, Luckeciano C. Melo, Yarin Gal
llmsagentsbenchmarks
More like this →
arXiv AI
Sep 4

Semantic Bayesian World Models

Semantic Bayesian World Models (SBWMs) propose a shift from static knowledge graphs to a dynamic, probabilistic fabric of beliefs that can be updated via Bayesian conditioning and influenced by actions. The approach aims to bridge the gap between crisp factual assertions and the probabilistic reasoning of foundation models and autonomous agents, enabling richer inference in scenarios such as home‑security decisions, actuarial estimates, and planning tasks. Realizing SBWMs requires new tools for belief annotation, probabilistic entailment, semantic calibration, and protocols for belief exchange among agents.

By Tommaso Soru
llmsagents
More like this →