Sebastian Raschka

LLM Research Papers: The 2025 List (July to December)

In June, I shared a bonus article with my curated and bookmarked research paper lists to the paid subscribers who make this Substack possible.

Simon Willison
Sep 18

Note on 18th September 2026

Simon Willison reflects on his current disinterest in large language models (LLMs), comparing it to a geneticist dismissing the newly opened Jurassic Park. He emphasizes that this stance feels odd given the excitement surrounding LLMs. The note highlights his personal stance on AI and generative‑AI topics.

arXiv Computation and Language
Sep 2

The Scientific Contribution Graph: Automated Literature-based Technological Roadmapping at Scale

The paper introduces the Scientific Contribution Graph, a large-scale resource that extracts 6 million scientific contributions from 655 k open-access papers across multiple disciplines and links them with 36 million prerequisite edges. It frames automated technological roadmapping as the task of identifying contributions and their prerequisites, and presents a new scientific prerequisite prediction task where models forecast which existing technologies enable future discoveries. The authors report that current models achieve a 0.48 MAP score on temporally-filtered backtesting, indicating rapid progress in this area.

By Peter A. Jansen