Sebastian Raschka By Sebastian Raschka, PhD

My Workflow for Understanding LLM Architectures

Read the original on Sebastian Raschka →

A learning-oriented workflow for understanding new open-weight model releases

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Sebastian Raschka.

Towards Data Science
Jul 22

How To Build Your Own LLM Runtime From Scratch

If you have ever wanted to actually build an LLM inference runtime yourself — pack your own weights, own every barrier, capture your own CUDA graphs — this is what that journey looks like on an H100. A step-by-step tour of a small runtime called annotated-llm-runtime, and the three bugs that produced most of the annotations.

By Anubhab Banerjee
arXiv AI
Sep 10

Complexity and Scale in AI-Assisted Workflow Management: A Federated Learning Case Study

The paper investigates the use of a large language model (LLM) agent to automate the creation and execution of a federated learning workflow for medical image analysis. By generating a reviewable specification of constraints and acceptance criteria, the LLM produces an executable workflow, while a validation loop repairs failures and ensures conformance to the specification. Experiments on the FABRIC testbed demonstrate that the approach can detect silent errors—such as a run that trained 1,700 jobs on random tensors—that traditional failure-driven debugging would miss.

By Komal Thareja, Hamza Safri, Rajiv Mayani, Anirban Mandal, Ewa Deelman