Towards Data Science

Automate Writing Your LLM Prompts

Using DSPy to automatically create, evaluate, and optimize your prompts The post Automate Writing Your LLM Prompts appeared first on Towards Data Science .

Towards Data Science
Jul 29

Prompt Engineering Is Solved—Prompt Management Isn’t

Prompt engineering helps you write better prompts—but it doesn’t help you change them safely. This article explores a common production failure where a simple variable rename breaks every live call, and introduces a lightweight static analysis tool that treats prompts like contracts, catching breaking changes before they ship.

By Emmimal P Alexander
Towards Data Science
Jul 22

How To Build Your Own LLM Runtime From Scratch

If you have ever wanted to actually build an LLM inference runtime yourself — pack your own weights, own every barrier, capture your own CUDA graphs — this is what that journey looks like on an H100. A step-by-step tour of a small runtime called annotated-llm-runtime, and the three bugs that produced most of the annotations.

By Anubhab Banerjee