I tried to make my ETL pipeline production-ready. Three things broke.
Building a production-ready RSS pipeline with Python, Docker, PostgreSQL, and Kestra The post I Built My Second ETL Pipeline. This Time, I Started Thinking Like a Data Engineer appeared first on Towards Data Science .
A practical data engineering onboarding workflow for environment setup, automated testing, and AI-assisted development. The post Your First Task as a Data Engineer in a New Company?
A reflection on the first month of learning data engineering in public, and what actually kept me going. The post One Month Into Learning Data Engineering in Public: Here’s What I Didn’t Write About appeared first on Towards Data Science .
A practical walkthrough using text-to-SQL as the example The post Why I Stopped Using One Agent and Built a Multi-Agent Pipeline Instead appeared first on Towards Data Science .
What I thought was a scheduling problem turned out to be a portability problem first The post I Tried to Schedule My ETL Pipeline. Here’s What I Didn’t Expect.
AI has accelerated data scientists’ productivity, but its influence extends beyond speed. The technology is reshaping who owns data, how judgment is exercised, and the overall career trajectory of data scientists. These changes signal a broader transformation in the field’s structure and responsibilities.
The barriers to building have collapsed. That shifts the bottleneck to ownership, validation, taste, and deciding what should actually exist The post Code Is Cheap.
One near miss, four months of running agents, and the question almost nobody is asking: what are you supposed to do while the AI writes the code? The post AI Made Me 5x Faster. It Also Made Me 5x Wors...
The article "How to Work with AI Coding Agents" offers a practical guide aimed at improving code quality rather than merely increasing quantity. It focuses on strategies and best practices for effectively collaborating with AI coding tools to produce better code. The post was originally published on Towards Data Science.
Enterprise Document Intelligence [Vol. 1 #9B] - One call wires the four upgraded bricks together, run on a paper, a NIST standard, and a report with a broken TOC The post A Production RAG Pipeline in Action: Every Answer Typed and Cited appeared first on Towards Data Science .
Towards Data Science has announced a major overhaul of its website and contributor portal. The new site promises faster performance and a brand‑new portal for writers, aiming to improve the experience for both readers and contributors. The update is positioned as a significant upgrade for anyone who reads, writes, or both on the platform.
The analytics career I signed up for five years ago doesn't exist anymore, and honestly, I am fine with that. The post How I’m Making Sure My Analytics Career Doesn’t Get Eaten by AI appeared first on Towards Data Science .