7 min read
Evaluating LLM Applications: Getting Past 'It Looks Good to Me'
Shipping LLM features on vibes works until a prompt tweak silently breaks ten other cases. Here is how to build evals that catch regressions before your users do.
Tag
LLM
Articles tagged LLM on The Augmented Dev.
5 articles
7 min read
Getting Structured Output From an LLM Without the Heartbreak
Asking a model to 'return JSON' and parsing the result is how you get 3 a.m. pages. Tool schemas, constrained decoding, and validation turn a probabilistic text generator into a reliable API.
7 min read
Chunking Strategies for RAG: Where Retrieval Quality Is Won or Lost
Most RAG systems that retrieve bad context aren't failing at embeddings or reranking — they're failing at chunking. How you split documents quietly decides what your model can ever find.
8 min read
Designing a Production-Ready RAG System: What Actually Matters
Retrieval-augmented generation demos look great. Production RAG is a different engineering problem — chunking, hybrid retrieval, reranking, evaluation, and the failure modes nobody mentions at conferences.
8 min read
Event-Driven Architecture for LLM Pipelines: Queues, Retries, and the Cost of Synchronous Chains
LLM-powered pipelines break in the same ways old monoliths did — when you stack synchronous calls. Queues, events, and the patterns that make a six-step AI pipeline survive a partial outage.