The production RAG eval cheatsheet.
25 failure modes to test before you ship. The symptom, the test, the snippet, the fix — for each one.
One more step — check your inbox.
We just sent a confirmation link. Click it to lock in your subscription and we'll send the cheatsheet right after.
Tactics from real shipping, not blog posts about blog posts.
Every issue starts with a real failure mode, debug story, or architectural decision — drawn from systems serving actual users. If it works in a demo, it doesn't ship here.
Written for engineers who ship the systems behind the demo.
APIs, queues, retrieval, caching, observability, evals. The boring infrastructure that makes LLM products actually work in production — not prompt engineering hot takes.
A single deep dive every Tuesday. No filler, no daily noise.
Long enough to be useful, short enough to read on the commute. Roughly 1,800 words, one diagram, one runnable snippet per issue. That's the contract.
Recent issues
Jul 7, 2026
Jun 30, 2026
Chunking strategies for production RAG
Jun 23, 2026
Hybrid search: combining BM25 with embeddings
Pure vector search misses exact-match queries.
Jun 16, 2026
Reranking 101: the 50ms layer that decides whether your RAG works.
Your retriever gives you 50 results. Reranking turns the top 5 useful. The difference between a RAG system that answers customer questions and one that hallucinates with confidence is rarely the...
Jun 9, 2026
Your LLM app fails with 200 OK. These are the three signals worth paging on.
A logging schema, three alert thresholds, and the shadow eval that catches drift before users do.
Production AI engineering. One Tuesday at a time.
Check your inbox.
We just sent a confirmation link. The cheatsheet lands right after you confirm.