Prompt Engineering in Production Is a Systems Problem
The prompt is the smallest part of the system. What determines output quality is the context, the constraints, the feedback loop and the evaluation set.
Tagged “evaluation”
3 articles.
How to Evaluate an LLM Pipeline So You Can Change It Safely
Build an evaluation set from real production traffic, assert on properties instead of exact strings, and wire it into CI so prompt changes ship on evidence.
Langfuse Review: Six Months of LLM Tracing in Production
What Langfuse actually did for my LLM pipeline: trace capture, token accounting, online evals and self-hosting reality, including what I regret.