Articles for people who
ship the stack
Rewrites on React, Node.js, TypeScript and AI. A translated body is shown when it exists. If it does not, you see the English text and a note that says so.
Tagged: LLM-as-a-Judge
Diagnosing RAG Failures: A Stage Map and a Claim-Level Groundedness Judge
Localize where a RAG pipeline broke, then build an LLM groundedness judge that checks claims one by one and is validated against human raters with kappa.
9 min readEvaluating and Regression-Testing LLM Prompts in Production
Build evaluation sets, rubrics and regression suites that tell whether a prompt change helped, covering exact checks, LLM judges, trade-offs and golden cases.
8 min readTraining Your Own LLM Judge: From PandaLM and JudgeLM to Prometheus
How finetuned evaluator models are built, from data and rubrics to bias control and meta-evaluation, and a practical recipe for training a domain-specific LLM judge.
39 min readA Dependency-Free LLM Eval With a Judge You Can Actually Trust
Build a small LLM evaluation from real logs, code checks and a single-criterion judge, then calibrate that judge against human labels so its scores mean something.
9 min readManaging LLM-as-a-Judge as a Living Production System
Learn how Netflix's four-stage lifecycle—ground-truth data, rubric-tuned training, safe rollout, and ongoing monitoring—keeps an LLM judge accurate at scale.
20 min read
About these articles
Request a 24h estimate
Need the same stack in a production operator layer? Send the brief — estimate within 24 hours.