Engineering notes
Articles for people who
ship the stack
Rewrites on React, Node.js, TypeScript and AI. A translated body is shown when it exists. If it does not, you see the English text and a note that says so.
Tagged: llm-as-judge
Who Grades the Grader? Validating Agent Eval Suites Before You Trust Them
Who validates the eval suite? Judge drift, outcome-only scoring, private failure modes and hidden cost can make LLM evals lie. Checks for the suite itself.
7 min readEvaluating AI Agents: Golden Sets, LLM Judges and CI Regression Gates
Offline and online evaluation for agents with AgentCore, LangFuse, Ragas and DeepEval, plus golden datasets, CI gating, A/B tests and memory feedback.
18 min readWhen Models Grade Architecture: Rubric Failures Worth Budgeting For
LLM verifiers grading architecture invent strict truths, confuse demos with products and reward boilerplate. Rubric failures to budget for, and how to fix them.
13 min read
FAQ
About these articles
Yes. Each piece is an original English rewrite prepared for this site. Structure and code examples follow the source material; prose is rewritten and checked for overlap before export.
English is the source. Another language is shown only when that translation body exists. A missing or empty translation stays in English, including on a localized URL.
New drafts land in the publish queue as they pass editorial checks. Running the site import picks up only new or changed slugs — nothing is duplicated.
Treat samples as illustrative. Validate against your stack and licences before production use. For delivery work, contact us with the brief.
Request a 24h estimate
Need the same stack in a production operator layer? Send the brief — estimate within 24 hours.