Engineering notes
Articles for people who
ship the stack
Rewrites on React, Node.js, TypeScript and AI. A translated body is shown when it exists. If it does not, you see the English text and a note that says so.
Tagged: distillation
Fine-Tuning Got Cheap, but Agents Still Need a Gate for Weights
How to turn an agent's stored lessons into weights with on-policy self-distillation, four promotion criteria, and why repeating the loop three times breaks it.
9 min readSoft-Label Distillation for a 0.8B SQL Agent: Why a Weaker Qwen Teacher Won
LoRA fine-tuning on top-k soft labels from frozen traces took a 0.8B SQL agent to 55 of 220 tasks, and a weaker Qwen teacher beat the stronger GPT model.
20 min read
FAQ
About these articles
Yes. Each piece is an original English rewrite prepared for this site. Structure and code examples follow the source material; prose is rewritten and checked for overlap before export.
English is the source. Another language is shown only when that translation body exists. A missing or empty translation stays in English, including on a localized URL.
New drafts land in the publish queue as they pass editorial checks. Running the site import picks up only new or changed slugs — nothing is duplicated.
Treat samples as illustrative. Validate against your stack and licences before production use. For delivery work, contact us with the brief.
Request a 24h estimate
Need the same stack in a production operator layer? Send the brief — estimate within 24 hours.