Articles for people who
ship the stack
Original rewrites on React, Node.js, TypeScript and AI — practical notes from the same engineering practice behind our operator software. Article bodies are in English.
Tagged: model-routing
Cutting LLM Costs: Caching, Model Routing and Prompt Trimming
Production LLM bills grow fast. Use semantic caching, model routing, leaner prompts, RAG reranking, output caps and batching to spend less without losing quality.
1824 wordsRead articleMoving KV Cache Between Qwen3 Models Instead of Re-Prefilling
NVIDIA research maps Qwen3-14B attention state into Qwen3-32B with a ridge-regression bridge. See what the latency numbers mean, where it fails, and why agents care.
1817 wordsRead articleWhere Our LLM API Bill Went and the Architecture Changes That Cut It
Step-level token attribution, model tiering, prompt trimming and backoff with jitter cut a coding agent's API costs; includes cost formulas and common optimization mistakes.
1861 wordsRead articlePractical notes: How to Optimize AI Agent Cost, Speed, and Quality with Model
Operable walkthrough of Practical notes: How to Optimize AI Agent Cost, Speed, and Quality with Model: contracts, checks, and drop-in code slots for teams shipping this pattern.
3025 wordsRead article
About these articles
Request a 24h estimate
Need the same stack in a production operator layer? Send the brief — estimate within 24 hours.