Articles for people who
ship the stack
Original rewrites on React, Node.js, TypeScript and AI — practical notes from the same engineering practice behind our operator software. Article bodies are in English.
Tagged: llm-costs
Semantic Caching for LLM Apps on Ubuntu 24.04 With Qdrant
Cut LLM API spend by caching answers by meaning, not text: Qdrant setup on Ubuntu 24.04, tenant isolation, per-route similarity thresholds, and IOPS costs.
788 wordsRead articleCutting LLM Costs: Caching, Model Routing and Prompt Trimming
Production LLM bills grow fast. Use semantic caching, model routing, leaner prompts, RAG reranking, output caps and batching to spend less without losing quality.
1824 wordsRead articleWhere Our LLM API Bill Went and the Architecture Changes That Cut It
Step-level token attribution, model tiering, prompt trimming and backoff with jitter cut a coding agent's API costs; includes cost formulas and common optimization mistakes.
1861 wordsRead articleCut Repeated Prompt Costs by 90% With One Line of Prompt Caching
Turn on automatic prompt caching with a single field, verify hits in the usage block, and avoid the prefix mistakes and minimum-length traps that silently erase savings.
914 wordsRead articleWhy Hermes Agent Burns Tokens and How to Cut Its Prompt to 4K
A one-word hello to Hermes Agent can trigger 30 requests and 1.5M tokens. See where the 16K prompt comes from and which CLI commands trim it below 4,000 tokens.
877 wordsRead article
About these articles
Request a 24h estimate
Need the same stack in a production operator layer? Send the brief — estimate within 24 hours.