Articles for people who
ship the stack
Original rewrites on React, Node.js, TypeScript and AI — practical notes from the same engineering practice behind our operator software. Article bodies are in English.
Tagged: tokenization
Practical notes: Glitch Tokens Compared to Fragile Tokens
Operable walkthrough of Practical notes: Glitch Tokens Compared to Fragile Tokens: contracts, checks, and drop-in code slots for teams shipping this pattern.
6755 wordsRead articleToken Budgets vs. Semantic Boundaries: Getting RAG Chunk Splits Right
Learn how tokenization and chunking differ, where each sits in a RAG pipeline, and how to split documents by meaning while measuring size with the real tokenizer.
2515 wordsRead articleBuilding a Byte Pair Encoding Tokenizer From Scratch for a Small GPT
Implement a character-level BPE tokenizer in Python, train it on WikiText-2, save and fingerprint it, and retrain a small GPT on shorter, denser token sequences.
6236 wordsRead articleThe Next-Token Loop: A Mental Model of LLMs Before You Touch Agents
Learn how tokens, context windows, sampling and the generation loop work, with small offline Python examples that explain why RAG, ReAct and LangGraph exist.
1218 wordsRead article
About these articles
Request a 24h estimate
Need the same stack in a production operator layer? Send the brief — estimate within 24 hours.