Engineering notes
Articles for people who
ship the stack
Rewrites on React, Node.js, TypeScript and AI. A translated body is shown when it exists. If it does not, you see the English text and a note that says so.
Tagged: vram
How Much Memory Do You Need for Local AI? Speeds from 16 GB to 512 GB
Measured local LLM speed and quality across 16, 32, 128, 256 and 512 GB machines, what each class can run, and which GPUs, Macs and mini PCs fit where.
5 min readHardware reality check for running 100B-class models locally
Can a workstation run a 100B-class LLM locally? MoE sparsity, quantization, KV cache size and VRAM math decide it, not the parameter count in the headline.
11 min read
FAQ
About these articles
Yes. Each piece is an original English rewrite prepared for this site. Structure and code examples follow the source material; prose is rewritten and checked for overlap before export.
English is the source. Another language is shown only when that translation body exists. A missing or empty translation stays in English, including on a localized URL.
New drafts land in the publish queue as they pass editorial checks. Running the site import picks up only new or changed slugs — nothing is duplicated.
Treat samples as illustrative. Validate against your stack and licences before production use. For delivery work, contact us with the brief.
Request a 24h estimate
Need the same stack in a production operator layer? Send the brief — estimate within 24 hours.