Engineering notes
Articles for people who
ship the stack
Rewrites on React, Node.js, TypeScript and AI. A translated body is shown when it exists. If it does not, you see the English text and a note that says so.
Tagged: Mixture of Experts
Serving Qwen3.8-Flash-Next on RTX 3090s with llama.cpp Tensor Offloading
Why an 88GB, 180B-parameter mixture of experts model like Qwen3.8-Flash-Next fits RTX 3090s, and how llama.cpp -ot, -ncmoe and mmap split VRAM, RAM, NVMe.
12 min readWhy a 17 GB Model Download Doesn't Mean 17 GB of Memory to Run It
Learn how active parameters, total parameters, KV cache growth and reasoning effort decide the real memory and compute cost of running a language model locally.
12 min read
FAQ
About these articles
Yes. Each piece is an original English rewrite prepared for this site. Structure and code examples follow the source material; prose is rewritten and checked for overlap before export.
English is the source. Another language is shown only when that translation body exists. A missing or empty translation stays in English, including on a localized URL.
New drafts land in the publish queue as they pass editorial checks. Running the site import picks up only new or changed slugs — nothing is duplicated.
Treat samples as illustrative. Validate against your stack and licences before production use. For delivery work, contact us with the brief.
Request a 24h estimate
Need the same stack in a production operator layer? Send the brief — estimate within 24 hours.