Engineering notes
Articles for people who
ship the stack
Rewrites on React, Node.js, TypeScript and AI. A translated body is shown when it exists. If it does not, you see the English text and a note that says so.
Tagged: sglang
Why Dual RTX 3090s Hit 55 tok/s Instead of 220 with SGLang and DFlash2
A hands-on look at running Qwen3.8-27B on two 3090s with SGLang, and how PCIe x4 links, missing P2P, tight KV cache and power spikes crushed the advertised speed.
7 min readContinuous batching and chunked prefill in vLLM and SGLang
Static LLM batches waste GPU on padding. Iteration-level scheduling and chunked prefill keep decode streams smooth while new prompts still make progress.
5 min read
FAQ
About these articles
Yes. Each piece is an original English rewrite prepared for this site. Structure and code examples follow the source material; prose is rewritten and checked for overlap before export.
English is the source. Another language is shown only when that translation body exists. A missing or empty translation stays in English, including on a localized URL.
New drafts land in the publish queue as they pass editorial checks. Running the site import picks up only new or changed slugs — nothing is duplicated.
Treat samples as illustrative. Validate against your stack and licences before production use. For delivery work, contact us with the brief.
Request a 24h estimate
Need the same stack in a production operator layer? Send the brief — estimate within 24 hours.