https://hiren.me/tags/capacity-planning/ Recent content in Capacity Planning on Hugo en Tue, 06 Oct 2026 18:29:36 -0700 https://hiren.me/posts/sizing-inference/ Tue, 06 Oct 2026 18:29:36 -0700 https://hiren.me/posts/sizing-inference/ <p>&ldquo;How many GPUs does it take to serve this model to these users?&rdquo; comes up in every capacity plan. A handful of formulas get you to an estimate. This post works one problem from start to finish and introduces each formula where it&rsquo;s needed. Each one is checked against numbers measured in <a href="https://hiren.me/posts/weight-precision-part-1/" >Weight precision part 1</a> and <a href="https://hiren.me/posts/weight-precision-part-2/" >part 2</a>: Qwen3-8B in BF16 on vLLM 0.30, one run on one H100 and one B200.</p>