Engineering7 min read
Our Benchmark Read an H200 at 48% of Spec. The Benchmark Was Wrong.
An NVIDIA H200 joined the network and our verification put its memory bandwidth at 2,319 GB/s, under half of the 4,800 on the spec sheet. The rent page warned renters about the card. We rented it ourselves, measured it another way, and found 4,110 GB/s. Here is how a bandwidth test that was right on every consumer card went wrong on a fast one, and the fix.
Read

