Comments on: Checking out the NVIDIA H100 in Our First Look at Hopper https://www.servethehome.com/checking-out-the-nvidia-h100-in-our-first-look-at-hopper/ Server and Workstation Reviews Fri, 06 May 2022 17:41:31 +0000 hourly 1 https://wordpress.org/?v=5.9.3 By: necr https://www.servethehome.com/checking-out-the-nvidia-h100-in-our-first-look-at-hopper/#comment-483197 Fri, 06 May 2022 17:41:31 +0000 https://www.servethehome.com/?p=60823#comment-483197 Thanks for sharing Patrick!
Interesting piece of silicon – all covered in caps and VRMs to satisfy that 700W appetite. Look like it’s either those damn 25K RPM Delta fans or leaky water cooling for DCs + the same challenges for a desktop Hopper.

]]> By: TS https://www.servethehome.com/checking-out-the-nvidia-h100-in-our-first-look-at-hopper/#comment-483146 Fri, 06 May 2022 03:36:54 +0000 https://www.servethehome.com/?p=60823#comment-483146 The problem with SXM is that the baseboard is not sold separately starting the A100 generation along with the 54V input issue for >350W. Gigabyte G262-ZR0, Supermicro 2024GQ-NART, Dell XE8545 all price their barebones at $60K or so(that’s because Nvidia charged 40K for the GPU bundled with the redstone board). So literally you are paying a 20K tax on top of the 40K forced bundle by Nvidia. Even SXM2 servers right now are priced at $1.5K(4GPU 2nd hand Dell C4140) and $3-5K for 2nd hand Gigbayte 8GPU barebones which are deprecated by 4x PCIe ampere cards.

Noticed that Nvidia separated the power plane and NVLINK plane plane with the SXM5. How about Nvidia start selling the 4x SXM4/SXM5 redstone board, 8x Delta board, or even better 1/2 SXM4/5 gpu boards separately without GPUs so that server vendors can start selling the barebones below 10K?

]]> By: hoohoo https://www.servethehome.com/checking-out-the-nvidia-h100-in-our-first-look-at-hopper/#comment-483113 Thu, 05 May 2022 19:53:43 +0000 https://www.servethehome.com/?p=60823#comment-483113 You look so happy holding that card! Great photo!

]]> By: T. Roll Price https://www.servethehome.com/checking-out-the-nvidia-h100-in-our-first-look-at-hopper/#comment-483104 Thu, 05 May 2022 18:38:32 +0000 https://www.servethehome.com/?p=60823#comment-483104 You weren’t there a full month ago. Your grill twitter was 8 April. It’s only now 5 May. That’s only 27 days not a month

]]> By: Carl https://www.servethehome.com/checking-out-the-nvidia-h100-in-our-first-look-at-hopper/#comment-483103 Thu, 05 May 2022 18:34:40 +0000 https://www.servethehome.com/?p=60823#comment-483103 “We’re gonna’ need a bigger power cord” (the data center version of Jaws).

]]>