NVIDIA H100

Extraordinary performance, scalability, and security for every data center.

FP64

34 TFLOPS

FP64 Tensor Core

67 TFLOPS

FP32

67 TFLOPS

TF32 Tensor Core²

989 TFLOPS

BFLOAT16 Tensor Core²

1,979 TFLOPS

FP16 Tensor Core²

1,979 TFLOPS

FP8 Tensor Core²

3,958 TFLOPS

INT8 Tensor Core²

3,958 TFLOPS

GPU Memory

80GB

GPU Memory Bandwidth

3.35TB/s

Max Thermal Design Power (TDP)

Up to 700W (configurable)

Multi-Instance GPUs

Up to 7 MIGS @ 10GB each

Interconnect

NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s

Give Zettabyte a try and see for yourself, superior MFU in both training and inference.