NVIDIA pioneered accelerated computing to tackle challenges ordinary computers cannot. NVIDIA reinvented modern computer graphics in 1999, and made real-time programmable shading possible, giving artists an infinite palette for expression.
NVIDIA is powering the next era of high-performance computing, the universe of supercomputing has expanded rapidly to include AI, advanced data analytics, and cloud computing.
The Universal System for AI Infrastructure
NVIDIA DGX™ A800 is the universal system for all AI workloads—from analytics to training to inference. DGX A800 offers the ability to deliver a fine-grained allocation of computing power using the Multi-Instance GPU (MIG) capability in the NVIDIA A800 Tensor Core GPU. This enables administrators to assign resources that are right-sized for specific workloads.
Unprecedented performance, scalability, and security for every data center
The NVIDIA® H100 Tensor Core GPU delivers unprecedented acceleration to power the world’s highest-performing elastic data centers for AI, data analytics, and high-performance computing (HPC) applications. NVIDIA H100 Tensor Core technology supports a broad range of math precisions, providing a single accelerator for every compute workload. The NVIDIA H100 PCIe supports double-precision (FP64), single-precision (FP32), half-precision (FP16), and integer (INT8) compute tasks. NVIDIA H100 PCIe cards use three NVIDIA® NVLink® bridges. They are the same as the bridges used with NVIDIA A100 PCIe cards. This allows two NVIDIA H100 PCIe cards to be connected to deliver 900 GB/s bidirectional bandwidth or 5x the bandwidth of PCIe Gen5, to maximize application performance for large workloads.
The World’s Proven Choice for Enterprise AI
NVIDIA DGX H100 is the fourth generation of the world’s premier purpose-built AI infrastructure, a fully optimized platform powered by the operating system of the accelerated data center, NVIDIA Base Command, a rich ecosystem of third-party support, and access to expert advice from NVIDIA professional services.
NVIDIA DGX H100 features up to 9X more performance, 2X faster networking, and high-speed scalability for NVIDIA DGX SuperPOD. The next-generation architecture is supercharged for the largest workloads such as natural language processing and deep learning recommendation models.
DGX H100 can be installed on-premises for direct management, colocated in NVIDIA DGX-Ready data centers, and accessed through NVIDIA-certified managed service providers. And with DGX-Ready Lifecycle Management, organizations get a predictable financial model to keep their deployment at the leading edge.
The Universal System for Every AI Workload
NVIDIA H100 – Unprecedented performance, scalability, and security for every data center
NVIDIA DGX H100 – The World’s Proven Choice for Enterprise AI
H100 triples the floating-point operations per second (FLOPS) of double-precision Tensor Cores, delivering 60 teraFLOPS of FP64 computing for HPC. AI-fused HPC applications can leverage H100’s TF32 precision to achieve one petaFLOP of throughput for single-precision, matrix-multiply operations, with zero code changes. Deploying H100 GPUs at data center scale delivers outstanding performance and brings the next generation of exascale high-performance computing (HPC) and trillion-parameter AI within the reach of all researchers. In addition, NVIDIA Magnum IO™ software delivers efficient scalability from small enterprises to massive, unified GPU clusters.
H100 further extends NVIDIA’s market-leading inference leadership with several advancements that accelerate inference by up to 30X and deliver the lowest latency. Fourth-generation Tensor Cores speed up all precisions, including FP64, TF32, FP32, FP16, and INT8, and the Transformer Engine utilizes FP8 and FP16 together to reduce memory usage and increase performance while still maintaining accuracy for large language models.
Today’s confidential computing solutions are CPU-based, which is too limited for compute-intensive workloads like AI and HPC. NVIDIA Confidential Computing is a built-in security feature of the NVIDIA Hopper™ architecture that makes H100 the world’s first accelerator with confidential computing capabilities. Users can protect the confidentiality and integrity of their data and applications in use while accessing the unsurpassed acceleration of H100 GPUs. It creates a hardware-based trusted execution environment (TEE) that secures and isolates the entire workload running on a single H100 GPU, multiple H100 GPUs within a node, or individual MIG instances.
Accelerated servers with H100 deliver the compute power—along with 3 terabytes per second (TB/s) of memory bandwidth per GPU and scalability with NVLink and NVSwitch—to tackle data analytics with high performance and scale to support massive datasets. Combined with NVIDIA Quantum-2 Infiniband, the Magnum IO software, GPU-accelerated Spark 3.0, and NVIDIA RAPIDS™, the NVIDIA data center platform is uniquely able to accelerate these huge workloads with unparalleled levels of performance and efficiency.
NVIDIA DGX™ systems is designed to maximize AI throughput, providing enterprises with a highly refined, systemized, and scalable platform to help them achieve breakthroughs in natural language processing, recommender systems, data analytics, and much more.
DGX H100 is designed to be the centerpiece of an enterprise AI center of excellence. It’s a fully optimized hardware and software platform that includes full support for the new range of NVIDIA AI software solutions, a rich ecosystem of third-party support, and access to expert advice from NVIDIA professional services. DGX H100 offers proven reliability, with DGX systems being used by thousands of customers around the world spanning nearly every industry.
