NVIDIA DGX B200

NVIDIA DGX B200 delivers unparalleled generative AI performance with a massive 1.4 terabytes (TB) of GPU memory and 64 terabytes per second (TB/s) of memory bandwidth, making it uniquely suited to handle any enterprise AI workload. With NVIDIA DGX B200, enterprises can equip their data scientists and developers with a universal AI supercomputer to accelerate their time to insight and fully realize the benefits of AI for their businesses.

// solution overview

Versatile AI system based on the world's most powerfull GPU

NVIDIA DGX B200 is built using the newest and most advanced technology, increasing training performance up to 3x and up to 15x higher inference compared to the previous generations.

NVIDIA DGX™ B200 is an unified AI platform for develop-to-deploy pipelines for businesses of any size at any stage in their AI journey. Leveraging the NVIDIA Blackwell GPU architecture, DGX B200 can handle diverse workloads making it ideal for businesses looking to accelerate their AI transformation.

performance

Configuration flexibility

TCO

premium support

// extreme performance

Computing on the most powerful NVIDIA GPUs

Up to 1.4 TB

total GPU memory

Unified NVIDIA Ecosystem

// Benefits

One Platform for full stack development pipelines

Enterprises require massive amounts of compute power to handle complex AI datasets at every stage of the AI pipeline, from training to fine-tuning to inference. With NVIDIA DGX B200, enterprises can arm their developers with a single platform built to accelerate their workflows.

Powerhouse of AI Performance

Powered by the NVIDIA Blackwell architecture’s advancements in computing, DGX B200 delivers 3X the training performance and 15X the inference performance of DGX H100. As the foundation of NVIDIA DGX BasePOD and NVIDIA DGX SuperPOD, DGX B200 delivers leading-edge performance for any workload.

Proven Infrastructure Standard

DGX B200 is a fully optimized hardware and software platform that includes the complete NVIDIA AI software stack, including NVIDIA Base Command and NVIDIA AI Enterprise software, a rich ecosystem of third-party support, and access to expert advice from NVIDIA professional services.

NVIDIA B200 GPU

8x NVIDIA B200 GPUs with 1440 GB total HBM3e GPU memory

NVLink & NVSwitch

6x NVIDIA NVSwitches with 4.8TB/s of bidirectional bandwidth

30TB Gen4 NVMe SSD

8× 3.84 TB with 50GB/s of peak bandwidth, 2x faster than Gen3 NVMe SSDs and 2× 1.92 TB NVMe for OS

// Extreme Performance

NVIDIA DGX B200

Dual 56-core Intel CPUs

A total of 112 processor cores and up to 4TB of system memory

High-speed fabric

8x NVIDIA ConnectX-7 VPI with up to 400Gb/s InfiniBand / Ethernet

Optimized Software Stack

DGX OS, all necessary system software, GPU-accelerated applications and pre-trained models

// Performance

Performance overview and cross-generation comparison

Real Time Large Language Model Inference

Supercharged AI Training Performance

Accelerated Data Processing

// Software & Services

Fastest Time to Solution

DGX B200 integrates a tested and optimized DGX software stack, including an AI-tuned base operating system, all necessary system software, and GPU-accelerated applications, pre-trained models, and more from NGC. NVIDIA Enterprise Services provide support, education, and professional services for your DGX infrastructure. With NVIDIA experts available at every step of your AI journey, Enterprise Services can help you get your projects up and running quickly and successfully.

// DGX software

NVIDIA DGX Systems Provide Full AI Software Stack

01. NVIDIA DGX server

The universal system for all AI workloads – from analytics to training to inference. DGX B200 sets a new bar for compute density, packing 72 petaFLOPS of AI training performance into a 10U form factor, replacing legacy compute infrastructure with a single, unified system.

02. NVIDIA DGX OS

NVIDIA DGX Systems comes with pre-installed NVIDIA DGX OS software stack – Ubuntu or RedHat Enterprise Linux, optimized drivers (GPU, networking), Docker engine, container management, system management, datacenter management tools and security features.

03. NVIDIA AI Enterprise

NVIDIA AI Enterprise offers end-to-end, secure, cloud-native suite of AI software which provides a large catalog of optimized and up-to-date data science libraries, tools, pre-trained models, frameworks, and more. The entire software stack is fully covered with NVIDIA enterprise support.

04. NVIDIA Mission controll

NVIDIA Mission controll is a software pack consisting of NVIDIA Base Command and NVIDIA Run:AI which provide together a solid software base for orchestration, Slurm, and Jupyter Notebook environments, delivering an easy-to-use, enterprise-proven scheduling and orchestration solution.

05. NGC applicatioin containers

NVIDIA NGC is public catalog of the most used AI frameworks, GPU accelerated applications, pre-trained AI models or workflows. You can run your AI workload right after delivery of your DGX system. NGC catalog is regurarly updated to always get the latest tuned software components for highest performance of your AI applications.

// Enterprise scale solutions

Supercomputing for any business with ease

NVIDIA DGX SuperPOD built on DGX B200 systems enables leading enterprises to deploy large-scale, turnkey infrastructure backed by NVIDIA’s AI expertise. Accelerate any of you projects with SuperPOD modular and versatile architecture and benefit from scalable performance to accelerate inference and training times.

NVIDIA DGX B200

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.

NVIDIA DGX B200

// solution overview

Versatile AI system based on the world's most powerfull GPU

// extreme performance

Computing on the most powerful NVIDIA GPUs

Up to 1.4 TB

total GPU memory

Unified NVIDIA Ecosystem

// Benefits

One Platform for full stack development pipelines

Powerhouse of AI Performance

Proven Infrastructure Standard

NVIDIA B200 GPU

NVLink & NVSwitch

30TB Gen4 NVMe SSD

// Extreme Performance

NVIDIA DGX B200

Dual 56-core Intel CPUs

High-speed fabric

Optimized Software Stack

// Performance

Performance overview and cross-generation comparison

Real Time Large Language Model Inference

Supercharged AI Training Performance

Accelerated Data Processing

// Software & Services

Fastest Time to Solution

// DGX software

NVIDIA DGX Systems Provide Full AI Software Stack

01.

NVIDIA DGX server

02.

NVIDIA DGX OS

03.

NVIDIA AI Enterprise

04.

NVIDIA Mission controll

05.

NGC applicatioin containers

// Enterprise scale solutions

Supercomputing for any business with ease

Resources

Continue Exploring

NVIDIA DGX B200

Related Products

NEED A CONSULTATION?

AI servers

NVIDIA DGX B200

AI Server 1 GPU

AI Server 4 GPU

AI Server 8 GPU

NVIDIA DGX Cloud

Internal Links

Nvidia GPU Selector

Our References

Our Contacts

External Links

NVIDIA NGC Catalog

AMD EPYC 4th Generation

NVIDIA DataCenter GPUs

NVIDIA DLI Trainings

NVIDIA AI Platform