NVIDIA DGX B200

Equipping enterprise teams with a universal AI supercomputer, the NVIDIA DGX B200 combines 1.4 TB of GPU memory with 64 TB/s bandwidth to handle heavy AI workloads at scale.

Its massive memory throughput minimizes bottlenecks and accelerates time to insight across complex development cycles.

DGX-B200-Q9

// solution overview

Versatile AI system based on the world's most powerfull GPU

Powered by the NVIDIA Blackwell architecture, the DGX B200 delivers a massive performance leap over previous generations offering up to 3x faster training and 15x higher inference throughput.

Designed as an all-in-one platform for the full development-to-deployment lifecycle, it provides the versatility organizations need to scale their AI initiatives at any stage.

performance
Configuration flexibility
TCO
premium support

// extreme performance

Computing on the most powerful NVIDIA GPUs

image 2024 03 22 102959009 600x547 1

Up to 1.4 TB

total GPU memory

Unified NVIDIA Ecosystem

// Benefits

image 2024 03 21 115439514

One Platform for full stack development pipelines

Modern enterprise workflows demand robust, scalable compute resources to process complex AI datasets across every phase from initial training and fine-tuning to production inference.

The NVIDIA DGX B200 addresses this need by providing developers with a unified platform designed to streamline and accelerate the entire pipeline.

image 2024 03 21 115458765

Powerhouse of AI Performance

Powered by the NVIDIA Blackwell architecture, the DGX B200 represents a major leap over the DGX H100, tripling training performance and boosting inference output fifteenfold.

As the core architecture behind DGX BasePOD and SuperPOD, it provides scalable, enterprise-grade compute across diverse AI applications.

image 2024 03 21 115527195

Proven Infrastructure Standard

The DGX B200 operates as a fully integrated platform, bringing together hardware optimization with the complete NVIDIA AI software suite including NVIDIA Base Command and NVIDIA AI Enterprise.

Backed by a broad third-party ecosystem and direct access to NVIDIA professional services, it offers a end-to-end environment for developing and scaling enterprise AI.

NVIDIA B200 GPU

8x NVIDIA B200 GPUs with 1440 GB total HBM3e GPU memory

NVLink & NVSwitch

6x NVIDIA NVSwitches with 4.8TB/s of bidirectional bandwidth

30TB Gen4 NVMe SSD

8× 3.84 TB with 50GB/s of peak bandwidth, 2x faster than Gen3 NVMe SSDs and 2× 1.92 TB NVMe for OS

// Extreme Performance

NVIDIA DGX B200

image 2024 03 21 103934909

Dual 56-core Intel CPUs

A total of 112 processor cores and up to 4TB of system memory

High-speed fabric

8x NVIDIA ConnectX-7 VPI with up to 400Gb/s InfiniBand / Ethernet

Optimized Software Stack

DGX OS, all necessary system software, GPU-accelerated applications and pre-trained models

// Performance

Performance overview and cross-generation comparison

Real Time Large Language Model Inference

image 2024 03 21 120805329 1

Supercharged AI Training Performance

image 2024 03 21 121030278 1

Accelerated Data Processing

image 2024 03 21 121304620 1

// Software & Services

Fastest Time to Solution

The DGX B200 integrates a fully optimized software environment, combining an AI-tailored base OS and core system software with NGC’s library of accelerated applications and pre-trained models.

Complementing the hardware stack, NVIDIA Enterprise Services delivers technical support, operational training, and professional consulting to streamline infrastructure deployment.

MainBlogImage 1024x685 1

// DGX software

NVIDIA DGX Systems Provide Full AI Software Stack

01.

NVIDIA DGX server

Engineered to handle every phase of the AI lifecycle from data analytics to training and inference the DGX B200 redefines compute density.

Delivering 72 petaFLOPS of AI training performance within a compact 10U chassis, it allows organizations to replace fragmented, legacy infrastructure with a single, highly integrated platform.

02.

NVIDIA DGX OS

NVIDIA DGX systems ship with a fully pre-configured DGX OS software stack built on Ubuntu or Red Hat Enterprise Linux.

It includes optimized GPU and networking drivers, a complete container engine environment, and integrated tools for system management, data center orchestration, and enterprise-grade security.

03.

NVIDIA AI Enterprise

NVIDIA AI Enterprise delivers a secure, cloud-native software suite that accelerates the full AI pipeline.

It grants access to a comprehensive catalog of optimized frameworks, pre-trained models, and data science libraries, with every component fully backed by enterprise-grade NVIDIA support.

04.

NVIDIA Mission controll

NVIDIA Mission Control unites NVIDIA Base Command and NVIDIA Run:AI into a cohesive management platform.

Together, they deliver an enterprise-grade orchestration and scheduling solution, providing streamlined support for Slurm workloads, Jupyter Notebook environments, and efficient resource allocation.

05.

NGC applicatioin containers

NVIDIA NGC serves as a hub for industry-standard AI frameworks, GPU-accelerated applications, and pre-trained models.

Pre-integrated into the ecosystem, it enables teams to deploy AI workloads immediately upon system delivery.

Continuous updates ensure that users always have access to the latest optimized software components for peak performance.

DGX SW stack

// Enterprise scale solutions

Supercomputing for any business with ease

Powered by DGX B200 systems, the NVIDIA DGX SuperPOD delivers a turnkey, modular architecture for large-scale AI operations.

It provides predictable, high-density performance that scales seamlessly to accelerate complex training and high-throughput inference workloads.

image 2024 03 21 142955677
Configuration NVIDIA DGX B200 1440GB
CPU 2 Intel® Xeon® Platinum 8570 Processors
112 Cores total, 2.1 GHz (Base),
4 GHz (Max Boost)
RAM 2TB, 4TB
NVMe capacity 2x 1.9TB
U.2 capacity 8x 3.84TB
GPU 8x NVIDIA Blackwell GPUs
Networking 4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI 400Gbps Infiniband / Ethernet,
2x dual-port QSFP112 NVIDIA BlueField-3 DPU 400Gbps Infiniband / Ethernet,
10Gb/s onboard NIC with RJ45,
100Gb/s dual-port ethernet NIC,
Host baseboard management controller (BMC) with RJ45
Support 3 years, 4 years, 5 years
Premium Support 3 years, 5 years
Additional Software NVIDIA AI Enterprise 3 years,
NVIDIA AI Enterprise 4 years,
NVIDIA AI Enterprise 5 years,
None

Reviews

There are no reviews yet.

Be the first to review “NVIDIA DGX B200”

Your email address will not be published. Required fields are marked *

NVIDIA-DGX-B300-Q9

NVIDIA DGX H200

mama ai

MAMA AI mDataChat

obrazek 2025 08 12 141815634

AI server 8 GPU

obrazek 2023 08 11 001847704

AI server 4 GPU

Related Products

Your email address will not be published. Required fields are marked *

Ready For AI Journey?