Take on demanding artificial intelligence, machine learning and deep learning
Rapidly develop, train and deploy large machine learning models with this high-performance application server made for artificial intelligence (AI), machine learning and deep learning.
Take on demanding artificial intelligence, machine learning and deep learning
Rapidly develop, train and deploy large machine learning models with this high-performance application server made for artificial intelligence (AI), machine learning and deep learning.
Two 5th Generation Intel® Xeon® Scalable processors with up to 64 cores per processor Two 4th Generation Intel® Xeon® Scalable processors with up to 56 cores per processor
Operating System
Canonical® Ubuntu® Server LTS Red Hat® Enterprise Linux SUSE Linux Enterprise Server VMware ESXi
Chipset
Intel® C741 chipset
Accelerators
8 NVIDIA HGX H100 80GB 700W SXM5 GPUs, fully interconnected with NVIDIA NVLink technology or, 8 NVIDIA HGX H200 141GB 700W SXM5 GPUs, fully interconnected with NVIDIA NVLink technology or, 8 AMD Instinct MI300X 192GB 750W OAM accelerator with AMD Infinity Fabric connectivity, 8 Intel Gaudi3 128GB 900W OAM accelerator with embedded RoCE ports for ethernet connectivity
Memory
DIMM Speed Up to 5600 MT/s on the 5th Generation Intel® Xeon® Scalable processors Up to 4800 MT/s on the 4th Generation Intel® Xeon® Scalable processors
Memory Type RDIMM
Memory Module Slots 32 DDR5 DIMM slots
Maximum RAM RDIMM 4 TB max
Storage
Front Bays Up to 8 x 2.5-inch NVMe/SAS/SATA SSD drives max 122.88 TB Up to 16 x E3.S NVMe direct drives max 122.88 TB Note: Only 8 x 2.5-inch NVMe SSD drives are supported with Intel Gaudi3.
Storage Controllers
Internal Controllers PERC H965i (Not supported with Intel Gaudi3) Internal Boot Boot Optimized Storage Subsystem (NVMe BOSS-N1): HWRAID 1, 2 x M.2 SSDs
Security
Cryptographically signed firmware Data at Rest Encryption (SEDs with local or external key mgmt) Secure Boot Secured Component Verification (Hardware integrity check) Secure Erase Silicon Root of Trust System Lockdown (requires iDRAC9 Enterprise or Datacenter) TPM 2.0 FIPS, CC-TCG certified, TPM 2.0 China NationZ
Management
Embedded / At-the-Server iDRAC9 iDRAC Direct iDRAC RESTful API with Redfish iDRAC Service Module
Consoles CloudIQ for PowerEdge plug in OpenManage Enterprise OpenManage Power Manager plugin OpenManage Service plugin OpenManage Update Manager plugin
Tools Dell System Update Dell Repository Manager Enterprise Catalogs iDRAC RESTful API with Redfish IPMI RACADM CLI
OpenManage Integrations BMC Truesight OpenManage Integration with ServiceNow
Power Supplies
2800W Titanium 200-240 VAC or 240 VDC redundant, hot swap
Fans Up to 6 High performance (HPR) gold grade fans installed in mid tray Up to ten high performance (HPR) gold grade fans installed on the rear of the system (up to 12 fans with Intel Gaudi3) All are hot swap fans
Embedded OSFP 6 x 800 Gb (available only with Intel Gaudi3)
Ports
Network Options 1 x OCP 3.0 (optional) 2 x 1GbE LOM (optional)
Front Ports 1 x iDRAC Direct (Micro-AB USB) port 1 x USB 2.0 1 x VGA
Rear Ports 1 x USB 2.0 1 x USB 3.0 1 x VGA 1 x RJ45 iDRAC9 ethernet port
Slots
PCIe Up to 10 x16 Gen5 (x16 PCIe) full-height, half-length (8 PCIe slots with Intel Gaudi3)
Bezel
Optional LCD bezel or security bezel
Form Factor
6U rack server
Dimensions & Weight
Height 10.36 in. (263.20 mm)
Width 18.97 in. (482.00 mm)
Depth 39.71 in. (1008.77 mm) with bezel 39.17 in. (995.00 mm) without bezel
Weight up to 114.05 kg (251.44 lbs.)
Recommended Support
Choose Dell ProSupport Plus for critical systems or Dell ProSupport for premium hardware and software support for your PowerEdge solution. Consulting and deployment offerings are also available. Contact your Dell representative today for more information. Availability and terms of Dell Services vary by region.
"Thanks to its combination of raw computational power, architectural flexibility, and enterprise-grade reliability, it has received a renewed Best of 2024 award." — StorageReview