In the dynamic world of data centers, open standards have become a cornerstone for innovation and efficiency. By 2029, businesses globally are expected to grow their artificial intelligence (AI) infrastructure with spending to reach $422.55 billion, growing at a compound rate of 44 percent over the next five years¹. The Open Compute Platform (OCP) community, with its dedication to open-source hardware, is at the forefront of this movement. Dell’s Integrated Rack Scalable Systems (IRSS) embody these principles, offering robust, adaptable solutions designed to meet the unique needs of large-scale AI deployments.
Dell’s Integrated Rack Scalable Systems (IRSS) – A Perfect Fit for Large-Scale AI and Dense Compute
Introducing the new Integrated Rack 7000 (IR7000), PowerEdge M7725 and PowerEdge XE9712. These new products provide a seamless and powerful solution for modern data centers as AI workloads increase the need for technology that offers energy efficient, dense compute that can accommodate future technological advancements. Dell’s IRSS aligns with the Open Compute Project’s rack standards and supports data center operations through enhanced energy efficiency and scalability.
Key Features of IR7000, PowerEdge M7725 and XE9712
The Dell Integrated Rack 7000 (IR7000) is a 21” Open Rack Version 3 (Orv3) based rack infrastructure with dense compute and liquid cooling for High TDP GPU and CPUs. Prior to ORV3, direct liquid cooling (DLC) manifold connections were proprietary and incompatible when trying to add servers with different DLC OEMs in a single rack. Dell’s next-generation, quick-connect modular infrastructure establishes the future direction for high performance workloads training large AI models.
- Flexible power: AC power shelves that currently support 33kW to 264kW per rack with an eye on 480kW for future deployments
- Future-ready: OCP standards-based 44OU & 50OU system form factor with wider, taller sleds will support multiple generations of CPU architectures
- Efficient: Consumes and dissipates high power and thermal exhaust by providing seamless power scaling and near 100% heat capture
- Optimizes Front IO: Custom configurations can accommodate flexible I/O or storage in a 21-inch enclosure design
The Dell PowerEdge M7725 is purpose-built for dense compute. PowerEdge M7725 supports two AMD EPYC 5th Generation processors that deliver 37% higher instructions per clock (IPC) for high performance computing (HPC) compared to the previous generations. A single IR7000 can accommodate 72 M7725 server nodes and deliver up to 27,000 cores per rack. M7725 offers improved serviceability with front IO as well as cable-free power and DLC connectivity. The M7725 with IR7000 Rack enables room neutral (near 100%) heat capture capability via Dell’s exclusive rear door heat capture technology.
- Scalable: Can support up to 72 nodes per 50OU rack, delivering up to 27,000 cores per rack. AMD 5th Gen Processors provide 37% higher IPC for HPC workloads
- High Speed IO: 2x IO slots (PCIe Gen5 x 16) per node enable best in class data transfer rates (both Ethernet & InfiniBand options supported), and an additional OCP slot for host management connectivity
- Power & Cooling: Power and effectively cool two 500W processors in a dense form-factor with the IR7000 Rack Infrastructure
The Dell PowerEdge XE9712 expands the Dell AI Factory with a NVIDIA GB200 NVL72 solution. Building on the success of the XE9680 with 8-way HGX GPUs, the XE9712 offers faster LLM performance with 72 GPUs acting as one in a single rack. It will be deployed as super PODs at scale, complete with full networking between racks, supported by Dell’s turnkey rack-scale deployment services, supply chain, and logistics.
- 25 times more efficient than the H100
- 30 times faster real-time trillion parameter LLM inference vs. the H100
- Liquid cooled architecture ensures efficient heat management, enabling higher performance and faster data processing.
Future-ready AI
Dell’s Integrated Rack Scalable Systems, featuring the IR7000, PowerEdge M7725 and XE9712, offer a seamless, cohesive solution tailored for OCP customers. By embracing open standards and delivering unmatched performance and efficiency, these innovations empower data centers to meet the challenges of tomorrow.
Visit our new Dell PowerEdge Server web page for more information on how to drive innovation and sustainability in your operations.
1 WSJ, AI-Ready Data Centers Are Poised for Fast Growth, https://www.wsj.com/articles/ai-ready-data-centers-are-poised-for-fast-growth-fadae952, August 2023
