Accelerate AI Innovation with RHEL AI on Dell PowerEdge Servers

Dell and Red Hat boost AI innovation industry's first solution optimized for RHEL AI.

Dell Technologies and Red Hat have combined to deliver robust, enterprise-grade solutions for over two decades. Last week, the two companies marked another milestone in their longstanding relationship with the announcement that the Dell PowerEdge 760xa is the first server platform validated and supported for Red Hat Enterprise Linux AI (RHEL AI).

Our latest collaboration allows organizations of all sizes to simplify AI adoption and unleash its full potential. You can learn more about the solution in this recently released white paper.

Driving Transformative Outcomes with AI

AI is no longer a futuristic concept but a present-day reality revolutionizing the entire industry. Generative AI is leading the charge by transforming how we create content, develop software and even make business decisions. Enterprises across industries are already using AI to automate tasks, analyze large datasets and enhance customer experiences. Below are a few examples of AI in action:

  • Healthcare. AI-driven diagnostics and personalized treatment plans.
  • Finance. Predictive analytics for fraud detection and risk management.
  • Retail. Enhanced customer experiences through personalized recommendations.
  • Manufacturing. Predictive maintenance and process optimization.

The potential for further innovation with AI is enormous. Businesses that invest in AI technology today are positioning themselves for a competitive advantage in the future.

Unleashing AI Innovation with RHEL AI and Dell PowerEdge

The validation of Dell PowerEdge servers with RHEL AI offers enterprises unparalleled advantages when it comes to making AI accessible and getting up and running quickly. The solution empowers application owners, domain experts and developers to build AI-powered apps faster while delivering enterprise-grade outcomes.

Understanding RHEL AI

RHEL AI is an innovative AI platform that brings together key components to start building and running AI models and applications efficiently and quickly. It combines:

  • Granite family of LLMs. Open-source-licensed large language models (LLMs) distributed under the Apache-2.0 license.
  • InstructLab model alignment tools. Intuitive, easy-to-use tools for enhancing LLM capabilities and making AI model development open and accessible to all users.
  • Bootable RHEL image. Granite models and InstructLab tooling packaged as a bootable RHEL image, including Pytorch/runtime libraries, and optimized for hardware GPU accelerators.
  • Enterprise support and indemnification. Technical support and model intellectual property indemnification provided by Red Hat.

Optimizing RHEL AI on Dell PowerEdge

The Dell PowerEdge R760xa provides a solid foundation for building and running resource intensive AI applications with RHEL AI.

  • First validated server platform. Dell PowerEdge is the first server platform validated, optimized and supported for RHEL AI, ensuring optimal performance and predictable outcomes.
  • Powerful and flexible. With support for up to 4X NVIDIA H100 or 4X NVIDIA L40S GPUs in a 2U PowerEdge R760xa node, the solution is engineered for GPU intensive model training, finetuning, inferencing and advanced analytics.
  • Single source procurement. The solution simplifies the procurement and support process, allowing enterprises to procure the entire solution from Dell. Dell also provides the first call support, identifying and triaging issues to Red Hat if it is related to RHEL AI components.

Making AI Accessible with RHEL AI on Dell PowerEdge

RHEL AI on Dell PowerEdge helps developers, app owners, domain experts and data scientists simplify how they build and run their AI-centric applications, while mitigating potential risks with a validated, supported platform. The InstructLab tooling and Granite models included with the solution empower a broad range of users to build AI applications without having to depend on scarce data scientists.

“AI by nature requires extensive resources spanning enabled servers, compute power and GPUs. As organizations evaluate and implement GenAI use cases, it is imperative that they build on a platform that is able to scale with their business while also providing the agility to experiment and develop AI-driven innovations. By collaborating with Dell Technologies to validate and empower RHEL AI on Dell PowerEdge servers, we are enabling customers with greater confidence and flexibility to harness the power of GenAI workloads across hybrid cloud environments and propel their business into the future.”
-Joe Fernandes, Vice President and General Manager, AI Business Unit, Red Hat

Whether you’re developing and fine-tuning AI models, integrating AI into existing applications or building new AI-driven solutions, this platform can simplify your AI journey.

Take AI to the Next Level with Red Hat and Dell

With Red Hat Enterprise Linux AI on Dell PowerEdge servers, businesses can simplify and accelerate their AI adoption. This powerful combination offers a validated, optimized and supported platform designed to lower barriers and accelerate innovation.

Ready to turbocharge your AI initiatives? Learn more about the RHEL AI solution by downloading our white paper).

Thank you for being part of this exciting journey. We’re here to assist you every step of the way. Contact us at ai.assist@dell.com if you have any AI-related questions.

About the Author: Brian Doty

Brian Doty is a 25-year veteran of Dell Technologies.  He started his career in the PowerEdge organization where he led validation efforts and enabled test automation.  In 2007, Brian shifted to product management and became responsible for the DRAC program, playing a key role in the product’s evolution to become the embedded automation engine and innovation enabler that it is today.  Since then, Brian has contributed to several areas Dell Technologies Infrastructure Solutions Group including modular servers, APEX AIOps (formally known as CloudIQ), services modernization, and common software.  Brian has filed several patents and participated in several industry forums.  Earlier this year, Brian assumed his current role as Director of Product Management for PowerEdge where he is responsible for systems management, operating systems, and platform security.  In his spare time, Brian enjoys fitness, reading and writing.