15G PowerFlex Family running CPLD 1.0.7 can hang during POST when updating to BIOS 1.8.2 and iDRAC 6.00.30.202
Summary: 15G PowerFlex R650 and R750 Custom Node, Appliance and Rack with CPLD firmware version 1.0.7 (or lower) installed may encounter a hang during POST when updating to BIOS 1.8.2 and iDRAC 6.00.30.202 (or newer versions of BIOS and iDRAC). You must perform the steps in the resolution below prior to performing an RCM or IC upgrade to prevent this issue. ...
This article applies to
This article does not apply to
This article is not tied to any specific product.
Not all product versions are identified in this article.
Symptoms
15G PowerFlex R650 and R750 Custom Node, Appliance and Rack with CPLD firmware version 1.0.7 (or lower) installed may encounter a hang during POST when updating to RCM, IC, or OME packages that include BIOS 1.8.2 and iDRAC 6.00.30.202 (or newer versions of BIOS and iDRAC).
NOTE: If you encounter the POST error below, you must immediately run a TSR collection from the iDRAC and check the box to enable Debug Logs before performing any other operation including a reboot. This will give support the BIOS debug log information they need to debug further.
- iDRAC Dashboard Error:
- PowerFlex Manager Alerts Tab Error:
- Lifecycle Log Event (seen in TSR log):
Cause
This is an issue with CPLD 1.0.7 (or lower) firmware version that prevents successful deployment and/or installation of RCM, IC, or OME packages that include BIOS 1.8.2 and iDRAC 6.00.30.202 (or newer versions of BIOS and iDRAC).
Resolution
The CPLD firmware should be updated manually to version 1.0.8 prior to deploying, updating, and or installing BIOS 1.8.2 and iDRAC 6.00.30.202.
*There are prerequisites that need to be fulfilled prior to any update to CPLD version 1.0.8.
BIOS version must be at 1.5.5 or higher, before updating CPLD.
iDRAC version must be at 5.10.10.05 or higher, before updating CPLD.
*CPLD must be updated separately and requires a reboot before updating other firmware or software.
NOTE: If you encounter a POST error on boot after CPLD is upgraded, perform a cold reboot the host a second time to ensure the node boots without error.
CPLD is not included in any RCM, IC and or OME catalog. However, BIOS and iDRAC are in the catalogs.
The catalogs below will require at least one (or more) updates to reach the required minimum BIOS and iDRAC versions necessary to update the CPLD to version 1.0.8.
If the customer system was last updated or deployed from PowerFlex custom node 15G OME Catalog for February 2022, you must update to PowerFlex custom node 15G OME Catalog for May 2022 or later before updating to CPLD version 1.0.8.
*Customer system cannot be updated directly to PowerFlex custom node 15G OME Catalog for January 2023 from PowerFlex custom node 15G OME Catalog for February 2022 (requires multiple updates).
To Update PowerFlex Custom Nodes
First confirm the current version of CPLD firmware on the node, before performing the update:
- Using iDRAC web UI to confirm current CPLD firmware (requires iDRAC IP address):
- To check if your nodes are affected, log in to each node iDRAC
- - Select: System→Inventory→Firmware Inventory – then scroll down to find “System CPLD”
- Using iDRAC IP through Putty to confirm current CPLD firmware (requires iDRAC IP address):
-
- racadm>>racadm get BIOS.sysinformation.SystemCpldVersion
Using iDRAC IP through Windows command prompt for Redfish API to confirm current CPLD firmware:
- User name:password: https://<idrac ip>/redfish/v1/UpdateService/FirmwareInventory
(Shows all firmware, not just CPLD)
- Cmd>curl -k -u root:xxxxx -X GET https://10.241.230.13/redfish/v1/UpdateService/FirmwareInventory
Once current CPLD firmware version has been confirmed, download the CPLD firmware via this link and update to CPLD version 1.0.8 using the instructions below: PowerEdge CPLD R750/R750xa/R650 Version 1.0.8
NOTE: When performing tasks on a node that requires it to be shut down or restarted, do so gracefully. Operating system upgrades and patches, and other maintenance activities, like part replacement, require shutting down or rebooting a node.
For information about updating a single component, see the articles below.
NOTE: When performing tasks on a node that requires it to be shut down or restarted, do so gracefully. Operating system upgrades and patches, and other maintenance activities, like part replacement, require shutting down or rebooting a node.
For information about updating a single component, see the articles below.
If updating the entire cluster suite (BIOS, Firmware, Driver pack), see the following links for instructions and downloads:
Before attempting any upgrade action, read the following:
-
Ensure that all data is protected by using Protected Maintenance Mode (PMM) for storage only and hyperconverged nodes housing SVM's during the CPLD upgrade process. Place ESXi nodes into Maintenance Mode (MM).
Once the CPLD version is verified and an update is confirmed necessary, follow the steps below to update the CPLD to version 1.0.8:
1. Clear the job queue:
racadm -r <iDRAC_IP> -u root -p <password> jobqueue delete -i ALL
2. Show the currently installed CPLD version by pulling the system inventory and filtering down to the CPLD firmware version:
racadm -r <iDRAC_IP> -u root -p <password> swinventory | grep CPLD -A4 | egrep "CPLD|Version"
3. Install the CPLD firmware package (note, this may have a slightly different structure depending on where the file is located locally or remotely):
racadm -r <iDRAC_IP> -u root -p <password> update -f CPLD_Firmware_N9YTC_WN64_1.0.8_A00.EXE
4. Monitor the job queue for progress and completion of CPLD download to LC:
racadm -r <iDRAC_IP> -u root -p <password> jobqueue view | grep CPLD -B1 -A1
5. Reboot the server from within the OS.
*Customer system cannot be updated directly to PowerFlex rack release 3.5.7.1 or 3.6.3.1 from PowerFlex rack release 3.5.6.1 or 3.6.2.1 (requires multiple updates).
If the customer system was last updated or deployed from PowerFlex appliance release IC_38.356.00, IC_38.356.01, IC_38.362.00, IC_38.362.01, you must update to PowerFlex appliance release IC_38.356.03, IC_38.362.03 or later before updating to CPLD version 1.0.8.
*Customer system cannot be updated directly to PowerFlex appliance release IC_38.357.01 or IC_38.363.01 from PowerFlex appliance release IC_38.356.00, IC_38.356.01, IC_38.362.00, IC_38.362.01 (requires multiple updates).
To Update PowerFlex Rack and PowerFlex Appliance
First confirm the current version of CPLD firmware on the node, before performing the update:
- Using iDRAC web UI to confirm current CPLD firmware (requires iDRAC IP address):
- To check if your nodes are affected, log in to each node iDRAC
- - Select: System→Inventory→Firmware Inventory - then scroll down to find "System CPLD"
- Using iDRAC IP through Putty to confirm current CPLD firmware (requires iDRAC IP address)
-
- racadm>>racadm get BIOS.sysinformation.SystemCpldVersion
- Using iDRAC IP through Windows command prompt for Redfish API to confirm current CPLD firmware:
- - User name:password: https://<idrac ip>/redfish/v1/UpdateService/FirmwareInventory
- (shows all firmware, not just CPLD)
-
- Cmd>curl -k -u root:xxxxx -X GET https://10.241.230.13/redfish/v1/UpdateService/FirmwareInventory
Once the current CPLD firmware version has been confirmed, download the CPLD firmware via this link and update to CPLD version 1.0.8 using the instructions below: PowerEdge CPLD R750/R750xa/R650 Version 1.0.8
NOTE: When performing tasks on a node that requires it to be shut down or restarted, do so gracefully. Operating system upgrades and patches, and other maintenance activities, like part replacement, require shutting down or rebooting a node.
NOTE: When performing tasks on a node that requires it to be shut down or restarted, do so gracefully. Operating system upgrades and patches, and other maintenance activities, like part replacement, require shutting down or rebooting a node.
Before attempting any upgrade action, please read the following:
-
Ensure all data is protected by using Protected Maintenance Mode (PMM) for storage only and hyperconverged nodes housing SVM's during the CPLD upgrade process. Place ESXi nodes into Maintenance Mode (MM).
Once CPLD version is verified and an update is confirmed necessary, follow the steps below to update the CPLD to version 1.0.8:
1. Clear the job queue:
2. Show the currently installed CPLD version by pulling the system inventory and filtering down to the CPLD firmware version:
3. Install the CPLD firmware package (note, this may have a slightly different structure depending on where the file is located locally or remotely):
4. Monitor the job queue for progress and completion of CPLD download to LC:
5. Reboot the server from within the OS.
1. Clear the job queue:
racadm -r <iDRAC_IP> -u root -p <password> jobqueue delete -i ALL
2. Show the currently installed CPLD version by pulling the system inventory and filtering down to the CPLD firmware version:
racadm -r <iDRAC_IP> -u root -p <password> swinventory | grep CPLD -A4 | egrep "CPLD|Version"
3. Install the CPLD firmware package (note, this may have a slightly different structure depending on where the file is located locally or remotely):
racadm -r <iDRAC_IP> -u root -p <password> update -f CPLD_Firmware_N9YTC_WN64_1.0.8_A00.EXE
4. Monitor the job queue for progress and completion of CPLD download to LC:
racadm -r <iDRAC_IP> -u root -p <password> jobqueue view | grep CPLD -B1 -A1
5. Reboot the server from within the OS.
Additional Information
Caution: When making single component upgrades:
For PowerFlex Rack and PowerFlex Appliance performing single component upgrades, contact the account team.
For PowerFlex Rack and PowerFlex Appliance performing single component upgrades, contact the account team.
Affected Products
PowerFlex rack, PowerFlex Appliance, PowerFlex appliance R650, Powerflex appliance R750, PowerFlex custom node R650, PowerFlex custom node R750Article Properties
Article Number: 000205925
Article Type: Solution
Last Modified: 05 Sep 2023
Version: 12
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.