Upgrade RecoverPoint for VMs to version 5.3.x
RecoverPoint for VMs upgrade fails at 11/12% during Repository configuration on RPA1.
The internal error (/home/kos/RPServers/RPServers_logs/clusterLogic/clusterLogic.log) shows:
2020/09/02 20:26:31.440 [pool-3-thread-1] (Task.java:111) DEBUG - GetRecentOperationsTask: task: Getting recent operations.old status is: RUNNING, setting status to SUCCESS. 2020/09/02 20:26:31.440 [pool-3-thread-1] (Task.java:98) ERROR - UpgradeClusterRestorableTask :Task failed: Executing NDU. com.emc.recoverpoint.utils.javainfra.status.tasks.exception.TaskFailedException: could not configure repository volume. at com.emc.recoverpoint.utils.javainfra.status.tasks.SerialTask.perform(SerialTask.java:35) at com.emc.recoverpoint.utils.javainfra.status.tasks.Task.executeSync(Task.java:91) at com.emc.recoverpoint.utils.javainfra.status.tasks.RestorableSerialTask.attemptToCompletePhase(RestorableSerialTask.java:94) at com.emc.recoverpoint.utils.javainfra.status.tasks.RestorableSerialTask.perform(RestorableSerialTask.java:63) at com.emc.recoverpoint.utils.javainfra.status.tasks.Task.executeSync(Task.java:91) at com.emc.recoverpoint.utils.javainfra.status.tasks.Task.call(Task.java:142) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: com.emc.recoverpoint.utils.javainfra.status.tasks.exception.TaskFailedException: could not configure repository volume. Caused by: com.emc.recoverpoint.cluster_logic.inner_model.exception.RpaAdapterException: Operation failed. Failed to verify certificates: Wrong Certificates 2020/08/31 18:43:06.334 [pool-3-thread-1] (BaseInstallationServerAdapter.java:317) ERROR - Transaction failed. transactionId=16, timeoutInSeconds=300, errorMSG=Operation failed. Failed to verify certificates: Wrong Certificates, errorType=OPERATION_FAILED, value=null 2020/08/31 18:43:06.335 [pool-3-thread-1] (BaseRpaCall.java:52) ERROR - ConfigureRepositoryVolumeCall failed. java.lang.RuntimeException: Operation failed. Failed to verify certificates: Wrong Certificates
The vCenter (VC) certificate was updated, but the VC credentials were not updated in the RP Cluster. RPA validates the VC certificate during upgrades to ensure it's connecting to the same VC.
Preventative Workaround:
Update the VC registration in RecoverPoint for VMs prior to upgrade
You can use the plugin or CLI command "update_vcenter_server_registration -f"
1. Login to RPA via SSH or console via admin credentials
2. Select Option #6 to open admin CLI
3. Run command update_vcenter_server_registration -f
4. Follow the interactive command instructions
5. Update the vCenter certificate
6. Follow the upgrade process once the certificate is updated
Note : Refer Page 130 in CLI reference guide
Workaround:
A solution exists for this issue but intervention from Dell EMC technical support personnel is required. Support Engineer will need to verify the issue and run a procedure to go back to previous version, update certificates and restart upgrade. Contact the Dell EMC Customer Support Center or your service representative for technical assistance and reference this Dell EMC knowledgebase solution ID.
Resolution:
Dell EMC engineering is currently investigating this issue. A permanent fix is still in progress. Contact the Dell EMC Customer Support Center or your service representative for assistance and reference this solution ID.