Dell ObjectScale 1.3 Administration Guide

Get replication failure reasons, failed destinations, and remediation hints

If replication fails, you can get information about the failure and take appropriate action to fix the problem.

1. Get the object name and version id of the failed replication.
   See Monitor for failed replications on the ObjectScale Portal UI.
2. Get the failure reason by issuing the S3 detailedReplicationStatus API request on the object name and version id.
   The format is:

   # /root/s3curl/s3curl.pl --id=ecsflex  -- 'http://{s3 endpoint}/source/<objname>?detailedReplicationStatus&versionId=<version-id>' |xmllint --format -

   An ObjectScale extension to this S3 call shows the following information about the destination replication status.

   Element name	Description
   <DestinationARN>	Replication destination bucket location—If the replication rule contains multiple destinations, all are listed. You can determine which destinations failed from the <ReplicationStatus> element.
   <ReplicationStatus>	Replication status for the named destination—When this value is <FAILED>, the next two elements are provided.
   <FailureErrorCode>	Failure code
   <FailureReason>	Explanation of the failure code

   Here is an example of the command output.

   # /root/s3curl/s3curl.pl --id=ecsflex  -- 'http://{s3 endpoint}/source/testobj2?detailedReplicationStatus&versionId=AAABiR-vS2ImsARyFp6AZ1qfns75LZ-FTzUA' |xmllint --format -
    
   <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
   <ObjectDetailedReplicationStatus xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
     <ObjectName>testobj2</ObjectName>
     <VersionId>AAABiR-vS2ImsARyFp6AZ1qfns75LZ-FTzUA</VersionId>
     <DestinationReplicationStatus>
       <DestinationARN>arn:aws:s3:osci26b00472169e8067:osti5a9f9ecef92d9f85:destination</DestinationARN>
       <ReplicationStatus>FAILED</ReplicationStatus>
       <FailureErrorCode>DST_BUCKET_VERSIONING_NOT_ENABLED_ERROR</FailureErrorCode>
       <FailureReason>Destination bucket is not versioning enabled, refer to knowledge base for detailed information and recommended actions.</FailureReason>
       <FailureTime>2023-07-04T06:55:30.969Z</FailureTime>
     </DestinationReplicationStatus>
   </ObjectDetailedReplicationStatus>

3. If the failure reason message is not enough information, you can get remediation suggestions as follows: .
   1. Log in to the Dell Support site.
   2. Search for the knowledge base article titled ObjectScale Debugging Guide.
   3. Search the document for the <FailureErrorCode>.
      The document contains detailed steps for debugging and resolving each failure error code.
4. Retrigger the failed replication object after fixing the configuration issue.
   To retrigger, copy the failed object version to a new version using the standard S3 copy request.