DataIQ User Guide

Transfer files using Data Mover

When Data Mover is installed and configured, you can transfer files between servers and to and from external object stores.

1. From DataIQ, select Data Management, and then use either the Search or Browse features to find a file, folder, or volume that you want to transfer.
2. In the Actions pane on the right, select Transfer. (The Transfer option only appears when Data Mover is enabled.)

   The Transfer dialog opens, and displays the following information:

   • Source path selected
   • File count and total size of the selected source.
     NOTE These values may not always be up-to-date or accurate. The values are based on the file count and size from the most recent DataIQ file scan. After the job is started, you can see updated, accurate values in the View Transfers page.
   • The number of active transfer jobs, system-wide.
   • The number of busy worker processes compared to the total number of worker processes, system-wide.
   • The amount of space available on each volume.
   • Whether the volume supports sequence transfers.

   

3. Select the destination. Options:
   • Same path as source, on volume: Copies to the same location on another volume. Example: If the source is /Vol1/Movies/EveryoneIsHappy/Subtitles/ and the destination volume that is selected is /Production, then the full destination path is /Production/Movies/EveryoneIsHappy/Subtitles/ .
   • Custom destination volume and path: Copies to the specified destination. Note, when copying to a different volume, use the full path, for example, /Vol1/Movies. Any selections in the list of volumes are ignored.

   NOTE

   • When Data Mover cannot transfer files, it opens a dialog saying why the transfer is not possible.
   • The source volume cannot be the same as the destination volume.
   • If any of the destination folders do not exist, Data Mover creates them.
   • Some source folders or destination folders may be restricted based on the DataIQ group Viewfilter rules. To learn more, see Viewfilters in the Dell EMC DataIQ Admin Guide
4. DataIQ Administrators may enable the following additional options:

   Maximum processes for the job

   Set a limit on the maximum amount of resources that Data Mover can use. Leave the field blank if you do not want to set a maximum limit.

   Allow destination folder to exist prior to transferring files

   When selected, Data Mover can overwrite files and folders on the destination.

   Transfer files in sequence

   When selected, Data Mover reserves (or preallocates) space on the disk before copying the bytes to the destination. Preallocating files can help performance later for files that are all accessed together, such as video files. For S3 endpoints and file systems that do not support preallocation, this setting is ignored.

   Delete Source

   When selected, Data Mover deletes the source files and folders after the transfer has completed successfully with no errors and no omitted source paths.

   Checksum

   The checksum is a cryptographic algorithm used to verify the transfer. Algorith options include md5, sha256, or none.

5. Select Submit.

   A dialog appears to either confirm the request was started, or tell you why the job could not be created. In some cases, a job may be started successfully but contain warnings, for example, when a destination path already exists and will be overwritten.

6. To check the progress of your file transfer, on the left side of the page, select View Transfers.

   A pop-up screen appears with a list of all transfer jobs, and whether they are Active, Paused, Canceled, Completed, or Failed. Each job listing has an associated button at the far right of this window. The button text shows you the Data Mover Service name for the job. Select this button to bring up job-specific log messages.

   At the bottom of View Transfers dialog, you can see:

   • The total number of workers across all worker nodes.
   • The total number of busy worker processes.
   • The total number of active transfer jobs.