DataIQ 2.2 Admin Guide

Automatically scan for duplicate files

Schedule automatic searches for duplicate files across your managed clusters.

1. From the DataIQ UI: Select Settings > Data management configuration.
2. In the Plugins section, select the ⋮ (vertical ellipses) icon next to Duplicates, and select Edit configuration.
3. Uncomment the Cron Jobs section. Keep all the lines for when you want the cron job to execute, and either comment out or remove the rest.
   Optional: To run the cron job immediately after saving the config file, in the Execute On section, change the value of Start to True.
4. Review the cron job output at /opt/dataiq/maunakea/data/plugins/duplicates/outputs/cron-<user name>/. Or, run the command: kubectl logs -ndataiq plugin-duplicates-0.