PowerScale OneFS 9.4.0.0 CloudPools Administration Guide

CloudPools and SmartDedupe

SmartDedupe scans the OneFS file system for files that contain identical blocks of data. If SmartDedupe finds duplicate blocks, SmartDedupe moves a single copy of the blocks to a hidden file called a shadow store. SmartDedupe then deletes the duplicate blocks from the original files and replaces the blocks with pointers to the shadow store.

CloudPools interacts as follows with SmartDedupe:

• If a file pool policy specifies that de-duplicated files should be archived to cloud storage, CloudPools archives those de-duplicated files and leaves SmartLink files in their place in local storage.
• When an archived file that had been de-duplicated is recalled from the cloud, the SmartLink file is replaced and the recalled file placed back in local storage is no longer de-duplicated.
• SmartDedupe does not de-duplicate SmartLink files.