Unsolved
This post is more than 5 years old
9 Posts
0
800
Cleaning up 24TB of content on a Centera device
I need to clean up 24TB of content from a Centera device. My procedure is:
1. download the list of clipid that have been created between time x and y
2. create a connection pool of 30 processes
3. have a multithreaded client to load this connection pool to delete each of the clipid.
it will take a month to clean up 24TB according to my calculation.
Are there any better way to clean up contents from Centera? Please help. Thanks.
Ging
ging505
9 Posts
0
July 28th, 2014 15:00
you are right. it should be 100 to 200 million clipids. thanks.
Ging
mfh2
208 Posts
0
July 28th, 2014 15:00
If we take the middle of this range (150M) you're looking at consistently deleting 58 clips per second for 30 days, or ~ 2 deletes per process per second. In my experience that's actually a pretty good rate; if you can do this good or better consider yourself lucky. Remember that the data is still on the disks until garbage collection completes a full cycle, and if you turn on DoD shredding the garbage collection rate drops through the floor.
EMC does have a secure erasure service available that can be delivered through their PS team if you need to get this done faster. I believe it involves bulk erasure and reimaging of all the disks in the system.
Good luck,
Mike Horgan
mfh2
208 Posts
0
July 28th, 2014 15:00
It's 24 TB, but how many clips are you dealing with? On Centera it's really the object count that makes the most difference.
ging505
9 Posts
0
July 28th, 2014 17:00
Mike,
Thank you so much for your help. I doubt our business user will pay addition to clean up the Centera device. thanks again.
Ging