Home / server / Questions / 411688
In Process
Uninspired
Asked: 2012-07-27 18:18:20 +0800 CST

Fastest way to delete millions of files on an Isilon IQ 72NL SAN?

  • 772

This question has been asked a number of times in general linux terms and in relation to certain file systems, but I have not seen the question asked about this specific brand/model SAN. So, the question is: What's the fastest way to delete millions of files (JPGs ranging from 1-15MB) on an Isilon near line model? Unfortunately, it's a custom OS and modifying that is entirely out of the question (unless it's something supported by Isilon that doesn't void the warranty). As far as I can tell, rm via SSH is barely faster than just mounting the share from a client and deleting it that way -- and those are the only two options I'm aware of. The Isilon GUI file system explorer doesn't have a delete function. Anyway, if anyone has any experience with this model (or even with Isilon in general -- they're probably similar), I'd appreciate any input.

Thanks

storage-area-network

1 Answers

  1. If the backup of the remaining of the data, formatting the fs and restoring the backup is faster than the delete, then you can consider this as a solution.

    If the filesystem is a transactional one (journal based one), then disable the journal, increase the time for sync to disk of the fs, delete the data, then re-enable the journal.

    In the OneFS WebUI go to the Cluster Management > Operations page.

    There is a link called "Start Job". Click it and in the Job field select TreeDelete. Enter the path that is desired to be deleted. Then click Start. The folder and its children will be deleted.

    Be sure to remove any orphaned shares that point to a path in that tree. Otherwise the SMB shares may not display correctly.

    • 1