Sample Header Ad - 728x90

Removing dirs with lots of tiny files on Lustre

4 votes
3 answers
3492 views
I have a dir with a gigantic amount of very small files that I want to remove and simply removing the dir with rm -rf /path/to/the/dir is already taking multiple days. It might sound strange that this is going slow, but the dir is not a dir on regular filesystem. It's a dir on a Lustre Filesystem of a cluster. I'm running the rm command on node A of the cluster which has the Lustre mounted, but the backend of the Lustre are 2 ZFS filesystems, one on node B and one on node C so all the networktraffic might be the cause of rm going slow. Does anyone know faster ways to remove the dir than my way ?
Asked by Eduardo J. Culpepper (41 rep)
Jun 12, 2016, 11:44 AM
Last activity: Feb 20, 2023, 07:27 AM