If you've ever run data recovery tools, you know how you end up with seemingly countless copies of the same file.

Well, fileDuplicateNuker is an effort to make cleanup easier. Basically it runs a hash of the files within a user-specified recovery directory, and deletes those files that have a duplicate signature.

Does this completely resolve the issue? Oh God no. A difference of even one bite causes a file to have a completely different hash than the original. However, it does take care of deleting a bunch of files IMHO. It's not something that'll take care of the problem completely, but it will lighten the load.

Feel free to use this script, keeping in mind that it errs on the side of caution (i.e. keeping the file) if there is any difference at all between it and a file that's already been reviewed.