I found a nice little tool in the
Python Cookbook section of the
Activestate website. It is pretty quick and helps to eliminate duplicate files by traversing the folder you run it on, comparing size and hashes for all the files and finally deleting them.
Comment of the author:
It ran against a 3.5 gigabyte set of files composed of about 120,000 files, of which there were about 50,000 duplicates, most of which were over 1 megabyte. The total run took about 2 minutes on a 1.33ghz G4 powerbook. Fast enough for me and fast enough without actually optimizing anything beyond the obvious.
Link to Python Recipe
Comments from my side:
- you will need python installed to use it, but you should have it anyway ;)
- as far as I can see, it works on every platform supporting python
- it doesn't replace the brain ;), it will simply delete everything duplicate
- The ASPN website is pretty slow and frequently unreachable. Contact me, if you like to have this script and can't get it from the page.