Speed up with file size check
Issue #1
resolved
Hashing can be slow, especially when sifting through many files that are not relevant. Generate a second file that contains file sizes instead of hashes. Then when doing postwork, check file size first, then hash if file size is correct.
Comments (5)
-
reporter
-
reporter
I should parse the command line better. Treat things as flags and arguments. Then I can pass a --no-size option and skip size checking if desired. Leaving open until that has been added.
-
reporter
-
assigned issue to
Matt Traudt
-
assigned issue to
-
reporter
Added fully in 29c9a12
Not much testing has been done to test for breakage, but I think I was careful!
-
reporter
- changed status to resolved
- Log in to comment
14bc768 adds this functionality.
I'm concerned about how it will work when looking at file sizes on two different file systems. I did testing on ext4, but will use it in production on zfs with compression.