1. David Larlet
  2. django-storages
  3. Pull requests

Pull requests

#67 Declined
Repository
NicolasPieuchot
Branch
default
Repository
david
Branch
default

Speed up exists function on buckets with large number of files (>10⁵)

Author
  1. NicolasPieuchot
Reviewers
Description

I have hundred thousand files in my bucket and exists function was very slow (several minutes), I added the AWS_S3_NUMEROUS_FILES parameter to skip the entries lookup and speedup the function.

Comments (2)

  1. NicolasPieuchot author

    As the pre-loading function however has to iterate over the whole dictionary to find the good entry, I'm not sure that there is any other way fixing it than disabling it.

    Would you see a better option ?