HTTPSConnectionPool Read timeout and bandersnatch exits

Issue #62 wontfix
jerrygb
created an issue

Hi,

Please take a look at the logs below.

We are using https://bitbucket.org/pypa/bandersnatch/raw/stable/requirements.txt

2016-01-15 05:15:16,231 INFO: Generation file missing. Reinitialising status files. 2016-01-15 05:15:16,236 INFO: Status file missing. Starting over. 2016-01-15 05:15:16,236 INFO: Syncing with https://pypi.python.org. 2016-01-15 05:15:16,236 INFO: Current mirror serial: 0 2016-01-15 05:15:16,237 INFO: Syncing all packages. Traceback (most recent call last): File "/usr/local/bin/bandersnatch", line 9, in <module> load_entry_point('bandersnatch==1.8', 'console_scripts', 'bandersnatch')() File "/usr/local/lib/python2.7/dist-packages/bandersnatch/main.py", line 68, in main args.func(config) File "/usr/local/lib/python2.7/dist-packages/bandersnatch/main.py", line 27, in mirror mirror.synchronize() File "/usr/local/lib/python2.7/dist-packages/bandersnatch/mirror.py", line 78, in synchronize self.determine_packages_to_sync() File "/usr/local/lib/python2.7/dist-packages/bandersnatch/mirror.py", line 120, in determine_packages_to_sync self.packages_to_sync.update(self.master.all_packages()) File "/usr/local/lib/python2.7/dist-packages/bandersnatch/master.py", line 75, in all_packages return self.rpc().list_packages_with_serial() File "/usr/local/lib/python2.7/dist-packages/xmlrpc2/client.py", line 86, in call resp = self._transport.request(self._uri, body) File "/usr/local/lib/python2.7/dist-packages/bandersnatch/master.py", line 19, in request resp = self.session.post(uri, body, timeout=self.timeout) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 504, in post return self.request('POST', url, data=data, json=json, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 461, in request resp = self.send(prep, send_kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 573, in send r = adapter.send(request, **kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 433, in send raise ReadTimeout(e, request=request) requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='pypi.python.org', port=443): Read timed out. (read timeout=10.0)

Thanks, Jerry

Comments (3)

  1. Christian Theune

    Timeouts due to temporary network issues are expected. I run bandersnatch in a very tight cron schedule and like to error out earlier than later: long TCP timeouts have the impact of bandersnatch appearing stuck, and in general WAN connections with reasonable connectivity the default of 10 seconds is fine. Increase only if you you have issues on your side of the connection, i.e. if you have a connection that is usually saturated, lossy or in a remote part of the internet world.

  2. Log in to comment