Commits

Show all
Author Commit Message Labels Comments Date
Gregory Petukhov
Refactoring forms
Branches
forms-refactoring
Gregory Petukhov
Disable sorting POST items by key name. This allow to control order of items in POST data.
Gregory Petukhov
Small changes to logging in mongo queue backend
Gregory Petukhov
Refactor task queue backends. Implement base interface for task queue implementations
Gregory Petukhov
Change file open mode in log_file option
Gregory Petukhov
Version 0.4.3
Gregory Petukhov
Fix request headers
Gregory Petukhov
Change KeyboardInterrupt processing in spider. Now it is propogated to upper level after processing
Gregory Petukhov
Small change to google lib
Gregory Petukhov
Fix bson import issue in mongodb cache backend
Gregory Petukhov
Improve saving of request dumps: now failed requests are dumped too
Gregory Petukhov
Change default redirect limit
Gregory Petukhov
Add link to custom pycurl build
Gregory Petukhov
Version 0.4.2
Gregory Petukhov
Fix unicode-ussie in proxy_userpwd option processing
Gregory Petukhov
Fix docs
Gregory Petukhov
Small fix to runtest.py
Gregory Petukhov
Better charset detection
Gregory Petukhov
More correct processing of empty HTML documents
Gregory Petukhov
Change MANIFEST.in
Gregory Petukhov
Disable logging of INFOTYPE_TEXT messages in debug function
Gregory Petukhov
Better handling userpwd option
Gregory Petukhov
Change queue timeout in spider class
Gregory Petukhov
hashed_path function refactoring
Gregory Petukhov
Fix installation issue
Gregory Petukhov
Fix logging outbound request headers in dump files
Gregory Petukhov
Version 0.4.1
Gregory Petukhov
Fix bug in Task.clone method
Gregory Petukhov
Refactor processing url, grab and grag_config options in Task constructor and clone methods
Gregory Petukhov
Add resolve_base option to process_links method
  1. Prev
  2. Next