Commits

Author Commit Message Labels Comments Date
Ismael Carnales
stlyed downloaded middleware doc
Ismael Carnales
added module directive to spidermw documentation
Ismael Carnales
added urllength spider middleware test
Ismael Carnales
added urlfilter spidermw test
Ismael Carnales
added referer spider middleware test
Ismael Carnales
added offside spider middleware test
Ismael Carnales
added depth spider middleware test
Ismael Carnales
fixed stats downloadermw test
Pablo Hoffman
renamed test_xpath.py to test_selector.py
Pablo Hoffman
added support for instantiating TextResponse (or any subclass) with unicode urls, improved organization of request/response unittests
Pablo Hoffman
better aws code arrangement
Pablo Hoffman
removed obsolete scrapy.utils.db module
Pablo Hoffman
removed some more obsolete middlewares
Pablo Hoffman
removed obsolete RestrictMiddleware
Pablo Hoffman
removed backwards compatibility for old errorpages downloader middlware
Ismael Carnales
added some missing spidermw tests
Ismael Carnales
added missing middleware docs
Ismael Carnales
added some missing middlewares tests
Pablo Hoffman
more updates to spider middleware doc
Pablo Hoffman
some improvements to spider middleware doc
Pablo Hoffman
removed (pretty useless) DebugMiddleware
Pablo Hoffman
fixed bug in robots middleware reported by fencer in #101
Pablo Hoffman
added comment downloader backout policy
Daniel Graña
meassure downloader backout based on active requests that includes those in downlodermw plus queue
Daniel Graña
change csv exporter to check flag inmediately instead of calling another function
Daniel Graña
media_pipeline: let failures reach item_completed
Pablo Hoffman
fixed another doc typo
Pablo Hoffman
some code rearrangement without functionality changes
Ismael Carnales
fixed typo in djangoitems doc (thanks anibal)
Daniel Graña
write header line by default when using csv exporter
  1. Prev
  2. Next