1. Evgeniy Tatarkin
  2. pomp

Commits

Author Commit Message Date Builds
Evgeniy Tatarkin
"fix AioPomp main loop and request processing"
Evgeniy Tatarkin
fix self.queue_lock.acquire(True)
Evgeniy Tatarkin
fix queue lock, do not get from queue more than downloader can fetch
Evgeniy Tatarkin
"BaseQueue.get_requests(count=None) and BaseCrawler.on_processing_done(response)"
Evgeniy Tatarkin
"release v0.2"
Evgeniy Tatarkin
"release date for v0.2.0"
Evgeniy Tatarkin
Added tag rel_0_2_0 for changeset 95937c212b0c
Evgeniy Tatarkin
"add architecture docs"
Tags
rel_0_2_0
Evgeniy Tatarkin
"2016 in doc copyright"
Evgeniy Tatarkin
"do not pickle traceback"
Evgeniy Tatarkin
fix BaseCrawlException intialization on response processing
Evgeniy Tatarkin
do not send StopCommand when all jobs done for external queue
Evgeniy Tatarkin
move middleware logic to engine, rename BaseDownloaderException to BaseCrawlException, rename BaseDownloaderMiddleware to BaseMiddleware, more generator like behaviour
Evgeniy Tatarkin
CsvPipeline write row directory from ListView
Evgeniy Tatarkin
AioConcurrentCrawler for asyncio plus concurrent futures (process pool executor) integration
Evgeniy Tatarkin
fix asyncio support
Evgeniy Tatarkin
fix UnboundLocalError: local variable 'value' referenced before assignment
Evgeniy Tatarkin
pomp.core.item moved to pomp.contrib.item by gh-6
Evgeniy Tatarkin
Merge Daniel Naab PR gh-5
Daniel Naab
Documentation changes for readability.
Evgeniy Tatarkin
clenaup def url and def response method from request and response classes
Evgeniy Tatarkin
pick avialble port for mock http server
Evgeniy Tatarkin
url and response properties are not required, trap ctrl-c
Evgeniy Tatarkin
better support for iterator/generator
Evgeniy Tatarkin
phantomjs with scroll
Evgeniy Tatarkin
ctrl-c signal support for concurency doaloder on python2.x
Evgeniy Tatarkin
example: integration with phantomjs
Evgeniy Tatarkin
concurrent parsing via ConcurrentCrawler wrapper
Evgeniy Tatarkin
remove unneede core from Planned class, random port for testing http server, better coverage
Evgeniy Tatarkin
cover report fix
  1. Prev
  2. Next