Commits

Timo Sulg  committed f740702

Simple crawler first running version and has unittested.

But has some design flaws - it reads toomuch not relevant links, including operational/administrative links, and i have to control/test depth functionality. And its runs very slow - i have some ideas to use multiprocessing module.

  • Participants
  • Parent commits 840b33a

Comments (0)

Files changed (5)