Make whoosh indexer more error proof

Issue #92 resolved
Marcin Kuzminski repo owner created an issue

Especially for not unicode content and on some bad source files, for example a *.py file containing binary data will crash whoosh indexers.

1 check for binary data during indexing,

2 catch Whoosh unicode errors, and just do a warning instead and skip this content.

Comments (3)

  1. Log in to comment