- changed title to Tagging: Explore different tokenizers for punctuation
- edited description
Tagging: Explore different tokenizers for punctuation
Issue #9
resolved
Currently using str.split() method, should try using other more advanced tokenizers like nltk's word_tokenize to solve punctuation issue.
Related to #1
Comments (3)
-
-
- changed status to resolved
-
-
assigned issue to
-
assigned issue to
- Log in to comment