Issue #402 open
The methods getToken() and peekToken() are not correctly implemented:
- getToken() never calls needMoreTokens(), which causes the method to return null if called a second time withtout peekToken() in between.
- peekToken() may raise an IndexOutOfBoundsException instead of returning null as it does not check if there are tokens left before calling tokens.get(0).
These issues causes the scanner not to work as expected, especially compared to its Pythonic brother.