It looks like phystokens.py has some hacks to go around backslash line changes. This doesn't seem to work when the source file has DOS line changes (\r\n).
I'll try to attach a small patch to fix this. This might not be the optimal one, but works for me.
Also Python 3.x might do something automatic for all open()s, and 2.x has 'U' flag for open (which is not always available).
Tested on Python 2.6.4 (Linux).