Commits

Benjamin Peterson committed 188e5f4

document TokenError and unclosed expression behavior (closes #12063)

Patch by Amandine Lee.

  • Participants
  • Parent commits e89c391
  • Branches 2.7

Comments (0)

Files changed (2)

File Doc/library/tokenize.rst

 
    .. versionadded:: 2.5
 
+.. exception:: TokenError
+
+   Raised when either a docstring or expression that may be split over several
+   lines is not completed anywhere in the file, for example::
+
+      """Beginning of
+      docstring
+
+   or::
+
+      [1,
+       2,
+       3
+
+Note that unclosed single-quoted strings do not cause an error to be
+raised. They are tokenized as ``ERRORTOKEN``, followed by the tokenization of
+their contents.
+
 Example of a script re-writer that transforms float literals into Decimal
 objects::
 
 Chris Lawrence
 Brian Leair
 Mathieu Leduc-Hamel
+Amandine Lee
 Christopher Lee
 Inyeol Lee
 James Lee