Georg Brandl  committed 9246d7a

Fix docstring of get_tokens_unprocessed.

  • Participants
  • Parent commits 2243bd0
  • Branches default

Comments (0)

Files changed (1)

File pygments/

     def get_tokens_unprocessed(self, text):
-        Return an iterable of (tokentype, value) pairs.
+        Return an iterable of (index, tokentype, value) pairs where "index"
+        is the starting position of the token within the input text.
         In subclasses, implement this method as a generator to
         maximize effectiveness.