Commits

Andy Li committed 7b1f3be

fixed #822 (remove BOM if present)

Comments (0)

Files changed (2)

pygments/lexer.py

             else:
                 text = text.decode(self.encoding)
         # text now *is* a unicode string
+        text = text.lstrip(u'\xef\xbb\xbf\ufeff') # remove BOM
         text = text.replace('\r\n', '\n')
         text = text.replace('\r', '\n')
         if self.stripall:

tests/test_examplefiles.py

         text = fp.read()
     finally:
         fp.close()
+    text = text.lstrip(u'\xef\xbb\xbf\ufeff') #remove BOM
     text = text.replace(b('\r\n'), b('\n'))
     text = text.strip(b('\n')) + b('\n')
     try: