Commits

Eric Knibbe committed 7754058

remove BOM for latin1 or UTF-8 encodings

Comments (0)

Files changed (1)

pygments/lexers/web.py

         RegexLexer.__init__(self, **options)
 
     def get_tokens_unprocessed(self, text):
-        text = text.lstrip(u'\ufeff')
+        text = text.lstrip(u'\xef\xbb\xbf\ufeff')
         stack = ['root']
         if self.requiredelimiters:
             stack.append('delimiters')