Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(754)

Unified Diff: tools/lexer_generator/code_generator.jinja

Issue 148283007: Experimental parser: remove bom handling (Closed) Base URL: https://v8.googlecode.com/svn/branches/experimental/parser
Patch Set: Created 6 years, 11 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View side-by-side diff with in-line comments
Download patch
« no previous file with comments | « src/scanner.h ('k') | tools/lexer_generator/code_generator.py » ('j') | no next file with comments »
Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
Index: tools/lexer_generator/code_generator.jinja
diff --git a/tools/lexer_generator/code_generator.jinja b/tools/lexer_generator/code_generator.jinja
index ab1c05720a086b2c524931c40b79f1c190202fd2..a7b759a307b3d2b8a9671e39b8b2e602ef3ea255 100644
--- a/tools/lexer_generator/code_generator.jinja
+++ b/tools/lexer_generator/code_generator.jinja
@@ -47,9 +47,7 @@
{%- endif -%}
{# These classes require long_char and to be outside the primary range #}
{%- elif r[0] == 'LONG_CHAR_CLASS' and encoding in ['utf16', 'utf8'] -%}
- {%- if r[1] == 'byte_order_mark' -%}
- (long_char == 0xfffe || long_char == 0xfeff)
- {%- elif r[1] == 'call' -%}
+ {%- if r[1] == 'call' -%}
unicode_cache_->{{r[2]}}(long_char)
{%- elif r[1] == 'invert' -%}
!({{do_key(r[2])}})
« no previous file with comments | « src/scanner.h ('k') | tools/lexer_generator/code_generator.py » ('j') | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698