tools/lexer_generator/regex_parser.py - Issue 59263003: Experimental lexer generator: parse \000 etc. inside char classes.

Keyboard Shortcuts

	File
u :	up to issue
j / k :	jump to file after / before current file
J / K :	jump to next file with a comment after / before current file
	Side-by-side diff
i :	toggle intra-line diffs
e :	expand all comments
c :	collapse all comments
s :	toggle showing all comments
n / p :	next / previous diff chunk or comment
N / P :	next / previous comment
<Up> / <Down> :	next / previous line

	Issue
u :	up to list of issues
j / k :	jump to patch after / before current patch
o / <Enter> :	open current patch in side-by-side view
i :	open current patch in unified diff view

	Issue List
j / k :	jump to issue after / before current issue
o / <Enter> :	open current issue

Unified Diff: tools/lexer_generator/regex_parser.py

Issue 59263003: Experimental lexer generator: parse \000 etc. inside char classes. (Closed) Base URL: https://v8.googlecode.com/svn/branches/experimental/parser

Patch Set: . Created 7 years, 1 month ago

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Jump to:

View side-by-side diff with in-line comments

Download patch

Index: tools/lexer_generator/regex_parser.py

diff --git a/tools/lexer_generator/regex_parser.py b/tools/lexer_generator/regex_parser.py

index c533215ab863dd535df8b4377c2b869d88f0a5f0..0afd356cd2336172390c44e3514e031dc8809416 100644

--- a/tools/lexer_generator/regex_parser.py

+++ b/tools/lexer_generator/regex_parser.py

@@ -113,12 +113,15 @@ class RegexParser:

'''class_content : CLASS_LITERAL RANGE CLASS_LITERAL maybe_class_content

| CLASS_LITERAL maybe_class_content

| CHARACTER_CLASS maybe_class_content

+ | CLASS_LITERAL_AS_OCTAL maybe_class_content

'''

if len(p) == 5:

left = ("RANGE", p[1], p[3])

else:

if len(p[1]) == 1:

left = ('LITERAL', p[1])

+ elif p[1][0] == '\\':

+ left = ('LITERAL', chr(int(p[1][1:], 8)))

else:

left = ('CHARACTER_CLASS', p[1][1:-1])

p[0] = self.__cat(left, p[len(p)-1])

« no previous file with comments | « tools/lexer_generator/regex_lexer.py ('k') | tools/lexer_generator/rule_parser.py » ('j') | no next file with comments »