tools/lexer_generator/regex_lexer.py - Issue 59033005: Experimental parser: build regex parse trees for all rules

Side by Side Diff

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Keyboard Shortcuts

	File
u :	up to issue
j / k :	jump to file after / before current file
J / K :	jump to next file with a comment after / before current file
	Side-by-side diff
i :	toggle intra-line diffs
e :	expand all comments
c :	collapse all comments
s :	toggle showing all comments
n / p :	next / previous diff chunk or comment
N / P :	next / previous comment
<Up> / <Down> :	next / previous line

	Issue
u :	up to list of issues
j / k :	jump to patch after / before current patch
o / <Enter> :	open current patch in side-by-side view
i :	open current patch in unified diff view

	Issue List
j / k :	jump to issue after / before current issue
o / <Enter> :	open current issue

Side by Side Diff: tools/lexer_generator/regex_lexer.py

Issue 59033005: Experimental parser: build regex parse trees for all rules (Closed) Base URL: https://v8.googlecode.com/svn/branches/experimental/parser

Patch Set: Created 7 years, 1 month ago

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Jump to:

View unified diff | Download patch | Annotate | Revision Log

OLD	NEW
1 # Copyright 2013 the V8 project authors. All rights reserved.	1 # Copyright 2013 the V8 project authors. All rights reserved.

2 # Redistribution and use in source and binary forms, with or without	2 # Redistribution and use in source and binary forms, with or without

3 # modification, are permitted provided that the following conditions are	3 # modification, are permitted provided that the following conditions are

4 # met:	4 # met:

5 #	5 #

6 # * Redistributions of source code must retain the above copyright	6 # * Redistributions of source code must retain the above copyright

7 # notice, this list of conditions and the following disclaimer.	7 # notice, this list of conditions and the following disclaimer.

8 # * Redistributions in binary form must reproduce the above	8 # * Redistributions in binary form must reproduce the above

9 # copyright notice, this list of conditions and the following	9 # copyright notice, this list of conditions and the following

10 # disclaimer in the documentation and/or other materials provided	10 # disclaimer in the documentation and/or other materials provided

(...skipping 75 matching lines...) Expand 10 before \| Expand all \| Expand 10 after Loading...
86 t_class_RANGE = '-'	86 t_class_RANGE = '-'

87 t_class_NOT = '\^'	87 t_class_NOT = '\^'

88 t_class_CHARACTER_CLASS = r':\w+:'	88 t_class_CHARACTER_CLASS = r':\w+:'

89	89

90 def t_class_ESCAPED_CLASS_LITERAL(self, t):	90 def t_class_ESCAPED_CLASS_LITERAL(self, t):

91 r'\\\^\|\\-\|\\\[\|\\\]\|\\\:\|\\\w'	91 r'\\\^\|\\-\|\\\[\|\\\]\|\\\:\|\\\w'

92 t.type = 'CLASS_LITERAL'	92 t.type = 'CLASS_LITERAL'

93 t.value = t.value[1:]	93 t.value = t.value[1:]

94 return t	94 return t

95	95

96 t_class_CLASS_LITERAL = r'[\w $_:+]' # fix this	96 t_class_CLASS_LITERAL = r'[\w $_+]' # fix this

97	97

98 t_ANY_ignore = '\n'	98 t_ANY_ignore = '\n'

99	99

100 def t_ANY_error(self, t):	100 def t_ANY_error(self, t):

101 raise Exception("Illegal character '%s'" % t.value[0])	101 raise Exception("Illegal character '%s'" % t.value[0])

102	102

103 def build(self, **kwargs):	103 def build(self, **kwargs):

104 self.lexer = lex.lex(module=self, **kwargs)	104 self.lexer = lex.lex(module=self, **kwargs)

OLD	NEW

« no previous file with comments | « tools/lexer_generator/nfa.py ('k') | tools/lexer_generator/regex_parser.py » ('j') | no next file with comments »