Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(82)

Side by Side Diff: tools/lexer_generator/regex_lexer.py

Issue 75143002: Experimental parser: make string rules look more like ecma spec (Closed) Base URL: https://v8.googlecode.com/svn/branches/experimental/parser
Patch Set: Created 7 years, 1 month ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
« no previous file with comments | « src/lexer/lexer_py.re ('k') | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 # Copyright 2013 the V8 project authors. All rights reserved. 1 # Copyright 2013 the V8 project authors. All rights reserved.
2 # Redistribution and use in source and binary forms, with or without 2 # Redistribution and use in source and binary forms, with or without
3 # modification, are permitted provided that the following conditions are 3 # modification, are permitted provided that the following conditions are
4 # met: 4 # met:
5 # 5 #
6 # * Redistributions of source code must retain the above copyright 6 # * Redistributions of source code must retain the above copyright
7 # notice, this list of conditions and the following disclaimer. 7 # notice, this list of conditions and the following disclaimer.
8 # * Redistributions in binary form must reproduce the above 8 # * Redistributions in binary form must reproduce the above
9 # copyright notice, this list of conditions and the following 9 # copyright notice, this list of conditions and the following
10 # disclaimer in the documentation and/or other materials provided 10 # disclaimer in the documentation and/or other materials provided
(...skipping 51 matching lines...) Expand 10 before | Expand all | Expand 10 after
62 'CLASS_LITERAL', 62 'CLASS_LITERAL',
63 'CLASS_LITERAL_AS_OCTAL', 63 'CLASS_LITERAL_AS_OCTAL',
64 'CHARACTER_CLASS', 64 'CHARACTER_CLASS',
65 ) 65 )
66 66
67 states = ( 67 states = (
68 ('class','exclusive'), 68 ('class','exclusive'),
69 ('repeat','exclusive'), 69 ('repeat','exclusive'),
70 ) 70 )
71 71
72 __escaped_literals = build_escape_map("(){}[]?+.*|\\") 72 __escaped_literals = build_escape_map("(){}[]?+.*|'\"\\")
73 73
74 def t_ESCAPED_LITERAL(self, t): 74 def t_ESCAPED_LITERAL(self, t):
75 r'\\.' 75 r'\\.'
76 t.type = 'LITERAL' 76 t.type = 'LITERAL'
77 t.value = RegexLexer.__escaped_literals[t.value] 77 t.value = RegexLexer.__escaped_literals[t.value]
78 return t 78 return t
79 79
80 t_GROUP_BEGIN = r'\(' 80 t_GROUP_BEGIN = r'\('
81 t_GROUP_END = r'\)' 81 t_GROUP_END = r'\)'
82 82
(...skipping 25 matching lines...) Expand all
108 return t 108 return t
109 109
110 __escaped_class_literals = build_escape_map("^[]-:\\") 110 __escaped_class_literals = build_escape_map("^[]-:\\")
111 111
112 def t_class_ESCAPED_CLASS_LITERAL(self, t): 112 def t_class_ESCAPED_CLASS_LITERAL(self, t):
113 r'\\.' 113 r'\\.'
114 t.type = 'CLASS_LITERAL' 114 t.type = 'CLASS_LITERAL'
115 t.value = RegexLexer.__escaped_class_literals[t.value] 115 t.value = RegexLexer.__escaped_class_literals[t.value]
116 return t 116 return t
117 117
118 t_class_CLASS_LITERAL = r'[\w *$_+\'/]' 118 t_class_CLASS_LITERAL = r'[\w *$_+\'\"/]'
119 119
120 def t_REPEAT_BEGIN(self, t): 120 def t_REPEAT_BEGIN(self, t):
121 r'\{' 121 r'\{'
122 self.lexer.push_state('repeat') 122 self.lexer.push_state('repeat')
123 return t 123 return t
124 124
125 def t_repeat_REPEAT_END(self, t): 125 def t_repeat_REPEAT_END(self, t):
126 r'\}' 126 r'\}'
127 self.lexer.pop_state() 127 self.lexer.pop_state()
128 return t 128 return t
129 129
130 t_repeat_NUMBER = r'[0-9]+' 130 t_repeat_NUMBER = r'[0-9]+'
131 t_repeat_COMMA = r',' 131 t_repeat_COMMA = r','
132 132
133 t_ANY_ignore = '\n' 133 t_ANY_ignore = '\n'
134 134
135 def t_ANY_error(self, t): 135 def t_ANY_error(self, t):
136 raise Exception("Illegal character '%s'" % t.value[0]) 136 raise Exception("Illegal character '%s'" % t.value[0])
137 137
138 def build(self, **kwargs): 138 def build(self, **kwargs):
139 self.lexer = lex.lex(module=self, **kwargs) 139 self.lexer = lex.lex(module=self, **kwargs)
OLDNEW
« no previous file with comments | « src/lexer/lexer_py.re ('k') | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698