Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(42)

Side by Side Diff: tools/lexer_generator/regex_lexer.py

Issue 52693002: Experimental lexer generator: escaping fix (Closed) Base URL: https://v8.googlecode.com/svn/branches/experimental/parser
Patch Set: Created 7 years, 1 month ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
« no previous file with comments | « no previous file | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 # Copyright 2013 the V8 project authors. All rights reserved. 1 # Copyright 2013 the V8 project authors. All rights reserved.
2 # Redistribution and use in source and binary forms, with or without 2 # Redistribution and use in source and binary forms, with or without
3 # modification, are permitted provided that the following conditions are 3 # modification, are permitted provided that the following conditions are
4 # met: 4 # met:
5 # 5 #
6 # * Redistributions of source code must retain the above copyright 6 # * Redistributions of source code must retain the above copyright
7 # notice, this list of conditions and the following disclaimer. 7 # notice, this list of conditions and the following disclaimer.
8 # * Redistributions in binary form must reproduce the above 8 # * Redistributions in binary form must reproduce the above
9 # copyright notice, this list of conditions and the following 9 # copyright notice, this list of conditions and the following
10 # disclaimer in the documentation and/or other materials provided 10 # disclaimer in the documentation and/or other materials provided
(...skipping 68 matching lines...) Expand 10 before | Expand all | Expand 10 after
79 79
80 def t_class_CLASS_END(self, t): 80 def t_class_CLASS_END(self, t):
81 r'\]' 81 r'\]'
82 self.lexer.pop_state() 82 self.lexer.pop_state()
83 return t 83 return t
84 84
85 t_class_RANGE = '-' 85 t_class_RANGE = '-'
86 t_class_NOT = '\^' 86 t_class_NOT = '\^'
87 87
88 def t_class_ESCAPED_CLASS_LITERAL(self, t): 88 def t_class_ESCAPED_CLASS_LITERAL(self, t):
89 r'\\\^|\\-' 89 r'\\\^|\\-|\\\[|\\\]'
90 t.type = 'CLASS_LITERAL' 90 t.type = 'CLASS_LITERAL'
91 t.value = t.value[1:] 91 t.value = t.value[1:]
92 return t 92 return t
93 93
94 t_class_CLASS_LITERAL = r'[a-zA-Z]' # fix this 94 t_class_CLASS_LITERAL = r'[a-zA-Z]' # fix this
95 95
96 t_ANY_ignore = '\n' 96 t_ANY_ignore = '\n'
97 97
98 def t_ANY_error(self, t): 98 def t_ANY_error(self, t):
99 raise Exception("Illegal character '%s'" % t.value[0]) 99 raise Exception("Illegal character '%s'" % t.value[0])
100 100
101 def build(self, **kwargs): 101 def build(self, **kwargs):
102 self.lexer = lex.lex(module=self, **kwargs) 102 self.lexer = lex.lex(module=self, **kwargs)
OLDNEW
« no previous file with comments | « no previous file | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698