Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(1)

Side by Side Diff: src/lexer/lexer_py.re

Issue 75203002: Experimental lexer generator: Fix number rules. (Closed) Base URL: https://v8.googlecode.com/svn/branches/experimental/parser
Patch Set: Created 7 years, 1 month ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
« no previous file with comments | « no previous file | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 # Copyright 2013 the V8 project authors. All rights reserved. 1 # Copyright 2013 the V8 project authors. All rights reserved.
2 # Redistribution and use in source and binary forms, with or without 2 # Redistribution and use in source and binary forms, with or without
3 # modification, are permitted provided that the following conditions are 3 # modification, are permitted provided that the following conditions are
4 # met: 4 # met:
5 # 5 #
6 # * Redistributions of source code must retain the above copyright 6 # * Redistributions of source code must retain the above copyright
7 # notice, this list of conditions and the following disclaimer. 7 # notice, this list of conditions and the following disclaimer.
8 # * Redistributions in binary form must reproduce the above 8 # * Redistributions in binary form must reproduce the above
9 # copyright notice, this list of conditions and the following 9 # copyright notice, this list of conditions and the following
10 # disclaimer in the documentation and/or other materials provided 10 # disclaimer in the documentation and/or other materials provided
(...skipping 83 matching lines...) Expand 10 before | Expand all | Expand 10 after
94 ">>=" <|push_token(ASSIGN_SAR)|> 94 ">>=" <|push_token(ASSIGN_SAR)|>
95 "<=" <|push_token(LTE)|> 95 "<=" <|push_token(LTE)|>
96 ">=" <|push_token(GTE)|> 96 ">=" <|push_token(GTE)|>
97 "<<" <|push_token(SHL)|> 97 "<<" <|push_token(SHL)|>
98 ">>" <|push_token(SAR)|> 98 ">>" <|push_token(SAR)|>
99 "<" <|push_token(LT)|> 99 "<" <|push_token(LT)|>
100 ">" <|push_token(GT)|> 100 ">" <|push_token(GT)|>
101 101
102 number <|push_token(NUMBER)|> 102 number <|push_token(NUMBER)|>
103 number identifier_char <|push_token(ILLEGAL)|> 103 number identifier_char <|push_token(ILLEGAL)|>
104 number "\\" <|push_token(ILLEGAL)|>
104 105
105 "(" <|push_token(LPAREN)|> 106 "(" <|push_token(LPAREN)|>
106 ")" <|push_token(RPAREN)|> 107 ")" <|push_token(RPAREN)|>
107 "[" <|push_token(LBRACK)|> 108 "[" <|push_token(LBRACK)|>
108 "]" <|push_token(RBRACK)|> 109 "]" <|push_token(RBRACK)|>
109 "{" <|push_token(LBRACE)|> 110 "{" <|push_token(LBRACE)|>
110 "}" <|push_token(RBRACE)|> 111 "}" <|push_token(RBRACE)|>
111 ":" <|push_token(COLON)|> 112 ":" <|push_token(COLON)|>
112 ";" <|push_token(SEMICOLON)|> 113 ";" <|push_token(SEMICOLON)|>
113 "." <|push_token(PERIOD)|> 114 "." <|push_token(PERIOD)|>
(...skipping 114 matching lines...) Expand 10 before | Expand all | Expand 10 after
228 eof <|skip_and_terminate|> 229 eof <|skip_and_terminate|>
229 catch_all <||continue> 230 catch_all <||continue>
230 231
231 <<MultiLineComment>> 232 <<MultiLineComment>>
232 /\*+\// <|skip|> 233 /\*+\// <|skip|>
233 # TODO find a way to generate the below rule 234 # TODO find a way to generate the below rule
234 /\*+[^\/*]/ <||continue> 235 /\*+[^\/*]/ <||continue>
235 line_terminator <push_line_terminator||continue> 236 line_terminator <push_line_terminator||continue>
236 eof <|skip_and_terminate|> 237 eof <|skip_and_terminate|>
237 catch_all <||continue> 238 catch_all <||continue>
OLDNEW
« no previous file with comments | « no previous file | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698