Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(2)

Side by Side Diff: src/lexer/lexer_py.re

Issue 93893006: Experimental scanner: fix new-line detection. (Closed) Base URL: https://v8.googlecode.com/svn/branches/experimental/parser
Patch Set: Created 7 years ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
« no previous file with comments | « no previous file | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 # Copyright 2013 the V8 project authors. All rights reserved. 1 # Copyright 2013 the V8 project authors. All rights reserved.
2 # Redistribution and use in source and binary forms, with or without 2 # Redistribution and use in source and binary forms, with or without
3 # modification, are permitted provided that the following conditions are 3 # modification, are permitted provided that the following conditions are
4 # met: 4 # met:
5 # 5 #
6 # * Redistributions of source code must retain the above copyright 6 # * Redistributions of source code must retain the above copyright
7 # notice, this list of conditions and the following disclaimer. 7 # notice, this list of conditions and the following disclaimer.
8 # * Redistributions in binary form must reproduce the above 8 # * Redistributions in binary form must reproduce the above
9 # copyright notice, this list of conditions and the following 9 # copyright notice, this list of conditions and the following
10 # disclaimer in the documentation and/or other materials provided 10 # disclaimer in the documentation and/or other materials provided
(...skipping 20 matching lines...) Expand all
31 digit = [0-9]; 31 digit = [0-9];
32 hex_digit = [0-9a-fA-F]; 32 hex_digit = [0-9a-fA-F];
33 single_escape_char = ['"\\bfnrtv]; 33 single_escape_char = ['"\\bfnrtv];
34 maybe_exponent = /([eE][\-+]?[:digit:]+)?/; 34 maybe_exponent = /([eE][\-+]?[:digit:]+)?/;
35 octal_number = /0[0-7]+/; 35 octal_number = /0[0-7]+/;
36 number = 36 number =
37 /0[xX][:hex_digit:]+/ | ( 37 /0[xX][:hex_digit:]+/ | (
38 /\.[:digit:]+/ maybe_exponent | 38 /\.[:digit:]+/ maybe_exponent |
39 /[:digit:]+(\.[:digit:]*)?/ maybe_exponent ); 39 /[:digit:]+(\.[:digit:]*)?/ maybe_exponent );
40 harmony_number = "0"[bBoO][:digit:]+; 40 harmony_number = "0"[bBoO][:digit:]+;
41 line_terminator_sequence = /[:line_terminator:]|\r\n/; 41 line_terminator_sequence = /[:line_terminator:]|(\r\n|\n\r)/;
42 eos = [:eos:]; 42 eos = [:eos:];
43 43
44 # grammar is 44 # grammar is
45 # regex <action_on_state_entry|action_on_match|transition> 45 # regex <action_on_state_entry|action_on_match|transition>
46 # 46 #
47 # actions can be c code enclosed in {} or identifiers to be passed to codegen 47 # actions can be c code enclosed in {} or identifiers to be passed to codegen
48 # transition must be in continue or the name of a subgraph 48 # transition must be in continue or the name of a subgraph
49 49
50 <<default>> 50 <<default>>
51 51
(...skipping 186 matching lines...) Expand 10 before | Expand all | Expand 10 after
238 eos <|skip_and_terminate|> 238 eos <|skip_and_terminate|>
239 catch_all <||continue> 239 catch_all <||continue>
240 240
241 <<MultiLineComment>> 241 <<MultiLineComment>>
242 /\*+\// <|skip|> 242 /\*+\// <|skip|>
243 # TODO find a way to generate the below rule 243 # TODO find a way to generate the below rule
244 /\*+[^\/*]/ <||continue> 244 /\*+[^\/*]/ <||continue>
245 line_terminator <line_terminator||continue> 245 line_terminator <line_terminator||continue>
246 eos <|terminate_illegal|> 246 eos <|terminate_illegal|>
247 catch_all <||continue> 247 catch_all <||continue>
OLDNEW
« no previous file with comments | « no previous file | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698