tools/lexer_generator/automaton.py - Issue 82803003: Experimental parser: add utf8 encoding

Keyboard Shortcuts

	File
u :	up to issue
j / k :	jump to file after / before current file
J / K :	jump to next file with a comment after / before current file
	Side-by-side diff
i :	toggle intra-line diffs
e :	expand all comments
c :	collapse all comments
s :	toggle showing all comments
n / p :	next / previous diff chunk or comment
N / P :	next / previous comment
<Up> / <Down> :	next / previous line

	Issue
u :	up to list of issues
j / k :	jump to patch after / before current patch
o / <Enter> :	open current patch in side-by-side view
i :	open current patch in unified diff view

	Issue List
j / k :	jump to issue after / before current issue
o / <Enter> :	open current issue

Unified Diff: tools/lexer_generator/automaton.py

Issue 82803003: Experimental parser: add utf8 encoding (Closed) Base URL: https://v8.googlecode.com/svn/branches/experimental/parser

Patch Set: Created 7 years, 1 month ago

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Jump to:

Index: tools/lexer_generator/automaton.py

diff --git a/tools/lexer_generator/automaton.py b/tools/lexer_generator/automaton.py

index 7321fae5972459374fb9bd33d04a8031fb8f9a40..ddd59fed54e5971cdcc0d1c720d619ba567321f4 100644

--- a/tools/lexer_generator/automaton.py

+++ b/tools/lexer_generator/automaton.py

@@ -217,6 +217,8 @@ class Automaton(object):

for key, state in node.key_state_iter():

if key == TransitionKey.epsilon():

key = "ε"

+ else:

+ key = key.to_string(self.encoding())

edge_content.append(" S_%s -> S_%s [ label = \"%s\" ];" % (

node.node_number(), state.node_number(), escape(key)))

return (node_content, edge_content)

« no previous file with comments | « no previous file | tools/lexer_generator/code_generator.py » ('j') | no next file with comments »