Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(74)

Issue 2331303002: Use ICU for ID_START and ID_CONTINUE for Unicode 9 data (Closed)

Created:
4 years, 3 months ago by jungshik at Google
Modified:
3 years, 6 months ago
CC:
v8-reviews_googlegroups.com
Target Ref:
refs/heads/master
Project:
v8
Visibility:
Public.

Description

Use ICU for ID_START, ID_CONTINUE and WhiteSpace check Use ICU to check ID_Start, ID_Continue and WhiteSpace even for BMP when V8_INTL_SUPPORT is on (which is default). Change LineTerminator::Is() to check 4 code points from ES#sec-line-terminators instead of using tables and Lookup function. Remove Lowercase::Is(). It's not used anywhere. Update webkit/{ToNumber,parseFloat}.js to have the correct expectation for U+180E and the corresponding expected files. This is a follow-up to an earlier change ( https://codereview.chromium.org/2720953003 ). CQ_INCLUDE_TRYBOTS=master.tryserver.v8:v8_win_dbg,v8_mac_dbg;master.tryserver.chromium.android:android_arm64_dbg_recipe CQ_INCLUDE_TRYBOTS=master.tryserver.v8:v8_linux_noi18n_rel_ng BUG=v8:5370, v8:5155 TEST=unittests --gtest_filter=CharP* TEST=webkit: ToNumber, parseFloat TEST=test262: built-ins/Number/S9.3*, built-ins/parse{Int,Float}/S15* TEST=test262: language/white-space/mong* TEST=test262: built-ins/String/prototype/trim/u180e TEST=mjsunit: whitespaces Review-Url: https://codereview.chromium.org/2331303002 Cr-Commit-Position: refs/heads/master@{#45957} Committed: https://chromium.googlesource.com/v8/v8/+/4aeb94a42d2abe7eb448aa416649ad7be5bdf3bc

Patch Set 1 #

Patch Set 2 : fix a compile error #

Patch Set 3 : fix link error #

Patch Set 4 : fix more functions #

Patch Set 5 : fix unittests #

Patch Set 6 : fix more tests and update test status #

Patch Set 7 : include LineTerminator tables in iI18n build #

Patch Set 8 : fix more U+180E tests #

Patch Set 9 : rebased #

Patch Set 10 : V8_I18N => V8_INTL #

Patch Set 11 : Add tests for Unicode 8/9 #

Patch Set 12 : add a few more tests #

Patch Set 13 : add more test for Unicode 8/9; fix multiline comments #

Patch Set 14 : 1. Remove unused Lowercase::Is and related table 2. LineTerminator : drop the table and use 4 code points check #

Patch Set 15 : Simplify WhiteSpaceOrLineTerminator::Is #

Patch Set 16 : Do not mark U+180E-related tests as failing with no_i18n #

Patch Set 17 : Speculative fix for linux bot failure #

Patch Set 18 : undo the speculative fix to see if it's really necessary #

Total comments: 1

Patch Set 19 : fix a typo #

Patch Set 20 : rebased #

Patch Set 21 : Refers to PropList.txt for Other_ID_{Start,Continue} #

Total comments: 14

Patch Set 22 : review comments addressed #

Total comments: 1

Patch Set 23 : fix a typo in unicode.h #

Patch Set 24 : drop an unnecessary todo #

Unified diffs Side-by-side diffs Delta from patch set Stats (+171 lines, -280 lines) Patch
M BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 1 chunk +1 line, -0 lines 0 comments Download
M src/char-predicates.h View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 1 chunk +27 lines, -22 lines 0 comments Download
M src/char-predicates.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 1 chunk +26 lines, -24 lines 0 comments Download
M src/unicode.h View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 2 chunks +2 lines, -3 lines 0 comments Download
M src/unicode.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 11 chunks +26 lines, -217 lines 0 comments Download
M src/v8.gyp View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 1 chunk +1 line, -0 lines 0 comments Download
M test/unittests/char-predicates-unittest.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 5 chunks +80 lines, -6 lines 0 comments Download
M test/webkit/ToNumber.js View 1 2 3 4 5 6 7 3 chunks +3 lines, -3 lines 0 comments Download
M test/webkit/ToNumber-expected.txt View 1 2 3 4 5 6 7 8 3 chunks +3 lines, -3 lines 0 comments Download
M test/webkit/parseFloat.js View 1 2 3 4 5 1 chunk +1 line, -1 line 0 comments Download
M test/webkit/parseFloat-expected.txt View 1 2 3 4 5 6 7 8 1 chunk +1 line, -1 line 0 comments Download

Messages

Total messages: 100 (84 generated)
jungshik at Google
Yang and Adam, PTAL Thanks Once icu_case_mapping flag is removed (which is already shipped), case-conversion-related ...
3 years, 7 months ago (2017-05-07 15:43:27 UTC) #52
jungshik at Google
3 years, 7 months ago (2017-05-08 17:15:31 UTC) #66
mathias
https://codereview.chromium.org/2331303002/diff/340001/src/char-predicates.h File src/char-predicates.h (right): https://codereview.chromium.org/2331303002/diff/340001/src/char-predicates.h#newcode39 src/char-predicates.h:39: // Non-BMP charaacters are not supported without I18N. typo: ...
3 years, 7 months ago (2017-05-08 20:43:06 UTC) #68
jungshik at Google
On 2017/05/08 20:43:06, mathias wrote: > https://codereview.chromium.org/2331303002/diff/340001/src/char-predicates.h > File src/char-predicates.h (right): > > https://codereview.chromium.org/2331303002/diff/340001/src/char-predicates.h#newcode39 > ...
3 years, 7 months ago (2017-05-08 23:15:43 UTC) #69
jungshik at Google
Ping, Dan, Adam and Yang :-) Thanks
3 years, 6 months ago (2017-06-06 20:36:33 UTC) #70
adamk
I'd feel most comfortable with Dan reviewing this. But Dan, let me know if you ...
3 years, 6 months ago (2017-06-08 19:55:39 UTC) #75
Dan Ehrenberg
On 2017/06/08 19:55:39, adamk wrote: > I'd feel most comfortable with Dan reviewing this. But ...
3 years, 6 months ago (2017-06-08 21:19:09 UTC) #76
Dan Ehrenberg
Patch seems good to me, modulo stylistic suggestions below. Did you notice any performance change ...
3 years, 6 months ago (2017-06-10 06:00:12 UTC) #77
jungshik at Google
> E.g., Octane CodeLoad stresses parsing and may change performance with this patch. Because the ...
3 years, 6 months ago (2017-06-13 09:37:30 UTC) #81
Dan Ehrenberg
On 2017/06/13 09:37:30, jungshik at Google wrote: > > E.g., Octane CodeLoad stresses parsing and ...
3 years, 6 months ago (2017-06-13 10:18:36 UTC) #84
jungshik at Google
On 2017/06/13 10:18:36, Dan Ehrenberg wrote: > On 2017/06/13 09:37:30, jungshik at Google wrote: > ...
3 years, 6 months ago (2017-06-13 18:55:54 UTC) #87
Dan Ehrenberg
On 2017/06/13 18:55:54, jungshik at Google wrote: > On 2017/06/13 10:18:36, Dan Ehrenberg wrote: > ...
3 years, 6 months ago (2017-06-13 19:12:33 UTC) #88
Dan Ehrenberg
https://codereview.chromium.org/2331303002/diff/420001/src/unicode.h File src/unicode.h (right): https://codereview.chromium.org/2331303002/diff/420001/src/unicode.h#newcode186 src/unicode.h:186: #ifndef V8_INTL_START V8_INTL_SUPPORT?
3 years, 6 months ago (2017-06-14 08:22:26 UTC) #89
jungshik at Google
On 2017/06/14 08:22:26, Dan Ehrenberg wrote: > https://codereview.chromium.org/2331303002/diff/420001/src/unicode.h > File src/unicode.h (right): > > https://codereview.chromium.org/2331303002/diff/420001/src/unicode.h#newcode186 ...
3 years, 6 months ago (2017-06-14 17:43:25 UTC) #92
commit-bot: I haz the power
CQ is trying da patch. Follow status at: https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.org/2331303002/460001
3 years, 6 months ago (2017-06-14 19:31:16 UTC) #97
commit-bot: I haz the power
3 years, 6 months ago (2017-06-14 20:33:04 UTC) #100
Message was sent while issue was closed.
Committed patchset #24 (id:460001) as
https://chromium.googlesource.com/v8/v8/+/4aeb94a42d2abe7eb448aa416649ad7be5b...

Powered by Google App Engine
This is Rietveld 408576698