Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(1)

Issue 878723002: Upgrade ICU to 54.1 (Closed)

Created:
5 years, 11 months ago by jungshik at Google
Modified:
5 years, 10 months ago
CC:
chromium-reviews
Base URL:
https://chromium.googlesource.com/chromium/src.git@master
Target Ref:
refs/pending/heads/master
Project:
chromium
Visibility:
Public.

Description

Upgrade ICU to 54.1 ICU 54.1 comes with CLDR 26 locale data along with Lao and Khmer dictionaries for line/word breaking, new interval/duration formatting support, display context support for date-time and lang/region display name and many more. To better support regional variants such as en-{CA,AU}, fr-CA, es-*, and de-CH, the locale data for those variants are included. The ICU data file (icudtl.dat) for non-Android platform is 256,960 bytes smaller than before. On Android, it's 232,240 bytes larger because the currency display name data was added for EcmaScript I18N API. On Linux/Mac/Android/iOS, base::TestSuites initializer now sets the ICU locale explicitly to en_US if the default locale is a POSIX locale that is not supported because I got rid of word_POSIX to save about 100kB. Moreover, virtually none of our users uses a POSIX locale so that testing on POSIX locale is not realistic. en_GB time formatting changed in ICU 54.1/CLDR 26 and the expected results are updated. Noto to Sheriff: The above data size changes (reduction or increase) may require the expected size adjustment. See https://codereview.chromium.org/403723003 for a similar change. BUG=428145 TEST=All tests on all platforms including but not limited to 1. Blink: layout tests and webkit_unittests 1. base_unittests: Break*, *onvers*, *Format*, *CU*, RTL*, *Search* 2. browser_tests: *ncoding*, *UILanguage* (CrOS) 3. sql_unittests 4. gfx_unittests: RenderText* 5. components_unittests: Query*, *ookmark* 6. net_unittests: Net**IDN*, URL* 7. url_unittests 8. ui_base_unittests Committed: https://crrev.com/8fe2fe9afd2d94f6cd814cd55900460ad11da26a Cr-Commit-Position: refs/heads/master@{#317210}

Patch Set 1 #

Patch Set 2 : add BUILD.gn and roll icu to the latest revision #

Patch Set 3 : update the expected results for time format in en-GB #

Patch Set 4 : rebase #

Patch Set 5 : fix sql/gfx/component*tests on Mac #

Patch Set 6 : overrides posix locale on all platforms #

Patch Set 7 : posix locale overide: only on Mac/Linux. iOS can't find ICU header uenum.h #

Patch Set 8 : exclude IOS from icu locale set codepath #

Patch Set 9 : suppress regional variants for now (cros browsertest) #

Patch Set 10 : add back POSIX locale override on iOS #

Patch Set 11 : style fix #

Patch Set 12 : almost back to ps 6 for posix loale check/override #

Patch Set 13 : set icu locale to en_US unconditionally on iOS test #

Patch Set 14 : windows link fix for icuuc #

Patch Set 15 : fix ios link issue (icudata type is now none) #

Patch Set 16 : fix en_GB lang display name #

Patch Set 17 : add en-GB display name test #

Unified diffs Side-by-side diffs Delta from patch set Stats (+83 lines, -25 lines) Patch
M DEPS View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 1 chunk +1 line, -1 line 0 comments Download
M base/i18n/break_iterator.cc View 1 2 3 4 1 chunk +2 lines, -1 line 0 comments Download
M base/i18n/time_formatting_unittest.cc View 1 2 3 1 chunk +3 lines, -3 lines 0 comments Download
M base/test/test_suite.cc View 1 2 3 4 5 6 7 8 9 10 11 12 2 chunks +24 lines, -0 lines 0 comments Download
M build/secondary/third_party/icu/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 17 chunks +42 lines, -12 lines 0 comments Download
M ui/base/l10n/l10n_util.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 3 chunks +5 lines, -8 lines 0 comments Download
M ui/base/l10n/l10n_util_unittest.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 chunk +6 lines, -0 lines 0 comments Download

Messages

Total messages: 39 (16 generated)
jungshik at Google
Mark and Brett, can you take a look? Thanks !
5 years, 10 months ago (2015-02-10 23:18:05 UTC) #2
Mark Mentovai
LGTM
5 years, 10 months ago (2015-02-10 23:20:44 UTC) #3
brettw
lgtm
5 years, 10 months ago (2015-02-10 23:31:55 UTC) #4
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/878723002/100001
5 years, 10 months ago (2015-02-11 05:26:21 UTC) #8
commit-bot: I haz the power
Try jobs failed on following builders: ios_rel_device_ng on tryserver.chromium.mac (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.mac/builders/ios_rel_device_ng/builds/9620)
5 years, 10 months ago (2015-02-11 05:34:23 UTC) #10
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/878723002/120001
5 years, 10 months ago (2015-02-11 07:15:37 UTC) #13
commit-bot: I haz the power
Try jobs failed on following builders: ios_dbg_simulator on tryserver.chromium.mac (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.mac/builders/ios_dbg_simulator/builds/57623)
5 years, 10 months ago (2015-02-11 07:24:26 UTC) #15
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/878723002/140001
5 years, 10 months ago (2015-02-11 07:32:42 UTC) #17
commit-bot: I haz the power
Try jobs failed on following builders: ios_dbg_simulator on tryserver.chromium.mac (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.mac/builders/ios_dbg_simulator/builds/57626)
5 years, 10 months ago (2015-02-11 07:56:56 UTC) #19
jungshik at Google
Thank you for LGTM. There are three issues that either I overlooked or haven't seen ...
5 years, 10 months ago (2015-02-11 10:29:53 UTC) #20
jungshik at Google
The WIndows link issue for icuuc is fixed by https://codereview.chromium.org/926113004/. The iOS issue (not finding ...
5 years, 10 months ago (2015-02-14 01:16:44 UTC) #21
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/878723002/320001
5 years, 10 months ago (2015-02-19 20:54:39 UTC) #23
commit-bot: I haz the power
Try jobs failed on following builders: win_chromium_x64_rel_ng on tryserver.chromium.win (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.win/builders/win_chromium_x64_rel_ng/builds/28287)
5 years, 10 months ago (2015-02-19 21:45:18 UTC) #25
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/878723002/320001
5 years, 10 months ago (2015-02-19 22:01:02 UTC) #27
jungshik at Google
Note to myself: If perf-bot complains about the size reduction on non-Android pplatforms, a CL ...
5 years, 10 months ago (2015-02-19 23:41:04 UTC) #28
commit-bot: I haz the power
Try jobs failed on following builders: win_chromium_x64_rel_ng on tryserver.chromium.win (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.win/builders/win_chromium_x64_rel_ng/builds/28321)
5 years, 10 months ago (2015-02-20 00:12:30 UTC) #30
jungshik at Google
On 2015/02/20 00:12:30, I haz the power (commit-bot) wrote: > Try jobs failed on following ...
5 years, 10 months ago (2015-02-20 00:15:45 UTC) #32
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/878723002/320001
5 years, 10 months ago (2015-02-20 00:16:17 UTC) #33
commit-bot: I haz the power
Committed patchset #17 (id:320001)
5 years, 10 months ago (2015-02-20 01:38:08 UTC) #34
commit-bot: I haz the power
Patchset 17 (id:??) landed as https://crrev.com/8fe2fe9afd2d94f6cd814cd55900460ad11da26a Cr-Commit-Position: refs/heads/master@{#317210}
5 years, 10 months ago (2015-02-20 01:39:32 UTC) #35
Jeffrey Yasskin
This appears to have caused data races: http://build.chromium.org/p/chromium.memory.fyi/builders/Linux%20TSan%20Tests/builds/57/steps/unit_tests/logs/stdio. They may be new, or just existing ...
5 years, 10 months ago (2015-02-20 18:47:59 UTC) #37
jungshik at Google
On 2015/02/20 18:47:59, Jeffrey Yasskin wrote: > This appears to have caused data races: > ...
5 years, 10 months ago (2015-02-20 19:54:16 UTC) #38
jungshik at Google
5 years, 10 months ago (2015-02-20 23:05:08 UTC) #39
Message was sent while issue was closed.
On 2015/02/20 19:54:16, Jungshik at google wrote:
> On 2015/02/20 18:47:59, Jeffrey Yasskin wrote:
> > This appears to have caused data races:
> >
>
http://build.chromium.org/p/chromium.memory.fyi/builders/Linux%20TSan%20Tests....
> > They may be new, or just existing ones that don't match their suppressions
> > anymore. Can you investigate?
> 
> Thanks for the alert. I'm looking into it.

It's resolved with updating the suppressor list. I also filed an upstream bug :
http://bugs.icu-project.org/trac/ticket/11538.

Powered by Google App Engine
This is Rietveld 408576698