Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(104)

Issue 2289343002: GN: add sanitize arg (Closed)

Created:
4 years, 3 months ago by mtklein_C
Modified:
4 years, 3 months ago
Reviewers:
jcgregorio, borenet, mtklein
CC:
reviews_skia.org
Target Ref:
refs/heads/master
Project:
skia
Visibility:
Public.

Description

GN: add sanitize arg Attempt to take over all *SAN builds. MSAN has a lot of coordination required between gn/BUILD.gn and gn_flavor.py. I'd like to follow up to move more of this into gn/BUILD.gn, to make it easier to use locally. The compile steps should be much faster now. We no longer build CMake and Clang for every run, instead using the clang_linux CIPD package. This removes the need for all the third_party/externals/llvm/... dependencies. Similarly, since we're using the clang_linux package, we no longer depend on Chrome's Clang, and thus no longer need to sync chromium on these bots. Instead of packaging up MSAN libraries and llvm-symbolizer in the compile output, I have the test / perf bots also depend on the clang_linux package. These do not vary from build to build. No more need for the xsan.blacklist -include hack: Clang, GN, and Ninja all track changes to xsan.blacklist without our help. This has the incidental effect of upgrading the compiler used by *SAN bots from Clang 3.8 to Clang 3.9. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2289343002 Committed: https://skia.googlesource.com/skia/+/2b3c2a3ff9166e92ca1700e695c30ae729a3f10c

Patch Set 1 #

Patch Set 2 : undo #

Patch Set 3 : prettier #

Patch Set 4 : take over ASAN,TSAN #

Patch Set 5 : clearer #

Patch Set 6 : rebase #

Patch Set 7 : rebase #

Patch Set 8 : try * #

Patch Set 9 : include hack not needed #

Patch Set 10 : misc #

Patch Set 11 : ubsan options #

Patch Set 12 : depend on clang_linux on SAN testers #

Patch Set 13 : ninja -v #

Patch Set 14 : no need for chromium #

Patch Set 15 : consistent #

Patch Set 16 : flail #

Patch Set 17 : overkill #

Patch Set 18 : one last try #

Patch Set 19 : burned by ccache? #

Patch Set 20 : rebase #

Patch Set 21 : move around sanitize #

Patch Set 22 : rebase #

Patch Set 23 : optimism #

Patch Set 24 : rebase #

Patch Set 25 : update comment #

Patch Set 26 : defaults #

Patch Set 27 : -Lclang_linux/msan #

Patch Set 28 : disable fontconfig #

Patch Set 29 : no -v, more precise env #

Patch Set 30 : rebase #

Total comments: 4
Unified diffs Side-by-side diffs Delta from patch set Stats (+223 lines, -284 lines) Patch
M DEPS View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 1 chunk +1 line, -8 lines 1 comment Download
M gn/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 4 chunks +31 lines, -2 lines 0 comments Download
M gn/BUILDCONFIG.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 1 chunk +1 line, -0 lines 0 comments Download
M infra/bots/recipe_modules/flavor/api.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 3 chunks +0 lines, -9 lines 0 comments Download
M infra/bots/recipe_modules/flavor/gn_flavor.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 4 chunks +41 lines, -7 lines 3 comments Download
D infra/bots/recipe_modules/flavor/xsan_flavor.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 1 chunk +0 lines, -68 lines 0 comments Download
M infra/bots/recipe_modules/vars/api.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 1 chunk +5 lines, -7 lines 0 comments Download
M infra/bots/recipes/swarm_compile.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 1 chunk +1 line, -0 lines 0 comments Download
A + infra/bots/recipes/swarm_compile.expected/Build-Ubuntu-Clang-x86_64-Debug-ASAN.json View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 5 chunks +41 lines, -6 lines 0 comments Download
M infra/bots/recipes/swarm_compile.expected/Build-Ubuntu-GCC-x86_64-Debug-MSAN.json View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 5 chunks +51 lines, -53 lines 0 comments Download
M infra/bots/recipes/swarm_perf.py View 1 2 3 4 5 6 7 8 9 1 chunk +4 lines, -3 lines 0 comments Download
M infra/bots/recipes/swarm_perf.expected/Perf-Mac-Clang-MacMini6.2-CPU-AVX-x86_64-Release-GN.json View 1 2 3 4 5 6 2 chunks +1 line, -6 lines 0 comments Download
A + infra/bots/recipes/swarm_perf.expected/Perf-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Release-GN.json View 1 2 3 4 5 6 7 8 9 6 chunks +8 lines, -14 lines 0 comments Download
M infra/bots/recipes/swarm_test.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 1 chunk +1 line, -0 lines 0 comments Download
A + infra/bots/recipes/swarm_test.expected/Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug-ASAN.json View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 3 chunks +6 lines, -11 lines 0 comments Download
M infra/bots/recipes/swarm_test.expected/Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Debug-MSAN.json View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 1 chunk +3 lines, -7 lines 0 comments Download
M infra/bots/recipes/swarm_test.expected/Test-Ubuntu-GCC-GCE-CPU-AVX2-x86_64-Release-TSAN.json View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 1 chunk +2 lines, -7 lines 0 comments Download
M infra/bots/recipes/swarm_trigger.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 2 chunks +11 lines, -6 lines 0 comments Download
M infra/bots/recipes/swarm_trigger.expected/Test-Ubuntu-Clang-GCE-CPU-AVX2-x86_64-Debug-MSAN.json View 1 2 3 4 5 6 7 8 9 10 11 2 chunks +12 lines, -0 lines 0 comments Download
M third_party/freetype2/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 1 chunk +2 lines, -1 line 0 comments Download
M tools/xsan.blacklist View 1 2 3 4 5 6 7 8 17 18 1 chunk +1 line, -11 lines 0 comments Download
D tools/xsan_build View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 1 chunk +0 lines, -58 lines 0 comments Download

Messages

Total messages: 26 (18 generated)
mtklein_C
PS 29 has a bunch of passing trybot runs, and I'm running them again on ...
4 years, 3 months ago (2016-09-08 13:58:25 UTC) #7
jcgregorio
On 2016/09/08 at 13:58:25, mtklein wrote: > PS 29 has a bunch of passing trybot ...
4 years, 3 months ago (2016-09-08 14:46:54 UTC) #17
borenet
Looks mostly good but can't really speak to the GN config stuff. https://codereview.chromium.org/2289343002/diff/570001/DEPS File DEPS ...
4 years, 3 months ago (2016-09-08 14:47:33 UTC) #18
mtklein
https://codereview.chromium.org/2289343002/diff/570001/infra/bots/recipe_modules/flavor/gn_flavor.py File infra/bots/recipe_modules/flavor/gn_flavor.py (right): https://codereview.chromium.org/2289343002/diff/570001/infra/bots/recipe_modules/flavor/gn_flavor.py#newcode32 infra/bots/recipe_modules/flavor/gn_flavor.py:32: clang_linux = str(self.m.vars.slave_dir.join('clang_linux')) On 2016/09/08 14:47:33, borenet wrote: > ...
4 years, 3 months ago (2016-09-08 14:51:11 UTC) #20
borenet
Recipes LGTM https://codereview.chromium.org/2289343002/diff/570001/infra/bots/recipe_modules/flavor/gn_flavor.py File infra/bots/recipe_modules/flavor/gn_flavor.py (right): https://codereview.chromium.org/2289343002/diff/570001/infra/bots/recipe_modules/flavor/gn_flavor.py#newcode32 infra/bots/recipe_modules/flavor/gn_flavor.py:32: clang_linux = str(self.m.vars.slave_dir.join('clang_linux')) On 2016/09/08 14:51:10, mtklein ...
4 years, 3 months ago (2016-09-08 15:06:39 UTC) #21
mtklein_C
> Ok, I'm not sure that str(pathObj) will resolve the path in the same way ...
4 years, 3 months ago (2016-09-08 15:08:03 UTC) #22
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.org/2289343002/570001
4 years, 3 months ago (2016-09-08 15:08:09 UTC) #24
commit-bot: I haz the power
4 years, 3 months ago (2016-09-08 15:39:37 UTC) #26
Message was sent while issue was closed.
Committed patchset #30 (id:570001) as
https://skia.googlesource.com/skia/+/2b3c2a3ff9166e92ca1700e695c30ae729a3f10c

Powered by Google App Engine
This is Rietveld 408576698