Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(879)

Issue 1416133003: Crashpad Windows: Use the Crashpad client instead of Breakpad on Windows (Closed)

Created:
5 years, 2 months ago by scottmg
Modified:
5 years ago
CC:
chromium-reviews, darin-cc_chromium.org, jam, sadrul, kalyank
Base URL:
https://chromium.googlesource.com/chromium/src.git@master
Target Ref:
refs/pending/heads/master
Project:
chromium
Visibility:
Public.

Description

Crashpad Windows: Use the Crashpad client instead of Breakpad on Windows Crashpad is always compiled into chrome and its handler is always enabled. It only uploads in Official builds. On Windows, the crash handler is chrome.exe run with a --crashpad-handler argument. This is due to concern about incompatibilities of shipping an additional new different binary for AV, firewalls, etc. Sample renderer crash/1aed2bc785e28995 Sample browser: crash/66c822815474a5d8 See also http://crbug.com/427611 . R=mark@chromium.org,cpu@chromium.org BUG=447073, 546288, 456193 Committed: https://crrev.com/aaa2ff656f9fcabcbdd9e9964e3b2bdc8f5102ed Cr-Commit-Position: refs/heads/master@{#361742}

Patch Set 1 #

Patch Set 2 : working on renderers #

Patch Set 3 : . #

Patch Set 4 : update to latest crashpad #

Patch Set 5 : . #

Patch Set 6 : . #

Total comments: 9

Patch Set 7 : deps and CrashForException #

Patch Set 8 : commandline and rebase #

Total comments: 14

Patch Set 9 : fixes #

Total comments: 60

Patch Set 10 : rebase #

Patch Set 11 : wip #

Patch Set 12 : . #

Patch Set 13 : move to dll #

Patch Set 14 : fixes #

Patch Set 15 : non-component #

Patch Set 16 : rebase #

Patch Set 17 : mac #

Patch Set 18 : mac and linux #

Patch Set 19 : breakpad #

Patch Set 20 : more #

Patch Set 21 : more gn #

Patch Set 22 : more build #

Patch Set 23 : gn linux #

Patch Set 24 : gn android #

Patch Set 25 : interactive ui tests #

Patch Set 26 : more linux gn #

Patch Set 27 : win64 #

Patch Set 28 : win gn check #

Patch Set 29 : test binaries #

Patch Set 30 : gn win getopt secondary, sigh #

Patch Set 31 : gn mach files #

Patch Set 32 : crashpad deps #

Patch Set 33 : build/secondary gn for deps roll #

Patch Set 34 : #include <algorithm> #

Patch Set 35 : gn secondary, mac .S not on windows #

Total comments: 30

Patch Set 36 : fixes #

Patch Set 37 : breakpad gn build 9_9, interactive_ui_tests isolate, roll deps again #

Patch Set 38 : gn check #

Patch Set 39 : isolate, gn check #

Patch Set 40 : more gn secondary updates for i_u_t #

Patch Set 41 : fixes #

Total comments: 8

Patch Set 42 : ppapi-path #

Total comments: 2

Patch Set 43 : no plugin-path, gn build child component #

Patch Set 44 : rebase #

Patch Set 45 : gn missing browser_watcher_client dep now #

Patch Set 46 : gn more deps added to watcher #

Patch Set 47 : deps roll #

Patch Set 48 : add some stub gn files #

Unified diffs Side-by-side diffs Delta from patch set Stats (+981 lines, -707 lines) Patch
M DEPS View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 1 chunk +1 line, -1 line 0 comments Download
M build/secondary/third_party/crashpad/crashpad/client/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 2 chunks +7 lines, -2 lines 0 comments Download
A build/secondary/third_party/crashpad/crashpad/handler/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 1 chunk +46 lines, -0 lines 0 comments Download
A build/secondary/third_party/crashpad/crashpad/minidump/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 1 chunk +65 lines, -0 lines 0 comments Download
A build/secondary/third_party/crashpad/crashpad/snapshot/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 1 chunk +102 lines, -0 lines 0 comments Download
M build/secondary/third_party/crashpad/crashpad/third_party/getopt/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 1 chunk +1 line, -1 line 0 comments Download
A build/secondary/third_party/crashpad/crashpad/tools/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 1 chunk +20 lines, -0 lines 0 comments Download
M build/secondary/third_party/crashpad/crashpad/util/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 6 chunks +49 lines, -33 lines 0 comments Download
M chrome/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 3 chunks +5 lines, -0 lines 0 comments Download
M chrome/app/DEPS View 1 2 8 9 1 chunk +1 line, -0 lines 0 comments Download
M chrome/app/chrome_crash_reporter_client.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 1 chunk +0 lines, -10 lines 0 comments Download
M chrome/app/chrome_exe_main_win.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 5 chunks +38 lines, -1 line 0 comments Download
M chrome/app/chrome_main_delegate.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 9 chunks +16 lines, -6 lines 0 comments Download
M chrome/app/main_dll_loader_win.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 8 chunks +10 lines, -29 lines 0 comments Download
M chrome/browser/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 1 chunk +1 line, -1 line 0 comments Download
M chrome/browser/chrome_browser_main_mac.mm View 1 chunk +1 line, -1 line 0 comments Download
M chrome/browser/crash_upload_list.cc View 1 2 3 4 5 6 7 8 9 10 2 chunks +5 lines, -10 lines 0 comments Download
A + chrome/browser/crash_upload_list_crashpad.h View 1 2 3 4 5 6 7 8 9 10 2 chunks +7 lines, -7 lines 0 comments Download
A + chrome/browser/crash_upload_list_crashpad.cc View 1 2 3 4 5 6 7 8 9 10 2 chunks +7 lines, -10 lines 0 comments Download
D chrome/browser/crash_upload_list_mac.h View 1 2 3 4 5 6 7 8 9 10 1 chunk +0 lines, -37 lines 0 comments Download
M chrome/browser/crash_upload_list_mac.cc View 1 2 3 4 5 6 7 8 9 10 1 chunk +0 lines, -34 lines 0 comments Download
D chrome/browser/crash_upload_list_win.h View 1 2 3 4 5 6 7 8 9 10 1 chunk +0 lines, -41 lines 0 comments Download
D chrome/browser/crash_upload_list_win.cc View 1 2 3 4 5 6 7 8 9 10 1 chunk +0 lines, -88 lines 0 comments Download
M chrome/browser/google/google_update_settings_posix.cc View 1 chunk +1 line, -1 line 0 comments Download
M chrome/chrome_browser.gypi View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 2 chunks +2 lines, -4 lines 0 comments Download
M chrome/chrome_dll.gypi View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 5 chunks +13 lines, -0 lines 0 comments Download
M chrome/chrome_exe.gypi View 1 2 3 4 5 6 7 8 9 10 11 12 2 chunks +1 line, -2 lines 0 comments Download
M chrome/chrome_installer.gypi View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 1 chunk +1 line, -1 line 0 comments Download
M chrome/chrome_tests_unit.gypi View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 1 chunk +7 lines, -7 lines 0 comments Download
M chrome/common/child_process_logging_win.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 1 chunk +0 lines, -50 lines 0 comments Download
M chrome/common/chrome_paths.cc View 1 2 3 4 5 6 7 8 9 1 chunk +1 line, -1 line 0 comments Download
M chrome/common/chrome_switches.h View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 1 chunk +1 line, -0 lines 0 comments Download
M chrome/common/chrome_switches.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 1 chunk +8 lines, -0 lines 0 comments Download
M chrome/common/crash_keys.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 1 chunk +1 line, -1 line 0 comments Download
M chrome/installer/setup/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 1 chunk +1 line, -0 lines 0 comments Download
M chrome/interactive_ui_tests.isolate View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 1 chunk +1 line, -0 lines 0 comments Download
M components/crash.gypi View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 7 chunks +48 lines, -34 lines 0 comments Download
M components/crash/content/app/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 5 chunks +26 lines, -14 lines 0 comments Download
A + components/crash/content/app/crashpad.h View 1 2 3 4 5 6 7 8 9 10 11 3 chunks +22 lines, -11 lines 0 comments Download
A components/crash/content/app/crashpad.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 1 chunk +236 lines, -0 lines 0 comments Download
D components/crash/content/app/crashpad_mac.h View 1 chunk +0 lines, -73 lines 0 comments Download
M components/crash/content/app/crashpad_mac.mm View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 5 chunks +7 lines, -188 lines 0 comments Download
A components/crash/content/app/crashpad_win.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 1 chunk +202 lines, -0 lines 0 comments Download
M components/crash/content/browser/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 1 chunk +1 line, -1 line 0 comments Download
M components/crash/core/common/crash_keys.h View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 1 chunk +6 lines, -3 lines 0 comments Download
M components/crash/core/common/crash_keys.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 3 chunks +10 lines, -2 lines 0 comments Download
M content/content_shell.gypi View 1 2 3 4 5 6 7 8 9 10 1 chunk +1 line, -1 line 0 comments Download
M content/ppapi_plugin/ppapi_plugin_main.cc View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 1 chunk +1 line, -0 lines 0 comments Download
M content/shell/BUILD.gn View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 1 chunk +1 line, -1 line 0 comments Download

Messages

Total messages: 58 (26 generated)
cpu_(ooo_6.6-7.5)
https://codereview.chromium.org/1416133003/diff/280001/build/filename_rules.gypi File build/filename_rules.gypi (right): https://codereview.chromium.org/1416133003/diff/280001/build/filename_rules.gypi#newcode19 build/filename_rules.gypi:19: }], you can probably push this change now outside ...
5 years, 1 month ago (2015-11-06 23:16:48 UTC) #15
scottmg
Thanks for taking a look. I'm not overly confident that I'm emulating all of the ...
5 years, 1 month ago (2015-11-07 00:39:43 UTC) #16
cpu_(ooo_6.6-7.5)
looks great, a few comments https://codereview.chromium.org/1416133003/diff/120002/chrome/app/chrome_exe_main_win.cc File chrome/app/chrome_exe_main_win.cc (right): https://codereview.chromium.org/1416133003/diff/120002/chrome/app/chrome_exe_main_win.cc#newcode157 chrome/app/chrome_exe_main_win.cc:157: base::CommandLine::Init(0, NULL); lets move ...
5 years, 1 month ago (2015-11-07 01:53:18 UTC) #17
scottmg
Thanks https://codereview.chromium.org/1416133003/diff/120002/chrome/app/chrome_exe_main_win.cc File chrome/app/chrome_exe_main_win.cc (right): https://codereview.chromium.org/1416133003/diff/120002/chrome/app/chrome_exe_main_win.cc#newcode157 chrome/app/chrome_exe_main_win.cc:157: base::CommandLine::Init(0, NULL); On 2015/11/07 01:53:17, cpu wrote: > ...
5 years, 1 month ago (2015-11-09 18:29:56 UTC) #18
Mark Mentovai
https://codereview.chromium.org/1416133003/diff/120002/components/crash/content/app/crashpad.cc File components/crash/content/app/crashpad.cc (right): https://codereview.chromium.org/1416133003/diff/120002/components/crash/content/app/crashpad.cc#newcode133 components/crash/content/app/crashpad.cc:133: } scottmg wrote: > On 2015/11/07 01:53:18, cpu wrote: ...
5 years, 1 month ago (2015-11-09 18:40:20 UTC) #19
scottmg
https://codereview.chromium.org/1416133003/diff/120002/components/crash/content/app/crashpad.cc File components/crash/content/app/crashpad.cc (right): https://codereview.chromium.org/1416133003/diff/120002/components/crash/content/app/crashpad.cc#newcode133 components/crash/content/app/crashpad.cc:133: } On 2015/11/09 18:40:20, Mark Mentovai wrote: > scottmg ...
5 years, 1 month ago (2015-11-09 18:58:47 UTC) #20
Mark Mentovai
Oh, in that case, ha!
5 years, 1 month ago (2015-11-09 19:01:58 UTC) #21
cpu_(ooo_6.6-7.5)
lgtm sans the IsMetroProcess() question. https://codereview.chromium.org/1416133003/diff/350001/chrome/app/main_dll_loader_win.cc File chrome/app/main_dll_loader_win.cc (left): https://codereview.chromium.org/1416133003/diff/350001/chrome/app/main_dll_loader_win.cc#oldcode237 chrome/app/main_dll_loader_win.cc:237: if (base::win::GetVersion() >= base::win::VERSION_WIN10) ...
5 years, 1 month ago (2015-11-10 03:06:51 UTC) #22
Mark Mentovai
https://codereview.chromium.org/1416133003/diff/350001/DEPS File DEPS (right): https://codereview.chromium.org/1416133003/diff/350001/DEPS#newcode130 DEPS:130: Var('chromium_git') + '/crashpad/crashpad.git' + '@' + '9e4cd8f07b107edf9cbba5c5760967d5aeb8e2bd', Good for ...
5 years, 1 month ago (2015-11-10 17:21:18 UTC) #23
scottmg
Sorry for the very slow turnaround on this, a bunch of (unrelated) things have come ...
5 years, 1 month ago (2015-11-16 21:48:40 UTC) #24
Mark Mentovai
No new review yet, just responding to stuff. scottmg wrote: > Sorry for the very ...
5 years, 1 month ago (2015-11-16 22:11:13 UTC) #25
Mark Mentovai
I wrote: > Yeah, I don’t know if it can be made to work without ...
5 years, 1 month ago (2015-11-17 17:10:42 UTC) #27
scottmg
OK, I think ready for another look after a bunch of mucking around with build ...
5 years, 1 month ago (2015-11-19 01:25:41 UTC) #31
scottmg
[[Looks like we have a couple problems semi-unrelated to this CL: - GN isn't handling ...
5 years, 1 month ago (2015-11-19 17:39:33 UTC) #32
Mark Mentovai
You fixed the CreateProcess() thing so I guess now we’re just down to the gn ...
5 years, 1 month ago (2015-11-19 22:21:38 UTC) #33
scottmg
Thanks. (Bots should all be green now, at long last.) https://codereview.chromium.org/1416133003/diff/910001/build/secondary/third_party/crashpad/crashpad/client/BUILD.gn File build/secondary/third_party/crashpad/crashpad/client/BUILD.gn (right): https://codereview.chromium.org/1416133003/diff/910001/build/secondary/third_party/crashpad/crashpad/client/BUILD.gn#newcode32 ...
5 years, 1 month ago (2015-11-20 19:52:48 UTC) #34
Mark Mentovai
https://codereview.chromium.org/1416133003/diff/910001/components/crash/content/app/crashpad_win.cc File components/crash/content/app/crashpad_win.cc (right): https://codereview.chromium.org/1416133003/diff/910001/components/crash/content/app/crashpad_win.cc#newcode83 components/crash/content/app/crashpad_win.cc:83: DCHECK(!env->HasVar(kPipeNameVar)); scottmg wrote: > I guess if it's set, ...
5 years, 1 month ago (2015-11-20 20:00:23 UTC) #35
scottmg
Thanks. (Requires https://codereview.chromium.org/1470483002/ for x86 GN, sigh.) https://codereview.chromium.org/1416133003/diff/910001/components/crash/content/app/crashpad_win.cc File components/crash/content/app/crashpad_win.cc (right): https://codereview.chromium.org/1416133003/diff/910001/components/crash/content/app/crashpad_win.cc#newcode83 components/crash/content/app/crashpad_win.cc:83: DCHECK(!env->HasVar(kPipeNameVar)); On ...
5 years, 1 month ago (2015-11-20 21:30:10 UTC) #36
Mark Mentovai
scottmg wrote: > Thanks. > > (Requires https://codereview.chromium.org/1470483002/ for x86 GN, sigh.) If that’s all ...
5 years, 1 month ago (2015-11-20 21:34:03 UTC) #37
scottmg
On 2015/11/20 21:34:03, Mark Mentovai wrote: > scottmg wrote: > > Thanks. > > > ...
5 years, 1 month ago (2015-11-20 21:37:54 UTC) #38
Mark Mentovai
LGTM!! Awesome job. https://codereview.chromium.org/1416133003/diff/1030001/DEPS File DEPS (right): https://codereview.chromium.org/1416133003/diff/1030001/DEPS#newcode1 DEPS:1: # This file is used to ...
5 years, 1 month ago (2015-11-20 22:35:56 UTC) #39
scottmg
Thanks. I'm going to hold off on landing for the moment -- I just realized ...
5 years, 1 month ago (2015-11-21 03:16:59 UTC) #40
Mark Mentovai
LGTM still. Hopefully there won’t be too many re-lands, but I’m betting on there at ...
5 years, 1 month ago (2015-11-21 14:53:07 UTC) #41
scottmg
In a static library build, the minidumps are ~300k smaller which seems to be below ...
5 years ago (2015-11-24 19:04:25 UTC) #43
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1416133003/1160001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1416133003/1160001
5 years ago (2015-11-25 18:02:55 UTC) #46
commit-bot: I haz the power
Committed patchset #48 (id:1160001)
5 years ago (2015-11-25 21:55:55 UTC) #48
commit-bot: I haz the power
Patchset 48 (id:??) landed as https://crrev.com/aaa2ff656f9fcabcbdd9e9964e3b2bdc8f5102ed Cr-Commit-Position: refs/heads/master@{#361742}
5 years ago (2015-11-25 21:57:20 UTC) #50
raymes
A revert of this CL (patchset #48 id:1160001) has been created in https://codereview.chromium.org/1475213004/ by raymes@chromium.org. ...
5 years ago (2015-11-25 23:24:06 UTC) #51
hans
This broke the Clang build on Windows. I've uploaded a fix here: https://codereview.chromium.org/1473073008/ It would ...
5 years ago (2015-11-26 01:52:38 UTC) #52
scottmg
On 2015/11/26 01:52:38, hans wrote: > This broke the Clang build on Windows. I've uploaded ...
5 years ago (2015-11-26 02:22:22 UTC) #53
scottmg
A revert of this CL (patchset #48 id:1160001) has been created in https://codereview.chromium.org/1476193002/ by scottmg@chromium.org. ...
5 years ago (2015-11-26 02:23:15 UTC) #54
scottmg
5 years ago (2015-11-26 02:42:24 UTC) #56
On 2015/11/26 02:23:15, scottmg wrote:
> A revert of this CL (patchset #48 id:1160001) has been created in
> https://codereview.chromium.org/1476193002/ by mailto:scottmg@chromium.org.
> 
> The reason for reverting is: Some failing tests
>
https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20%28dbg%29%2....
> Unclear why they didn't fail on trybots so I'm going to revert and
investigate..

Ah, I'm guess it's because they're dbg only failures. I thought there was one of
those in the default tryjob set, but I guess only on the waterfall.

Powered by Google App Engine
This is Rietveld 408576698