Clean up the browser_tests filter for Site Isolation bots.

Clean up the browser_tests filter for Site Isolation bots.

Previously, the filter disabled 192 tests.  However, lots of these
tests were actually passing with --site-per-process, mostly due to
unnecessarily wide wildcards.  This CL explicitly lists all the actual
failures, and also removes a couple of WebRtc tests which seem to be
passing now.  This brings the number of disabled tests down to 26.

BUG=417518, 603261
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_site_isolation

Committed: https://crrev.com/b1320e8f04eb906f295def43d4cf4894d7bc5b7a
Cr-Commit-Position: refs/heads/master@{#403928}

[alexmos, 2016-07-01 23:05:54]

alexmos@chromium.org changed reviewers:
+ creis@chromium.org

[alexmos, 2016-07-01 23:05:55]

Charlie, can you please take a look?  I ran the try bot three times to make sure
there are no flakes.

Something must have fixed the WebRtc tests, since they all work now.  Tabs2
might be fixed too, as it's passing for me locally, but I'll leave it in for
now, since we have a bug filed for it being flaky specifically on the bots.

[Charlie Reis, 2016-07-01 23:24:34]

This is great!  I'm glad we're down to a manageable number of failures.  LGTM.

Do you want to land this now or after the long weekend, when we can react if one
of the tests fails?

[alexmos, 2016-07-01 23:28:25]

Thanks!

On 2016/07/01 23:24:34, Charlie Reis wrote:
> This is great!  I'm glad we're down to a manageable number of failures.  LGTM.
> 
> Do you want to land this now or after the long weekend, when we can react if
one
> of the tests fails?

Good point - I'll wait until after the long weekend.

[alexmos, 2016-07-06 16:33:44]

The CQ bit was checked by alexmos@chromium.org

[commit-bot: I haz the power, 2016-07-06 16:34:08]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-07-06 16:35:49]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-07-06 16:35:50]

Try jobs failed on following builders:
  ios-device on master.tryserver.chromium.mac (JOB_FAILED,
http://build.chromium.org/p/tryserver.chromium.mac/builders/ios-device/builds...)
  ios-device-gn on master.tryserver.chromium.mac (JOB_FAILED,
http://build.chromium.org/p/tryserver.chromium.mac/builders/ios-device-gn/bui...)
  ios-simulator on master.tryserver.chromium.mac (JOB_FAILED,
http://build.chromium.org/p/tryserver.chromium.mac/builders/ios-simulator/bui...)
  ios-simulator-gn on master.tryserver.chromium.mac (JOB_FAILED,
http://build.chromium.org/p/tryserver.chromium.mac/builders/ios-simulator-gn/...)
  mac_chromium_gyp_rel on master.tryserver.chromium.mac (JOB_FAILED,
http://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_gyp_...)

[alexmos, 2016-07-06 16:45:32]

Description was changed from

==========
Clean up the browser_tests filter for Site Isolation bots.

Previously, the filter disabled 192 tests.  However, lots of these
tests were actually passing with --site-per-process, mostly due to
unnecessarily wide wildcards.  This CL explicitly lists all the actual
failures, and also removes a couple of WebRtc tests which seem to be
passing now.  This brings the number of disabled tests down to 26.

BUG=417518, 603261
==========

to

==========
Clean up the browser_tests filter for Site Isolation bots.

Previously, the filter disabled 192 tests.  However, lots of these
tests were actually passing with --site-per-process, mostly due to
unnecessarily wide wildcards.  This CL explicitly lists all the actual
failures, and also removes a couple of WebRtc tests which seem to be
passing now.  This brings the number of disabled tests down to 26.

BUG=417518, 603261
CQ_INCLUDE_TRYBOTS=linux_site_isolation
==========

[alexmos, 2016-07-06 16:46:47]

The CQ bit was checked by alexmos@chromium.org

[alexmos, 2016-07-06 16:46:47]

The patchset sent to the CQ was uploaded after l-g-t-m from creis@chromium.org
Link to the patchset: https://codereview.chromium.org/2120673002/#ps40001
(title: "Rebase")

[commit-bot: I haz the power, 2016-07-06 16:47:05]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-07-06 16:47:06]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-07-06 16:47:07]

Transient error: Invalid delimiter in "linux_site_isolation":
Correct syntax is "tryserver:bot1,bot2;tryserver2:bot3,bot4;".

[alexmos, 2016-07-06 16:48:14]

Description was changed from

==========
Clean up the browser_tests filter for Site Isolation bots.

Previously, the filter disabled 192 tests.  However, lots of these
tests were actually passing with --site-per-process, mostly due to
unnecessarily wide wildcards.  This CL explicitly lists all the actual
failures, and also removes a couple of WebRtc tests which seem to be
passing now.  This brings the number of disabled tests down to 26.

BUG=417518, 603261
CQ_INCLUDE_TRYBOTS=linux_site_isolation
==========

to

==========
Clean up the browser_tests filter for Site Isolation bots.

Previously, the filter disabled 192 tests.  However, lots of these
tests were actually passing with --site-per-process, mostly due to
unnecessarily wide wildcards.  This CL explicitly lists all the actual
failures, and also removes a couple of WebRtc tests which seem to be
passing now.  This brings the number of disabled tests down to 26.

BUG=417518, 603261
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_site_isolation
==========

[alexmos, 2016-07-06 16:48:27]

The CQ bit was checked by alexmos@chromium.org

[commit-bot: I haz the power, 2016-07-06 16:48:55]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-07-06 17:38:30]

Committed patchset #3 (id:40001)

[commit-bot: I haz the power, 2016-07-06 17:38:35]

CQ bit was unchecked.

[commit-bot: I haz the power, 2016-07-06 17:41:27]

Description was changed from

==========
Clean up the browser_tests filter for Site Isolation bots.

Previously, the filter disabled 192 tests.  However, lots of these
tests were actually passing with --site-per-process, mostly due to
unnecessarily wide wildcards.  This CL explicitly lists all the actual
failures, and also removes a couple of WebRtc tests which seem to be
passing now.  This brings the number of disabled tests down to 26.

BUG=417518, 603261
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_site_isolation
==========

to

==========
Clean up the browser_tests filter for Site Isolation bots.

Previously, the filter disabled 192 tests.  However, lots of these
tests were actually passing with --site-per-process, mostly due to
unnecessarily wide wildcards.  This CL explicitly lists all the actual
failures, and also removes a couple of WebRtc tests which seem to be
passing now.  This brings the number of disabled tests down to 26.

BUG=417518, 603261
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_site_isolation

Committed: https://crrev.com/b1320e8f04eb906f295def43d4cf4894d7bc5b7a
Cr-Commit-Position: refs/heads/master@{#403928}
==========

[commit-bot: I haz the power, 2016-07-06 17:41:28]

Patchset 3 (id:??) landed as
https://crrev.com/b1320e8f04eb906f295def43d4cf4894d7bc5b7a
Cr-Commit-Position: refs/heads/master@{#403928}