Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(77)

Issue 1466783002: Enabling extra tests that pass on site-isolation FYI bots. (Closed)

Created:
5 years, 1 month ago by Łukasz Anforowicz
Modified:
5 years ago
Reviewers:
Charlie Reis
CC:
chromium-reviews, site-isolation-reviews_chromium.org
Base URL:
https://chromium.googlesource.com/chromium/src.git@master
Target Ref:
refs/pending/heads/master
Project:
chromium
Visibility:
Public.

Description

Enabling extra tests that pass on site-isolation FYI bots. Tests that pass and can be removed from the exclusion list: BrowserTest.ClearPendingOnFailUnlessNTP BrowserTest.WindowOpenClose DnsProbeBrowserTest.* InlineLoginUISafeIframeBrowserTest.* LaunchWebAuthFlowFunctionTest.* OptionsUIBrowserTest.* PopupBlockerBrowserTest.* *.RestoreCrossSiteWithExistingSiteInstance ZoomControllerBrowserTest.* *.ProfilesWithoutPagesNotLaunched Tests that don't exist anymore / don't match the exclusion pattern: *.NewAvatarMenuEnabledInGuestMode Test suites that still fail, but where the exclusion can be narrowed down: - RedirectTest.* [8 tests / only 1 fails] can be narrowed down into: RedirectTest.ClientEmptyReferer - ReferrerPolicyTest.* [32 tests / only 1 fails] can be narrowed down into: ReferrerPolicyTest.HttpsRedirect - SSLUITest.* [37 tests / only 1 fails] can be narrowed down into: SSLUITest.TestGoodFrameNavigation - RestoreOnStartupPolicyTest* [10 tests / only 2 fail] can be narrowed down into: RestoreOnStartupPolicyTestInstance/RestoreOnStartupPolicyTest.RunTest* BUG=417518, 448592, 467125, 456420 Committed: https://crrev.com/5f920780e30c5f0101e45b9187ac498d9cbc4d20 Cr-Commit-Position: refs/heads/master@{#362248}

Patch Set 1 #

Total comments: 2

Patch Set 2 : Backed out accidental PhishingClassifierTest changes. #

Patch Set 3 : Have to exclude BrowserTest.WindowOpenClose after all (flaky). #

Patch Set 4 : Rebasing... #

Unified diffs Side-by-side diffs Delta from patch set Stats (+2 lines, -2 lines) Patch
M testing/buildbot/chromium.fyi.json View 1 2 3 2 chunks +2 lines, -2 lines 0 comments Download

Messages

Total messages: 19 (7 generated)
Łukasz Anforowicz
Charlie, can you take a look please?
5 years, 1 month ago (2015-11-20 22:39:16 UTC) #2
Charlie Reis
On 2015/11/20 22:39:16, Łukasz Anforowicz wrote: > Charlie, can you take a look please? Thanks-- ...
5 years, 1 month ago (2015-11-20 23:11:20 UTC) #3
Charlie Reis
https://codereview.chromium.org/1466783002/diff/1/testing/buildbot/chromium.fyi.json File testing/buildbot/chromium.fyi.json (right): https://codereview.chromium.org/1466783002/diff/1/testing/buildbot/chromium.fyi.json#newcode5660 testing/buildbot/chromium.fyi.json:5660: "--gtest_filter=-BrowserTest.InterstitialCancelsGuestViewDialogs:BrowserTest.OtherRedirectsDontForkProcess:ChromeRenderProcessHostTest.*:ChromeRenderProcessHostTestWithCommandLine.*:DevToolsExperimentalExtensionTest.*:DevToolsExtensionTest.*:ErrorPageTest.*:ExtensionApiTest.ContentScriptOtherExtensions:ExtensionApiTest.ContentScriptExtensionProcess:ExtensionApiTest.DontInjectContentScriptsInBackgroundPages:ExtensionApiTest.Tabs2:ExtensionApiTest.TabsOnUpdated:ExtensionApiTest.WindowOpenPopupIframe:ExtensionOptionsApiTest.ExtensionCanEmbedOwnOptions:ExtensionViewTest.*:IsolatedAppTest.*:MimeHandlerViewTest.*:*PDFExtensionTest.*:PhishingClassifierTest.TestClassification:PhishingDOMFeatureExtractorTest.*:PrerenderBrowserTest.*:ProcessManagementTest.*:RedirectTest.ClientEmptyReferer:ReferrerPolicyTest.HttpsRedirect:SSLUITest.TestGoodFrameNavigation:WebNavigationApiTest.CrossProcessFragment:WebNavigationApiTest.ServerRedirectSingleProcess:WebNavigationApiTest.CrossProcessHistory:WebViewDPITest.*:WebViewPluginTest.*:WebViewTest.AcceptTouchEvents:WebViewTest.IndexedDBIsolation:WebViewTest.ScreenCoordinates:WebViewTest.ContextMenusAPI_PreventDefault:WebViewTest.TestContextMenu:WebViewTest.NestedGuestContainerBounds:WebViewFocusTest.*:WebViewNewWindowTest.*:WebViewVisibilityTest.*:*.NavigateFromNTPToOptionsInSameTab:*.TabMove:*.WhitelistedExtension:*.NewTabPageURL:*.HomepageLocation:RestoreOnStartupPolicyTestInstance/RestoreOnStartupPolicyTest.RunTest*:PhishingClassifierDelegateTest.*:WebUIWebViewBrowserTest*:WebRtcBrowserTest.RunsAudioVideoWebRTCCallInTwoTabs:SingleProcessTracingBrowserTest.TestMemoryInfra" Hmm, this pattern differs from the Linux pattern. ...
5 years, 1 month ago (2015-11-20 23:13:59 UTC) #4
Łukasz Anforowicz
On 2015/11/20 23:11:20, Charlie Reis wrote: > On 2015/11/20 22:39:16, Łukasz Anforowicz wrote: > > ...
5 years ago (2015-11-30 19:37:53 UTC) #6
commit-bot: I haz the power
Dry run: CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1466783002/60001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1466783002/60001
5 years ago (2015-11-30 19:40:02 UTC) #8
alexmos
On 2015/11/30 19:37:53, Łukasz Anforowicz wrote: > On 2015/11/20 23:11:20, Charlie Reis wrote: > > ...
5 years ago (2015-11-30 19:41:20 UTC) #9
commit-bot: I haz the power
Dry run: This issue passed the CQ dry run.
5 years ago (2015-11-30 22:15:15 UTC) #11
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1466783002/60001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1466783002/60001
5 years ago (2015-11-30 22:26:45 UTC) #14
commit-bot: I haz the power
Committed patchset #4 (id:60001)
5 years ago (2015-11-30 22:41:21 UTC) #15
commit-bot: I haz the power
Patchset 4 (id:??) landed as https://crrev.com/5f920780e30c5f0101e45b9187ac498d9cbc4d20 Cr-Commit-Position: refs/heads/master@{#362248}
5 years ago (2015-11-30 22:42:56 UTC) #17
Łukasz Anforowicz
Oooops... I forgot to publish my old draft comment... At any rate - this seems ...
5 years ago (2015-11-30 23:09:59 UTC) #18
Łukasz Anforowicz
5 years ago (2015-12-01 18:35:03 UTC) #19
Message was sent while issue was closed.
On 2015/11/30 19:41:20, alexmos wrote:
> Driveby comment: I noticed that ExtensionApiTest.Tabs2 and all tests under
> ExtensionViewTest.* were passing for me locally.  Lukasz, could you perhaps
> check if they work on the bot, and if so, reenable them here as well?  Thanks!

These tests passed locally when run --gtest_repeat=10 times with
--isolate-extensions.

OTOH, ExtensionApiTest.Tabs2 intermittently (around 40% of time) fails when run
with --site-per-process.

I'll try creating a separate CL that enables ExtensionViewTest.* and then seeing
if the bot is also happy with this.

Powered by Google App Engine
This is Rietveld 408576698