Change auto_bisect to post results to perf dashboard.

Change auto_bisect to post results to perf dashboard.

High level changes:

bisect_results.py
  This is removed and replaced by bisector.get_result(), where we craft a object to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on completion.

perf_try
  Change to craft bisect result object and call performance_dasboard.post_bisect_results as well.

This CL depends on CL: 1570513008

BUG=573308
Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=298871

[chrisphan, 2016-01-11 20:59:41]

Description was changed from

==========
.


.


Use gitiles_poller to poll chromium LKGR branch on Dr. Memory LKGR bots

R=bruening@chromium.org,phajdan.jr@chromium.org
BUG=574167

Review URL: https://codereview.chromium.org/1576043002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298203
0039d316-1c4b-4281-b951-d872f2087c98

Changing WASM announcement to something more wasm specific.

BUG=None
TEST=local
R=jfb@chromium.org

Review URL: https://codereview.chromium.org/1575133002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298200
0039d316-1c4b-4281-b951-d872f2087c98

add instrumentation tests to cloud bot

also increase number of instances to 10

TBR=stip@chromium.org,sergeyberezin@chromium.org
BUG=

Review URL: https://codereview.chromium.org/1574943003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298199
0039d316-1c4b-4281-b951-d872f2087c98

Fix recipe_simulation test.

BUG=

Review URL: https://codereview.chromium.org/1577683003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298198
0039d316-1c4b-4281-b951-d872f2087c98

Reland of V8 Buildbot: Switch remaining mac bots to swarming.

Reason for revert:
Should work after https://codereview.chromium.org/1573913003/

Original issue's description:
> Partial revert of V8 Buildbot: Switch remaining mac bots to swarming.
>
> Mac asan is not working.
>
> BUG=535160
> TBR=tandrii@chromium.org, kjellander@chromium.org
>
> Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=298194

TBR=tandrii@chromium.org,kjellander@chromium.org
BUG=535160

Review URL: https://codereview.chromium.org/1576993002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298197
0039d316-1c4b-4281-b951-d872f2087c98

Add recipe for testing recipe simulation.

Also add it to master.chromium.tools.build on {win,linux,mac} platforms.

R=machenbach@chromium.org
BUG=

Review URL: https://codereview.chromium.org/1575833003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298196
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Stage mac asan for swarming.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1579623002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298195
0039d316-1c4b-4281-b951-d872f2087c98

Partial revert of V8 Buildbot: Switch remaining mac bots to swarming.

Mac asan is not working.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1576933002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298194
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Switch remaining mac bots to swarming.

This switches all trybots and mac asan.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1575923002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298193
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Remove swarming staging builders/testers.

This also includes a refactoring of the subdir slaves
distribution code.

BUG=535160

Review URL: https://codereview.chromium.org/1573093002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298192
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Switch mac continuous to swarming.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1578763002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298191
0039d316-1c4b-4281-b951-d872f2087c98

Make linux_blink_oilpan_rel run layout tests only for changes touching
third_party/WebKit

This is similar to how linux_chromium_rel_ng runs layout tests.

Depends on changes landed for
https://code.google.com/p/chromium/issues/detail?id=575658

BUG=387516

Review URL: https://codereview.chromium.org/1575873002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298190
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buldbot: Remove haswell slaves to prepare swarming switch.

BUG=575556
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1578743002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298189
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Stage mac for swarming.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1575853002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298188
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Switch static-initializer check to swarming.

BUG=535160

Review URL: https://codereview.chromium.org/1578703002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298187
0039d316-1c4b-4281-b951-d872f2087c98

Enable AndroidWebViewTest and ChromeSyncShellTest instrumentation tests for GN

BUG=510485

Review URL: https://codereview.chromium.org/1556693002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298186
0039d316-1c4b-4281-b951-d872f2087c98

Teach bots about a new summary line in the DR suite.

The new cross-compilation builds in the DynamoRIO suite are skipped if no
cross-compiler is found.  The bot scripts need to be taught about this new
skipped build type.

BUG=none
TBR=zhaoqin@chromium.org
NOTRY=true

Review URL: https://codereview.chromium.org/1570803003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298184
0039d316-1c4b-4281-b951-d872f2087c98

CrOS: Update Chromite pin.

Update ChromeOS Chromite pins.
- [master]
  12b0ab20d32e55c5fe120f01cfa086ff4e55fc5c =>
     c9b17b3efac184e077fc29f203716f20bda1ee86

BUG=chromium:575872
TBR=tandrii@chromium.org

Review URL: https://codereview.chromium.org/1564293004

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298183
0039d316-1c4b-4281-b951-d872f2087c98

Add manually triggered builders to build conda environment CIPD package.

I don't expect this environment to be rebuild often, thus no schedulers.

TBR=iannucci@chromium.org
BUG=457792

Review URL: https://codereview.chromium.org/1570993002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298182
0039d316-1c4b-4281-b951-d872f2087c98

Add recipe to build CIPD package with relocatable Conda environment.

It butchers Conda directory before packaging to remove all references to local
installation prefix, thus making it fully relocatable (it will be installed into
another prefix on bots). This process downgrades it from conda environment into
"regular" portable python environment.

R=iannucci@chromium.org,dtu@chromium.org
BUG=457792

Review URL: https://codereview.chromium.org/1511383003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298181
0039d316-1c4b-4281-b951-d872f2087c98

Flakiness dashboard: turn off json logging completely until determining an
appropriate amount to log.

BUG=

Review URL: https://codereview.chromium.org/1570293002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298180
0039d316-1c4b-4281-b951-d872f2087c98

Flakiness dashboard: dump test results json instead of gtest json.

Gtest json is 10s of MB and too large to practically debug with.
Also pretty print test results json.

BUG=573343

Review URL: https://codereview.chromium.org/1570713003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298179
0039d316-1c4b-4281-b951-d872f2087c98

Deploy new Linux Intel slave running Intel's Graphics Stack.

(As opposed to the stock Ubuntu drivers, which the Linux Intel bot is
going to be switched to run.)

BUG=540543

Review URL: https://codereview.chromium.org/1574563002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298178
0039d316-1c4b-4281-b951-d872f2087c98
==========

to

==========
.


.


Use gitiles_poller to poll chromium LKGR branch on Dr. Memory LKGR bots

R=bruening@chromium.org,phajdan.jr@chromium.org
BUG=574167

Review URL: https://codereview.chromium.org/1576043002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298203
0039d316-1c4b-4281-b951-d872f2087c98

Changing WASM announcement to something more wasm specific.

BUG=None
TEST=local
R=jfb@chromium.org

Review URL: https://codereview.chromium.org/1575133002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298200
0039d316-1c4b-4281-b951-d872f2087c98

add instrumentation tests to cloud bot

also increase number of instances to 10

TBR=stip@chromium.org,sergeyberezin@chromium.org
BUG=

Review URL: https://codereview.chromium.org/1574943003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298199
0039d316-1c4b-4281-b951-d872f2087c98

Fix recipe_simulation test.

BUG=

Review URL: https://codereview.chromium.org/1577683003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298198
0039d316-1c4b-4281-b951-d872f2087c98

Reland of V8 Buildbot: Switch remaining mac bots to swarming.

Reason for revert:
Should work after https://codereview.chromium.org/1573913003/

Original issue's description:
> Partial revert of V8 Buildbot: Switch remaining mac bots to swarming.
>
> Mac asan is not working.
>
> BUG=535160
> TBR=tandrii@chromium.org, kjellander@chromium.org
>
> Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=298194

TBR=tandrii@chromium.org,kjellander@chromium.org
BUG=535160

Review URL: https://codereview.chromium.org/1576993002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298197
0039d316-1c4b-4281-b951-d872f2087c98

Add recipe for testing recipe simulation.

Also add it to master.chromium.tools.build on {win,linux,mac} platforms.

R=machenbach@chromium.org
BUG=

Review URL: https://codereview.chromium.org/1575833003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298196
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Stage mac asan for swarming.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1579623002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298195
0039d316-1c4b-4281-b951-d872f2087c98

Partial revert of V8 Buildbot: Switch remaining mac bots to swarming.

Mac asan is not working.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1576933002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298194
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Switch remaining mac bots to swarming.

This switches all trybots and mac asan.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1575923002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298193
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Remove swarming staging builders/testers.

This also includes a refactoring of the subdir slaves
distribution code.

BUG=535160

Review URL: https://codereview.chromium.org/1573093002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298192
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Switch mac continuous to swarming.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1578763002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298191
0039d316-1c4b-4281-b951-d872f2087c98

Make linux_blink_oilpan_rel run layout tests only for changes touching
third_party/WebKit

This is similar to how linux_chromium_rel_ng runs layout tests.

Depends on changes landed for
https://code.google.com/p/chromium/issues/detail?id=575658

BUG=387516

Review URL: https://codereview.chromium.org/1575873002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298190
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buldbot: Remove haswell slaves to prepare swarming switch.

BUG=575556
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1578743002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298189
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Stage mac for swarming.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1575853002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298188
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Switch static-initializer check to swarming.

BUG=535160

Review URL: https://codereview.chromium.org/1578703002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298187
0039d316-1c4b-4281-b951-d872f2087c98

Enable AndroidWebViewTest and ChromeSyncShellTest instrumentation tests for GN

BUG=510485

Review URL: https://codereview.chromium.org/1556693002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298186
0039d316-1c4b-4281-b951-d872f2087c98

Teach bots about a new summary line in the DR suite.

The new cross-compilation builds in the DynamoRIO suite are skipped if no
cross-compiler is found.  The bot scripts need to be taught about this new
skipped build type.

BUG=none
TBR=zhaoqin@chromium.org
NOTRY=true

Review URL: https://codereview.chromium.org/1570803003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298184
0039d316-1c4b-4281-b951-d872f2087c98

CrOS: Update Chromite pin.

Update ChromeOS Chromite pins.
- [master]
  12b0ab20d32e55c5fe120f01cfa086ff4e55fc5c =>
     c9b17b3efac184e077fc29f203716f20bda1ee86

BUG=chromium:575872
TBR=tandrii@chromium.org

Review URL: https://codereview.chromium.org/1564293004

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298183
0039d316-1c4b-4281-b951-d872f2087c98

Add manually triggered builders to build conda environment CIPD package.

I don't expect this environment to be rebuild often, thus no schedulers.

TBR=iannucci@chromium.org
BUG=457792

Review URL: https://codereview.chromium.org/1570993002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298182
0039d316-1c4b-4281-b951-d872f2087c98

Add recipe to build CIPD package with relocatable Conda environment.

It butchers Conda directory before packaging to remove all references to local
installation prefix, thus making it fully relocatable (it will be installed into
another prefix on bots). This process downgrades it from conda environment into
"regular" portable python environment.

R=iannucci@chromium.org,dtu@chromium.org
BUG=457792

Review URL: https://codereview.chromium.org/1511383003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298181
0039d316-1c4b-4281-b951-d872f2087c98

Flakiness dashboard: turn off json logging completely until determining an
appropriate amount to log.

BUG=

Review URL: https://codereview.chromium.org/1570293002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298180
0039d316-1c4b-4281-b951-d872f2087c98

Flakiness dashboard: dump test results json instead of gtest json.

Gtest json is 10s of MB and too large to practically debug with.
Also pretty print test results json.

BUG=573343

Review URL: https://codereview.chromium.org/1570713003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298179
0039d316-1c4b-4281-b951-d872f2087c98

Deploy new Linux Intel slave running Intel's Graphics Stack.

(As opposed to the stock Ubuntu drivers, which the Linux Intel bot is
going to be switched to run.)

BUG=540543

Review URL: https://codereview.chromium.org/1574563002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298178
0039d316-1c4b-4281-b951-d872f2087c98
==========

[chrisphan, 2016-01-11 20:59:41]

chrisphan@chromium.org changed reviewers:
- bruening@chromium.org, dtu@chromium.org, iannucci@chromium.org,
jfb@chromium.org, kjellander@chromium.org, machenbach@chromium.org,
phajdan.jr@chromium.org, sergeyberezin@chromium.org, stip@chromium.org,
tandrii@chromium.org, zhaoqin@chromium.org

[chrisphan, 2016-01-11 21:08:45]

Description was changed from

==========
.


.


Use gitiles_poller to poll chromium LKGR branch on Dr. Memory LKGR bots

R=bruening@chromium.org,phajdan.jr@chromium.org
BUG=574167

Review URL: https://codereview.chromium.org/1576043002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298203
0039d316-1c4b-4281-b951-d872f2087c98

Changing WASM announcement to something more wasm specific.

BUG=None
TEST=local
R=jfb@chromium.org

Review URL: https://codereview.chromium.org/1575133002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298200
0039d316-1c4b-4281-b951-d872f2087c98

add instrumentation tests to cloud bot

also increase number of instances to 10

TBR=stip@chromium.org,sergeyberezin@chromium.org
BUG=

Review URL: https://codereview.chromium.org/1574943003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298199
0039d316-1c4b-4281-b951-d872f2087c98

Fix recipe_simulation test.

BUG=

Review URL: https://codereview.chromium.org/1577683003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298198
0039d316-1c4b-4281-b951-d872f2087c98

Reland of V8 Buildbot: Switch remaining mac bots to swarming.

Reason for revert:
Should work after https://codereview.chromium.org/1573913003/

Original issue's description:
> Partial revert of V8 Buildbot: Switch remaining mac bots to swarming.
>
> Mac asan is not working.
>
> BUG=535160
> TBR=tandrii@chromium.org, kjellander@chromium.org
>
> Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=298194

TBR=tandrii@chromium.org,kjellander@chromium.org
BUG=535160

Review URL: https://codereview.chromium.org/1576993002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298197
0039d316-1c4b-4281-b951-d872f2087c98

Add recipe for testing recipe simulation.

Also add it to master.chromium.tools.build on {win,linux,mac} platforms.

R=machenbach@chromium.org
BUG=

Review URL: https://codereview.chromium.org/1575833003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298196
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Stage mac asan for swarming.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1579623002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298195
0039d316-1c4b-4281-b951-d872f2087c98

Partial revert of V8 Buildbot: Switch remaining mac bots to swarming.

Mac asan is not working.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1576933002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298194
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Switch remaining mac bots to swarming.

This switches all trybots and mac asan.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1575923002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298193
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Remove swarming staging builders/testers.

This also includes a refactoring of the subdir slaves
distribution code.

BUG=535160

Review URL: https://codereview.chromium.org/1573093002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298192
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Switch mac continuous to swarming.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1578763002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298191
0039d316-1c4b-4281-b951-d872f2087c98

Make linux_blink_oilpan_rel run layout tests only for changes touching
third_party/WebKit

This is similar to how linux_chromium_rel_ng runs layout tests.

Depends on changes landed for
https://code.google.com/p/chromium/issues/detail?id=575658

BUG=387516

Review URL: https://codereview.chromium.org/1575873002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298190
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buldbot: Remove haswell slaves to prepare swarming switch.

BUG=575556
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1578743002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298189
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Stage mac for swarming.

BUG=535160
TBR=tandrii@chromium.org, kjellander@chromium.org

Review URL: https://codereview.chromium.org/1575853002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298188
0039d316-1c4b-4281-b951-d872f2087c98

V8 Buildbot: Switch static-initializer check to swarming.

BUG=535160

Review URL: https://codereview.chromium.org/1578703002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298187
0039d316-1c4b-4281-b951-d872f2087c98

Enable AndroidWebViewTest and ChromeSyncShellTest instrumentation tests for GN

BUG=510485

Review URL: https://codereview.chromium.org/1556693002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298186
0039d316-1c4b-4281-b951-d872f2087c98

Teach bots about a new summary line in the DR suite.

The new cross-compilation builds in the DynamoRIO suite are skipped if no
cross-compiler is found.  The bot scripts need to be taught about this new
skipped build type.

BUG=none
TBR=zhaoqin@chromium.org
NOTRY=true

Review URL: https://codereview.chromium.org/1570803003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298184
0039d316-1c4b-4281-b951-d872f2087c98

CrOS: Update Chromite pin.

Update ChromeOS Chromite pins.
- [master]
  12b0ab20d32e55c5fe120f01cfa086ff4e55fc5c =>
     c9b17b3efac184e077fc29f203716f20bda1ee86

BUG=chromium:575872
TBR=tandrii@chromium.org

Review URL: https://codereview.chromium.org/1564293004

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298183
0039d316-1c4b-4281-b951-d872f2087c98

Add manually triggered builders to build conda environment CIPD package.

I don't expect this environment to be rebuild often, thus no schedulers.

TBR=iannucci@chromium.org
BUG=457792

Review URL: https://codereview.chromium.org/1570993002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298182
0039d316-1c4b-4281-b951-d872f2087c98

Add recipe to build CIPD package with relocatable Conda environment.

It butchers Conda directory before packaging to remove all references to local
installation prefix, thus making it fully relocatable (it will be installed into
another prefix on bots). This process downgrades it from conda environment into
"regular" portable python environment.

R=iannucci@chromium.org,dtu@chromium.org
BUG=457792

Review URL: https://codereview.chromium.org/1511383003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298181
0039d316-1c4b-4281-b951-d872f2087c98

Flakiness dashboard: turn off json logging completely until determining an
appropriate amount to log.

BUG=

Review URL: https://codereview.chromium.org/1570293002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298180
0039d316-1c4b-4281-b951-d872f2087c98

Flakiness dashboard: dump test results json instead of gtest json.

Gtest json is 10s of MB and too large to practically debug with.
Also pretty print test results json.

BUG=573343

Review URL: https://codereview.chromium.org/1570713003

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298179
0039d316-1c4b-4281-b951-d872f2087c98

Deploy new Linux Intel slave running Intel's Graphics Stack.

(As opposed to the stock Ubuntu drivers, which the Linux Intel bot is
going to be switched to run.)

BUG=540543

Review URL: https://codereview.chromium.org/1574563002

git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@298178
0039d316-1c4b-4281-b951-d872f2087c98
==========

to

==========
Change auto_bisect to post results to perf dashboard.


High level changes:

bisect_results_json.py
  This is where we craft a object to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on
completion.

perf_try
  Change to call performance_dasboard.post_bisect as well.


BUG=573308
==========

[chrisphan, 2016-01-11 21:08:46]

chrisphan@chromium.org changed reviewers:
+ prasadv@chromium.org, robertocn@chromium.org, robertocn@google.com

[chrisphan, 2016-01-11 21:09:32]

Description was changed from

==========
Change auto_bisect to post results to perf dashboard.


High level changes:

bisect_results_json.py
  This is where we craft a object to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on
completion.

perf_try
  Change to call performance_dasboard.post_bisect as well.


BUG=573308
==========

to

==========
Change auto_bisect to post results to perf dashboard.

This CL depends on CL: 1570513008

High level changes:

bisect_results_json.py
  This is where we craft a object to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on
completion.

perf_try
  Change to call performance_dasboard.post_bisect as well.


BUG=573308
==========

[chrisphan, 2016-01-11 21:13:27]

Description was changed from

==========
Change auto_bisect to post results to perf dashboard.

This CL depends on CL: 1570513008

High level changes:

bisect_results_json.py
  This is where we craft a object to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on
completion.

perf_try
  Change to call performance_dasboard.post_bisect as well.


BUG=573308
==========

to

==========
Change auto_bisect to post results to perf dashboard.

High level changes:

bisect_results_json.py
  This is where we craft a object to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on
completion.

perf_try
  Change to call performance_dasboard.post_bisect as well.

This CL depends on CL: 1570513008

BUG=573308
==========

[chrisphan, 2016-01-11 21:19:09]

https://codereview.chromium.org/1573293002/diff/20001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/auto_bisect/bisect_results.py (left):

https://codereview.chromium.org/1573293002/diff/20001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/auto_bisect/bisect_results.py:10: _RESULTS_BANNER =
"""
So most of this is moved to dashboard side.  See
https://codereview.chromium.org/1566013002/diff/1/dashboard/dashboard/bisect_....
 However, we also output these data in json format in "Results" step see (CL:
1570513008).

[qyearsley, 2016-01-11 22:49:43]

qyearsley@chromium.org changed reviewers:
+ qyearsley@chromium.org

[qyearsley, 2016-01-11 22:49:43]

https://chromiumcodereview-hr.appspot.com/1573293002/diff/40001/scripts/slave...
File scripts/slave/recipe_modules/auto_bisect/bisect_results_json.py (right):

https://chromiumcodereview-hr.appspot.com/1573293002/diff/40001/scripts/slave...
scripts/slave/recipe_modules/auto_bisect/bisect_results_json.py:18: def
get(bisector):
What do you think about making this a method of Bisector?

https://chromiumcodereview-hr.appspot.com/1573293002/diff/40001/scripts/slave...
scripts/slave/recipe_modules/auto_bisect/bisect_results_json.py:55: 
Nit: two spaces between top-level functions

https://chromiumcodereview-hr.appspot.com/1573293002/diff/40001/scripts/slave...
File scripts/slave/recipe_modules/auto_bisect/bisector.py (right):

https://chromiumcodereview-hr.appspot.com/1573293002/diff/40001/scripts/slave...
scripts/slave/recipe_modules/auto_bisect/bisector.py:501:
self.api.m.perf_dashboard.post_bisect(results, halt_on_failure)
Nice, I'm glad we can re-use the perf_dashboard recipe module.

https://chromiumcodereview-hr.appspot.com/1573293002/diff/40001/scripts/slave...
File scripts/slave/recipe_modules/perf_try/bisect_results_json.py (right):

https://chromiumcodereview-hr.appspot.com/1573293002/diff/40001/scripts/slave...
scripts/slave/recipe_modules/perf_try/bisect_results_json.py:18: def get(api,
config, results_without_patch, results_with_patch, labels):
Might it be potentially clearer if this module is renamed, since there's already
another bisect_results_json.py in auto_bisect/?

[RobertoCN, 2016-01-12 20:47:29]

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/auto_bisect/bisect_results_json.py (right):

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/auto_bisect/bisect_results_json.py:18: def
get(bisector):
On 2016/01/11 22:49:43, qyearsley wrote:
> What do you think about making this a method of Bisector?

+1

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/auto_bisect/local_bisect.py (right):

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/auto_bisect/local_bisect.py:78:
bisector.post_result(halt_on_failure=False)
At first I was concerned that we might not be showing the results for debugging
purposes, I had to go to the perf_dashboard module to see that post_result
actually generates a step. I only wish the step would be called 'Partial
results' rather than 'Results' when appropriate (to avoid confusion).

[chrisphan, 2016-01-14 00:53:26]

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/auto_bisect/bisect_results_json.py (right):

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/auto_bisect/bisect_results_json.py:18: def
get(bisector):
On 2016/01/12 20:47:29, RobertoCN wrote:
> On 2016/01/11 22:49:43, qyearsley wrote:
> > What do you think about making this a method of Bisector?
> 
> +1

Done.

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/auto_bisect/bisect_results_json.py:55: 
On 2016/01/11 22:49:43, qyearsley wrote:
> Nit: two spaces between top-level functions

Done.

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/auto_bisect/local_bisect.py (right):

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/auto_bisect/local_bisect.py:78:
bisector.post_result(halt_on_failure=False)
On 2016/01/12 20:47:29, RobertoCN wrote:
> At first I was concerned that we might not be showing the results for
debugging
> purposes, I had to go to the perf_dashboard module to see that post_result
> actually generates a step. I only wish the step would be called 'Partial
> results' rather than 'Results' when appropriate (to avoid confusion).

Right, I was making 'post bisect results' step generic since it will be used in
multiple places and multiple purposes like failures, partial, and completion. 
And hoping dashboard will present the results in better format for those states.
 We can follow up with a CL to add the results link which points to dashboard
bisect result page (we talked about).

And if this still a bother, we can follow up with a change to add 'partial' to
'post bisect result' step name.

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/perf_try/bisect_results_json.py (right):

https://codereview.chromium.org/1573293002/diff/40001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/perf_try/bisect_results_json.py:18: def get(api,
config, results_without_patch, results_with_patch, labels):
On 2016/01/11 22:49:43, qyearsley wrote:
> Might it be potentially clearer if this module is renamed, since there's
already
> another bisect_results_json.py in auto_bisect/?

Moved this to perf_try/api for consistency.  This was meant to differentiate
from auto_bisect/bisect_results and legacy's bisect_printer.py.

[chrisphan, 2016-01-14 23:55:45]

Bump

[qyearsley, 2016-01-17 22:48:51]

On 2016/01/14 23:55:45, chrisphan wrote:
> Bump

LGTM as far as I can see; Roberto or Prasad should have a look as well.

[qyearsley, 2016-01-17 22:49:19]

https://codereview.chromium.org/1573293002/diff/60001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/auto_bisect/bisect_results.py (left):

https://codereview.chromium.org/1573293002/diff/60001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/auto_bisect/bisect_results.py:1: # Copyright 2015
The Chromium Authors. All rights reserved.
Note: This file is being removed because after
https://codereview.chromium.org/1566013002 and this CL, bisector.get_result now
handles putting the result data together (into a dict) and
dashboard/bisect_report handles formatting it into text to paste to the bug.

https://codereview.chromium.org/1573293002/diff/60001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/auto_bisect/bisector.py (right):

https://codereview.chromium.org/1573293002/diff/60001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/auto_bisect/bisector.py:52: 'and not a
regression.')
Note: these are moved from bisect_results.py

[chrisphan, 2016-01-20 20:33:09]

Description was changed from

==========
Change auto_bisect to post results to perf dashboard.

High level changes:

bisect_results_json.py
  This is where we craft a object to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on
completion.

perf_try
  Change to call performance_dasboard.post_bisect as well.

This CL depends on CL: 1570513008

BUG=573308
==========

to

==========
Change auto_bisect to post results to perf dashboard.

High level changes:

bisect_results.py
  This is removed and replaced by bisector.get_result(), where we craft a object
to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on
completion.

perf_try
  Change to craft bisect result object and call
performance_dasboard.post_bisect_results as well.

This CL depends on CL: 1570513008

BUG=573308
==========

[RobertoCN, 2016-01-21 18:55:09]

This looks good, I would only ask that you add a flag or something to prevent
the bisector from posting to dashboard 
(for example if we are running the recipe locally to debug another problem and
we don't want to clutter the dashboard with fake results) maybe support a
'skip_post_results' in the bisect config?

[chrisphan, 2016-01-21 21:31:22]

On 2016/01/21 18:55:09, RobertoCN wrote:
> This looks good, I would only ask that you add a flag or something to prevent
> the bisector from posting to dashboard 
> (for example if we are running the recipe locally to debug another problem and
> we don't want to clutter the dashboard with fake results) maybe support a
> 'skip_post_results' in the bisect config?

Right, so for test run, you can set environment var TESTING_MASTERNAME or
TESTING_SLAVENAME, this will direct posting bisect results to perf dash testing
server (see recipe_modules/perf_dashboard/config.py).  Would that be helpful to
go ahead and make the post request? Currently any post request error won't halt
except the final 'Post bisect results' step.

[prasadv, 2016-01-22 18:15:02]

https://codereview.chromium.org/1573293002/diff/80001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/perf_try/api.py (right):

https://codereview.chromium.org/1573293002/diff/80001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/perf_try/api.py:101:
self.m.perf_dashboard.post_bisect_results(
Why do you want to post results of a perf try job to dashboard.
Currently Perf try jobs and CQ jobs are not triggered by dashboard.

There is "Trace" button on alert form on dashboard, that triggers Perf Tryjob
but that workflow uses legacy bisect. AFAIK, this functionality is not yet
supported by recipes.

[chrisphan, 2016-01-22 18:30:02]

https://codereview.chromium.org/1573293002/diff/80001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/perf_try/api.py (right):

https://codereview.chromium.org/1573293002/diff/80001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/perf_try/api.py:101:
self.m.perf_dashboard.post_bisect_results(
On 2016/01/22 18:15:02, prasadv wrote:
> Why do you want to post results of a perf try job to dashboard.
> Currently Perf try jobs and CQ jobs are not triggered by dashboard.
> 
> There is "Trace" button on alert form on dashboard, that triggers Perf Tryjob
> but that workflow uses legacy bisect. AFAIK, this functionality is not yet
> supported by recipes.
> 
> 

We're gonna deprecate legacy bisect and use this perf_try module right?  Legacy
is updated to upload results to dash as well.  We'll have dashboard send out
mail or display the results so next is to add a link to perf dash on this bot.

[chrisphan, 2016-01-22 18:39:27]

On 2016/01/22 18:30:02, chrisphan wrote:
>
https://codereview.chromium.org/1573293002/diff/80001/scripts/slave/recipe_mo...
> File scripts/slave/recipe_modules/perf_try/api.py (right):
> 
>
https://codereview.chromium.org/1573293002/diff/80001/scripts/slave/recipe_mo...
> scripts/slave/recipe_modules/perf_try/api.py:101:
> self.m.perf_dashboard.post_bisect_results(
> On 2016/01/22 18:15:02, prasadv wrote:
> > Why do you want to post results of a perf try job to dashboard.
> > Currently Perf try jobs and CQ jobs are not triggered by dashboard.
> > 
> > There is "Trace" button on alert form on dashboard, that triggers Perf
Tryjob
> > but that workflow uses legacy bisect. AFAIK, this functionality is not yet
> > supported by recipes.
> > 
> > 
> 
> We're gonna deprecate legacy bisect and use this perf_try module right? 
Legacy
> is updated to upload results to dash as well.  We'll have dashboard send out
> mail or display the results so next is to add a link to perf dash on this bot.

Per offline talk, for perf try jobs without try_job_id, we'll do nothing on
dashboard side.

[chrisphan, 2016-01-22 19:44:28]

So per offline talk, the switch not post results won't apply here since this
change removes previous method of generating report and the same with dashboard
end.  So I'll deploy a dev version of dash and test this change on multiple
platforms.

[qyearsley, 2016-01-26 22:10:50]

LGTM, although this CL should be LGTMd by Roberto or Prasad, and it still
depends on the dashboard changes (https://codereview.chromium.org/1566013002/).

https://codereview.chromium.org/1573293002/diff/80001/scripts/slave/recipes/b...
File scripts/slave/recipes/bisect.py (right):

https://codereview.chromium.org/1573293002/diff/80001/scripts/slave/recipes/b...
scripts/slave/recipes/bisect.py:301: stdout=api.json.output(response))
Style nit: when there are arguments on the same line as the opening parenthesis,
then the other arguments should line up with the first argument.

[chrisphan, 2016-02-05 18:53:16]

Ran this change on linux and windows local setup.  Anything else here Roberto
and Prasadv?

If you want to see the result output, come to my desk.  Also making sure
Dashboard will throw 200 for any requests from bisect bots for now.  Anything
additional lets do follow ups.  This focus on getting the results to dashboard
first.

[RobertoCN, 2016-02-09 21:40:07]

On 2016/02/05 at 18:53:16, chrisphan wrote:
> Ran this change on linux and windows local setup.  Anything else here Roberto
and Prasadv?
> 
> If you want to see the result output, come to my desk.  Also making sure
Dashboard will throw 200 for any requests from bisect bots for now.  Anything
additional lets do follow ups.  This focus on getting the results to dashboard
first.

Do you have a link to a run in your local master?

[chrisphan, 2016-02-18 23:18:11]

The CQ bit was checked by chrisphan@chromium.org to run a CQ dry run

[commit-bot: I haz the power, 2016-02-18 23:18:24]

Dry run: CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1573293002/120001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1573293002/120001

[commit-bot: I haz the power, 2016-02-18 23:22:04]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-02-18 23:22:05]

Dry run: This issue passed the CQ dry run.

[chrisphan, 2016-02-18 23:23:40]

On 2016/02/09 21:40:07, RobertoCN wrote:
> On 2016/02/05 at 18:53:16, chrisphan wrote:
> > Ran this change on linux and windows local setup.  Anything else here
Roberto
> and Prasadv?
> > 
> > If you want to see the result output, come to my desk.  Also making sure
> Dashboard will throw 200 for any requests from bisect bots for now.  Anything
> additional lets do follow ups.  This focus on getting the results to dashboard
> first.
> 
> Do you have a link to a run in your local master?

Resolved offline.  No complete run on Windows, though tested added part.  Will
keep watch for windows after deployment.

[chrisphan, 2016-02-18 23:23:49]

The CQ bit was checked by chrisphan@chromium.org

[chrisphan, 2016-02-18 23:23:49]

The patchset sent to the CQ was uploaded after l-g-t-m from
qyearsley@chromium.org
Link to the patchset: https://codereview.chromium.org/1573293002/#ps120001
(title: "rebase")

[commit-bot: I haz the power, 2016-02-18 23:23:55]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1573293002/120001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1573293002/120001

[commit-bot: I haz the power, 2016-02-18 23:37:19]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-02-18 23:37:20]

Try jobs failed on following builders:
  Build Presubmit on tryserver.infra (JOB_FAILED,
https://build.chromium.org/p/tryserver.infra/builders/Build%20Presubmit/build...)

[prasadv, 2016-02-19 00:05:44]

lgtm

[chrisphan, 2016-02-19 00:06:49]

The CQ bit was checked by chrisphan@chromium.org

[chrisphan, 2016-02-19 00:06:50]

The patchset sent to the CQ was uploaded after l-g-t-m from
qyearsley@chromium.org
Link to the patchset:
https://chromiumcodereview-hr.appspot.com/1573293002/#ps200001 (title: ".")

[commit-bot: I haz the power, 2016-02-19 00:06:59]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1573293002/200001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1573293002/200001

[commit-bot: I haz the power, 2016-02-19 00:19:48]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-02-19 00:19:50]

Try jobs failed on following builders:
  Build Presubmit on tryserver.infra (JOB_FAILED,
https://build.chromium.org/p/tryserver.infra/builders/Build%20Presubmit/build...)

[RobertoCN, 2016-02-19 01:34:57]

rs-lgtm

[chrisphan, 2016-02-19 01:38:37]

The CQ bit was checked by chrisphan@chromium.org

[commit-bot: I haz the power, 2016-02-19 01:38:44]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1573293002/200001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1573293002/200001

[commit-bot: I haz the power, 2016-02-19 01:45:43]

Description was changed from

==========
Change auto_bisect to post results to perf dashboard.

High level changes:

bisect_results.py
  This is removed and replaced by bisector.get_result(), where we craft a object
to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on
completion.

perf_try
  Change to craft bisect result object and call
performance_dasboard.post_bisect_results as well.

This CL depends on CL: 1570513008

BUG=573308
==========

to

==========
Change auto_bisect to post results to perf dashboard.

High level changes:

bisect_results.py
  This is removed and replaced by bisector.get_result(), where we craft a object
to be post to dashboard.

local_bisect.py
  Change to call performance_dasboard.post_bisect for each revision and once on
completion.

perf_try
  Change to craft bisect result object and call
performance_dasboard.post_bisect_results as well.

This CL depends on CL: 1570513008

BUG=573308

Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=298871
==========

[commit-bot: I haz the power, 2016-02-19 01:45:45]

Committed patchset #11 (id:200001) as
http://src.chromium.org/viewvc/chrome?view=rev&revision=298871