Add script comparing v8-perf results

Add script comparing v8-perf results

R=rossberg@chromium.org
BUG=

[nickie, 2016-02-05 13:15:24]

Description was changed from

==========
Add script comparing v8-perf results

R=rossberg@chromium.org
BUG=
==========

to

==========
Add script comparing v8-perf results

R=rossberg@chromium.org
BUG=
==========

[nickie, 2016-02-05 13:15:25]

nikolaos@chromium.org changed reviewers:
+ littledan@chromium.org

[nickie, 2016-02-05 13:16:44]

On 2016/02/05 13:11:05, nickie wrote:

Dan (added to the reviewers) found this useful and suggested that I add this to
the tools/ directory.
To be honest, I haven't checked if there's anything similar to this already
there.
This started as my quick hack for comparing performance results.

[Dan Ehrenberg, 2016-02-05 14:00:39]

On 2016/02/05 at 13:16:44, nikolaos wrote:
> On 2016/02/05 13:11:05, nickie wrote:
> 
> Dan (added to the reviewers) found this useful and suggested that I add this
to the tools/ directory.
> To be honest, I haven't checked if there's anything similar to this already
there.
> This started as my quick hack for comparing performance results.

Ideally, this would be integrated with tools/run_perf.py (which has been very
awkward for me to post-process myself). However, even in the absence of that
integration, this script looks pretty useful to me, so I'd be fine with checking
it in. Other thoughts?

[Dan Ehrenberg, 2016-03-18 18:40:38]

https://codereview.chromium.org/1672433003/diff/1/tools/v8-perf-statistics.py
File tools/v8-perf-statistics.py (right):

https://codereview.chromium.org/1672433003/diff/1/tools/v8-perf-statistics.py...
tools/v8-perf-statistics.py:78: assert m
When I use this script, I replace 'assert m' with 'if not m: continue' so that
it can work on the output of run-perf. A hack for sure, but it works.

[nickie, 2016-03-21 16:09:37]

https://codereview.chromium.org/1672433003/diff/1/tools/v8-perf-statistics.py
File tools/v8-perf-statistics.py (right):

https://codereview.chromium.org/1672433003/diff/1/tools/v8-perf-statistics.py...
tools/v8-perf-statistics.py:78: assert m
On 2016/03/18 18:40:37, Dan Ehrenberg wrote:
> When I use this script, I replace 'assert m' with 'if not m: continue' so that
> it can work on the output of run-perf. A hack for sure, but it works.

Done.  I'm fixing this in a better way.

[Camillo Bruni, 2016-03-21 16:28:43]

On 2016/03/21 at 16:09:37, nikolaos wrote:
> https://codereview.chromium.org/1672433003/diff/1/tools/v8-perf-statistics.py
> File tools/v8-perf-statistics.py (right):
> 
>
https://codereview.chromium.org/1672433003/diff/1/tools/v8-perf-statistics.py...
> tools/v8-perf-statistics.py:78: assert m
> On 2016/03/18 18:40:37, Dan Ehrenberg wrote:
> > When I use this script, I replace 'assert m' with 'if not m: continue' so
that
> > it can work on the output of run-perf. A hack for sure, but it works.
> 
> Done.  I'm fixing this in a better way.

We do already have bsuite to locally compare benchmark runs between separate
versions, not sure if that would be enough?
See https://wiki.corp.google.com/twiki/bin/view/Main/V8 (probably you've seen
this already)

[Dan Ehrenberg, 2016-04-01 19:47:14]

On 2016/03/21 at 16:28:43, cbruni wrote:
> On 2016/03/21 at 16:09:37, nikolaos wrote:
> >
https://codereview.chromium.org/1672433003/diff/1/tools/v8-perf-statistics.py
> > File tools/v8-perf-statistics.py (right):
> > 
> >
https://codereview.chromium.org/1672433003/diff/1/tools/v8-perf-statistics.py...
> > tools/v8-perf-statistics.py:78: assert m
> > On 2016/03/18 18:40:37, Dan Ehrenberg wrote:
> > > When I use this script, I replace 'assert m' with 'if not m: continue' so
that
> > > it can work on the output of run-perf. A hack for sure, but it works.
> > 
> > Done.  I'm fixing this in a better way.
> 
> We do already have bsuite to locally compare benchmark runs between separate
versions, not sure if that would be enough?
> See https://wiki.corp.google.com/twiki/bin/view/Main/V8 (probably you've seen
this already)

cbruni, I hadn't seen that. Where can I find bsuite today? Is it still in svn
with an application-specific password? I'm having trouble logging into that, and
most of our other resources have migrated. I don't see it in our tools/
directory or v8-perf.

[nickie, 2016-09-29 09:32:50]

I'm closing this CL, as I'm not sure if it's any useful (anymore) to the team.
Feel free to take the script and modify it, if you find it useful.