DevTools: improve test infrastructure w/ devtools driving the test

DevTools: improve test infrastructure w/ devtools driving the test

Improvements:
* devtools drives the test, not the inspected page
* tests are pure JS
* doc-typed test harness

This includes a couple sample tests to make sure this new test infra
actually works, but I don't quite yet trust it, so I'm keeping the original
release-note test for now :)

Performance (running console-clear.js x100):
TBD

BUG=667560

[chenwilliam, 2017-03-09 01:14:15]

Description was changed from

==========
DevTools: improve test infrastructure w/ devtools driving the test

Improvements:
* devtools drives the test, not the inspected page
* tests are pure JS
* doc-typed test harness

BUG=667560
==========

to

==========
DevTools: improve test infrastructure w/ devtools driving the test

Improvements:
* devtools drives the test, not the inspected page
* tests are pure JS
* doc-typed test harness

This includes a couple sample tests to make sure this new test infra
actually works, but I don't quite yet trust it, so I'm keeping the original
release-note test for now :)
BUG=667560
==========

[chenwilliam, 2017-03-09 01:14:15]

chenwilliam@chromium.org changed reviewers:
+ dgozman@chromium.org

[chenwilliam, 2017-03-09 01:24:19]

Description was changed from

==========
DevTools: improve test infrastructure w/ devtools driving the test

Improvements:
* devtools drives the test, not the inspected page
* tests are pure JS
* doc-typed test harness

This includes a couple sample tests to make sure this new test infra
actually works, but I don't quite yet trust it, so I'm keeping the original
release-note test for now :)
BUG=667560
==========

to

==========
DevTools: improve test infrastructure w/ devtools driving the test

Improvements:
* devtools drives the test, not the inspected page
* tests are pure JS
* doc-typed test harness

This includes a couple sample tests to make sure this new test infra
actually works, but I don't quite yet trust it, so I'm keeping the original
release-note test for now :)

BUG=667560
==========

[chenwilliam, 2017-03-09 01:27:42]

ptal. I know it looks like a big patch, but a lot of it is copy-paste :)

https://codereview.chromium.org/2742623002/diff/20001/third_party/WebKit/Sour...
File third_party/WebKit/Source/devtools/front_end/integration_test_runner.json
(right):

https://codereview.chromium.org/2742623002/diff/20001/third_party/WebKit/Sour...
third_party/WebKit/Source/devtools/front_end/integration_test_runner.json:2:
"modules" : [
This will likely be annoying to maintain, but I'm planning on making it DRY
(e.g. a special code path for integration_test_runner so it can extend
inspector.json) in a f/u CL. WDYT?

[dgozman, 2017-03-10 00:17:17]

Exciting!

https://codereview.chromium.org/2742623002/diff/20001/content/shell/browser/l...
File content/shell/browser/layout_test/blink_test_controller.cc (right):

https://codereview.chromium.org/2742623002/diff/20001/content/shell/browser/l...
content/shell/browser/layout_test/blink_test_controller.cc:232:
inspected_window_(NULL),
nullptr

https://codereview.chromium.org/2742623002/diff/20001/content/shell/browser/l...
content/shell/browser/layout_test/blink_test_controller.cc:296:
inspected_window_->LoadURL(GURL(url::kAboutBlankURL));
Did we detach at the end of previous test? It would be unfortunate to navigate
while attached and waste resources.

https://codereview.chromium.org/2742623002/diff/20001/content/shell/browser/l...
File content/shell/browser/layout_test/blink_test_controller.h (right):

https://codereview.chromium.org/2742623002/diff/20001/content/shell/browser/l...
content/shell/browser/layout_test/blink_test_controller.h:270: Shell*
inspected_window_;
Where do we clean this up? Or does it stay forever?

https://codereview.chromium.org/2742623002/diff/20001/third_party/WebKit/Layo...
File
third_party/WebKit/LayoutTests/http/tests/inspector/devtools-js/release-note.js
(right):

https://codereview.chromium.org/2742623002/diff/20001/third_party/WebKit/Layo...
third_party/WebKit/LayoutTests/http/tests/inspector/devtools-js/release-note.js:1:
TestRunner.addResult("Test release note\n");
Copyright!

https://codereview.chromium.org/2742623002/diff/20001/third_party/WebKit/Sour...
File third_party/WebKit/Source/devtools/front_end/test_runner/TestRunner.js
(right):

https://codereview.chromium.org/2742623002/diff/20001/third_party/WebKit/Sour...
third_party/WebKit/Source/devtools/front_end/test_runner/TestRunner.js:95:
TestRunner.addSniffer = function(receiver, methodName, override, opt_sticky) {
General question: should we use this opportunity to make better test helpers, or
we'll be able to migrate many existing tests automatically at once?

https://codereview.chromium.org/2742623002/diff/20001/third_party/WebKit/Sour...
File third_party/WebKit/Source/devtools/front_end/timer/Timer.js (right):

https://codereview.chromium.org/2742623002/diff/20001/third_party/WebKit/Sour...
third_party/WebKit/Source/devtools/front_end/timer/Timer.js:4: Timer.time =
function(label) {
Just add a helper in Main.js for now?

[chenwilliam, 2017-03-10 18:31:16]

Description was changed from

==========
DevTools: improve test infrastructure w/ devtools driving the test

Improvements:
* devtools drives the test, not the inspected page
* tests are pure JS
* doc-typed test harness

This includes a couple sample tests to make sure this new test infra
actually works, but I don't quite yet trust it, so I'm keeping the original
release-note test for now :)

BUG=667560
==========

to

==========
DevTools: improve test infrastructure w/ devtools driving the test

Improvements:
* devtools drives the test, not the inspected page
* tests are pure JS
* doc-typed test harness

This includes a couple sample tests to make sure this new test infra
actually works, but I don't quite yet trust it, so I'm keeping the original
release-note test for now :)

Performance (running console-clear.js x100):
current - 58.9 sec
new - 44.3 sec

BUG=667560
==========

[chenwilliam, 2017-03-16 02:42:08]

Description was changed from

==========
DevTools: improve test infrastructure w/ devtools driving the test

Improvements:
* devtools drives the test, not the inspected page
* tests are pure JS
* doc-typed test harness

This includes a couple sample tests to make sure this new test infra
actually works, but I don't quite yet trust it, so I'm keeping the original
release-note test for now :)

Performance (running console-clear.js x100):
current - 58.9 sec
new - 44.3 sec

BUG=667560
==========

to

==========
DevTools: improve test infrastructure w/ devtools driving the test

Improvements:
* devtools drives the test, not the inspected page
* tests are pure JS
* doc-typed test harness

This includes a couple sample tests to make sure this new test infra
actually works, but I don't quite yet trust it, so I'm keeping the original
release-note test for now :)

Performance (running console-clear.js x100):
TBD

BUG=667560
==========