Add image-first-tests flag to run-webkit-tests

third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py

Index: third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py
diff --git a/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py b/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py
index d4f23c97edff3740910097040dc7ee8b82df47fb..8ba82917b926bcc9155634aea1a760ea140dc648 100644
--- a/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py
+++ b/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py
@@ -235,6 +235,15 @@ def parse_args(args):
                 dest='smoke',
                 action='store_false',
                 help='Do not run just the SmokeTests'),
+            optparse.make_option(
+                '--image-first-tests',
+                action='append',
+                default=[],
+                dest='image_first_tests',
+                help='directories or test that will be only checked for image'
+                ' expectation if it\'s available and fall back to test '
+                'expectation if image expectation is missing (may specify '
+                'multiple times)'),

[qyearsley, 2017/03/21 22:44:09]

This help text could probably be made a bit clearer. Does it sound correct to
say:
"A directory (or test) where the test result will only be compared with the
image baseline if an image baseline is available, and fall back to comparison
with the text baseline when image baselines are missing. Specify multiple times
to add multiple directories." 

Since this argument is sort of parallel to --pixel-test-directory, you could
also change the option name and dest etc. to be more like
--pixel-test-directory.

            optparse.make_option(
                '--image-first-directory',
                action='append',
                default=[],
                dest='image_first_directories',
                help=('A directory (or test) where the test result will '
                      'only be compared with the image baseline if an image '
                      'baseline is available, and fall back to comparison '
                      'with the text baseline when image baselines are missing.
'
                      'Specify multiple times to add multiple directories.')),

         ]))
 
     option_group_definitions.append(