third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py - Issue 2308283002: Allow seeding the random layout test order and write out seed.

Keyboard Shortcuts

	File
u :	up to issue
j / k :	jump to file after / before current file
J / K :	jump to next file with a comment after / before current file
	Side-by-side diff
i :	toggle intra-line diffs
e :	expand all comments
c :	collapse all comments
s :	toggle showing all comments
n / p :	next / previous diff chunk or comment
N / P :	next / previous comment
<Up> / <Down> :	next / previous line

	Issue
u :	up to list of issues
j / k :	jump to patch after / before current patch
o / <Enter> :	open current patch in side-by-side view
i :	open current patch in unified diff view

	Issue List
j / k :	jump to issue after / before current issue
o / <Enter> :	open current issue

Unified Diff: third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py

Issue 2308283002: Allow seeding the random layout test order and write out seed. (Closed)

Patch Set: Add random order seed to results file. Created 4 years, 3 months ago

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Jump to:

View side-by-side diff with in-line comments

Download patch

« no previous file with comments | « third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/models/test_run_results.py ('k') | third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests_unittest.py » ('j') | no next file with comments »
Expand Comments ('e') | Collapse Comments ('c') | Hide Comments ('s')

Index: third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py

diff --git a/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py b/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py

index 7dda2713a136d962d26d30dbdd9d047e1dc6927d..d54d120bb03717cf92ff11c1e8f684197e9566fe 100644

--- a/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py

+++ b/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py

@@ -333,12 +333,12 @@ def parse_args(args):

"--order",

action="store",

default="natural",

- help=("determine the order in which the test cases will be run. "

+ help=("Determine the order in which the test cases will be run. "

"'none' == use the order in which the tests were listed "

"either in arguments or test list, "

"'natural' == use the natural order (default), "

- "'random-seeded' == randomize the test order using a fixed seed, "

- "'random' == randomize the test order.")),

+ "'random' == pseudo-random order. Seed can be specified "

+ "via --seed, otherwise a default seed will be used.")),

optparse.make_option(

"--profile",

action="store_true",

@@ -382,6 +382,12 @@ def parse_args(args):

default=False,

help="DEPRECATED, same as --batch-size=1 --verbose"),

optparse.make_option(

+ "--seed",

+ type="int",

+ default=4, # http://xkcd.com/221/

+ help=("Seed to use for random test order (default: %default). "

+ "Only applicable in combination with --order=random.")),

+ optparse.make_option(

"--skipped",

action="store",

default=None,