gm/tests/run.sh - Issue 14187007: GM: allow caller to specify which result types trigger an error

Side by Side Diff

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Keyboard Shortcuts

	File
u :	up to issue
j / k :	jump to file after / before current file
J / K :	jump to next file with a comment after / before current file
	Side-by-side diff
i :	toggle intra-line diffs
e :	expand all comments
c :	collapse all comments
s :	toggle showing all comments
n / p :	next / previous diff chunk or comment
N / P :	next / previous comment
<Up> / <Down> :	next / previous line

	Issue
u :	up to list of issues
j / k :	jump to patch after / before current patch
o / <Enter> :	open current patch in side-by-side view
i :	open current patch in unified diff view

	Issue List
j / k :	jump to issue after / before current issue
o / <Enter> :	open current issue

Side by Side Diff: gm/tests/run.sh

Issue 14187007: GM: allow caller to specify which result types trigger an error (Closed) Base URL: http://skia.googlecode.com/svn/trunk/

Patch Set: sync_to_r8651 Created 7 years, 8 months ago

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Jump to:

View unified diff | Download patch | Annotate | Revision Log

« no previous file with comments | « gm/tests/outputs/ignore-expectations-mismatch/output-expected/stdout ('k') | no next file » | no next file with comments »

OLD	NEW
1 #!/bin/bash	1 #!/bin/bash

2	2

3 # Self-tests for gm, based on tools/tests/run.sh	3 # Self-tests for gm, based on tools/tests/run.sh

4 #	4 #

5 # These tests are run by the Skia_PerCommit_House_Keeping bot at every commit,	5 # These tests are run by the Skia_PerCommit_House_Keeping bot at every commit,

6 # so make sure that they still pass when you make changes to gm!	6 # so make sure that they still pass when you make changes to gm!

7 #	7 #

8 # To generate new baselines when gm behavior changes, run gm/tests/rebaseline.sh	8 # To generate new baselines when gm behavior changes, run gm/tests/rebaseline.sh

9 #	9 #

10 # TODO: because this is written as a shell script (instead of, say, Python)	10 # TODO: because this is written as a shell script (instead of, say, Python)

(...skipping 147 matching lines...) Expand 10 before \| Expand all \| Expand 10 after Loading...
158 # actual checksums marked as "failure-ignored", but the "expected-results"	158 # actual checksums marked as "failure-ignored", but the "expected-results"

159 # section should be empty.	159 # section should be empty.

160 gm_test "--verbose --hierarchy --match selftest1 $CONFIGS" "$GM_OUTPUTS/no-readp ath"	160 gm_test "--verbose --hierarchy --match selftest1 $CONFIGS" "$GM_OUTPUTS/no-readp ath"

161	161

162 # Test what happens if a subset of the renderModes fail (e.g. pipe)	162 # Test what happens if a subset of the renderModes fail (e.g. pipe)

163 gm_test "--simulatePipePlaybackFailure --verbose --hierarchy --match selftest1 $ CONFIGS -r $GM_INPUTS/json/identical-pixels.json" "$GM_OUTPUTS/pipe-playback-fai lure"	163 gm_test "--simulatePipePlaybackFailure --verbose --hierarchy --match selftest1 $ CONFIGS -r $GM_INPUTS/json/identical-pixels.json" "$GM_OUTPUTS/pipe-playback-fai lure"

164	164

165 # Confirm that IntentionallySkipped tests are recorded as such.	165 # Confirm that IntentionallySkipped tests are recorded as such.

166 gm_test "--verbose --hierarchy --match selftest1 selftest2 $CONFIGS" "$GM_OUTPUT S/intentionally-skipped-tests"	166 gm_test "--verbose --hierarchy --match selftest1 selftest2 $CONFIGS" "$GM_OUTPUT S/intentionally-skipped-tests"

167	167

	168 # Ignore some error types (including ExpectationsMismatch)

	169 gm_test "--ignoreErrorTypes ExpectationsMismatch NoGpuContext --verbose --hierar chy --match selftest1 $CONFIGS -r $GM_INPUTS/json/different-pixels.json" "$GM_OU TPUTS/ignore-expectations-mismatch"

	170

168 echo "All tests passed."	171 echo "All tests passed."

OLD	NEW