gm/tests/run.sh - Issue 13650002: gm: report ExpectationsMismatch and RenderModeMismatch results separately

Side by Side Diff

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Keyboard Shortcuts

	File
u :	up to issue
j / k :	jump to file after / before current file
J / K :	jump to next file with a comment after / before current file
	Side-by-side diff
i :	toggle intra-line diffs
e :	expand all comments
c :	collapse all comments
s :	toggle showing all comments
n / p :	next / previous diff chunk or comment
N / P :	next / previous comment
<Up> / <Down> :	next / previous line

	Issue
u :	up to list of issues
j / k :	jump to patch after / before current patch
o / <Enter> :	open current patch in side-by-side view
i :	open current patch in unified diff view

	Issue List
j / k :	jump to issue after / before current issue
o / <Enter> :	open current issue

Side by Side Diff: gm/tests/run.sh

Issue 13650002: gm: report ExpectationsMismatch and RenderModeMismatch results separately (Closed) Base URL: http://skia.googlecode.com/svn/trunk/

Patch Set: record_RenderModeMismatch_separately Created 7 years, 8 months ago

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Jump to:

View unified diff | Download patch | Annotate | Revision Log

« gm/tests/outputs/pipe-playback-failure/output-expected/stdout ('K') | « gm/tests/outputs/pipe-playback-failure/output-expected/stdout ('k') | no next file » | no next file with comments »

OLD	NEW
1 #!/bin/bash	1 #!/bin/bash

2	2

3 # Self-tests for gm, based on tools/tests/run.sh	3 # Self-tests for gm, based on tools/tests/run.sh

4 #	4 #

5 # These tests are run by the Skia_PerCommit_House_Keeping bot at every commit,	5 # These tests are run by the Skia_PerCommit_House_Keeping bot at every commit,

6 # so make sure that they still pass when you make changes to gm!	6 # so make sure that they still pass when you make changes to gm!

7 #	7 #

8 # To generate new baselines when gm behavior changes, run gm/tests/rebaseline.sh	8 # To generate new baselines when gm behavior changes, run gm/tests/rebaseline.sh

9 #	9 #

10 # TODO: because this is written as a shell script (instead of, say, Python)	10 # TODO: because this is written as a shell script (instead of, say, Python)

(...skipping 138 matching lines...) Expand 10 before \| Expand all \| Expand 10 after Loading...
149 gm_test "--hierarchy --match selftest1 $CONFIGS -r $GM_INPUTS/json/different-pix els.json" "$GM_OUTPUTS/compared-against-different-pixels-json"	149 gm_test "--hierarchy --match selftest1 $CONFIGS -r $GM_INPUTS/json/different-pix els.json" "$GM_OUTPUTS/compared-against-different-pixels-json"

150	150

151 # Compare generated image against an empty "expected image" dir.	151 # Compare generated image against an empty "expected image" dir.

152 gm_test "--hierarchy --match selftest1 $CONFIGS -r $GM_INPUTS/images/empty-dir" "$GM_OUTPUTS/compared-against-empty-dir"	152 gm_test "--hierarchy --match selftest1 $CONFIGS -r $GM_INPUTS/images/empty-dir" "$GM_OUTPUTS/compared-against-empty-dir"

153	153

154 # If run without "-r", the JSON's "actual-results" section should contain	154 # If run without "-r", the JSON's "actual-results" section should contain

155 # actual checksums marked as "failure-ignored", but the "expected-results"	155 # actual checksums marked as "failure-ignored", but the "expected-results"

156 # section should be empty.	156 # section should be empty.

157 gm_test "--hierarchy --match selftest1 $CONFIGS" "$GM_OUTPUTS/no-readpath"	157 gm_test "--hierarchy --match selftest1 $CONFIGS" "$GM_OUTPUTS/no-readpath"

158	158

	159 # Test what happens if a subset of the renderModes fail (e.g. pipe)

	160 gm_test "--simulatePipePlaybackFailure --hierarchy --match selftest1 $CONFIGS -r $GM_INPUTS/json/identical-pixels.json" "$GM_OUTPUTS/pipe-playback-failure"

	161

159 echo "All tests passed."	162 echo "All tests passed."

OLD	NEW