Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(621)

Side by Side Diff: gm/rebaseline_server/compare_to_expectations.py

Issue 270413002: rebaseline_server JSON: pass category values as values, not keys (Closed) Base URL: https://skia.googlesource.com/skia.git@master
Patch Set: rebase Created 6 years, 7 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
« no previous file with comments | « gm/rebaseline_server/column.py ('k') | gm/rebaseline_server/imagepairset.py » ('j') | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 #!/usr/bin/python 1 #!/usr/bin/python
2 2
3 """ 3 """
4 Copyright 2013 Google Inc. 4 Copyright 2013 Google Inc.
5 5
6 Use of this source code is governed by a BSD-style license that can be 6 Use of this source code is governed by a BSD-style license that can be
7 found in the LICENSE file. 7 found in the LICENSE file.
8 8
9 Repackage expected/actual GM results as needed by our HTML rebaseline viewer. 9 Repackage expected/actual GM results as needed by our HTML rebaseline viewer.
10 """ 10 """
(...skipping 298 matching lines...) Expand 10 before | Expand all | Expand 10 after
309 # from the most recent actuals). Treat these as successes 309 # from the most recent actuals). Treat these as successes
310 # instead of failures. 310 # instead of failures.
311 # 311 #
312 # TODO(epoger): Do we need to do something similar in 312 # TODO(epoger): Do we need to do something similar in
313 # other cases, such as when we have recently marked a test 313 # other cases, such as when we have recently marked a test
314 # as ignoreFailure but it still shows up in the 'failed' 314 # as ignoreFailure but it still shows up in the 'failed'
315 # category? Maybe we should not rely on the result_type 315 # category? Maybe we should not rely on the result_type
316 # categories recorded within the gm_actuals AT ALL, and 316 # categories recorded within the gm_actuals AT ALL, and
317 # instead evaluate the result_type ourselves based on what 317 # instead evaluate the result_type ourselves based on what
318 # we see in expectations vs actual checksum? 318 # we see in expectations vs actual checksum?
319 # See related http://skbug.com/2514 ('rebaseline_server: apply
320 # ignored-tests.txt within rebaseline_server, not just on the bots')
319 if expected_image_relative_url == actual_image_relative_url: 321 if expected_image_relative_url == actual_image_relative_url:
320 updated_result_type = results.KEY__RESULT_TYPE__SUCCEEDED 322 updated_result_type = results.KEY__RESULT_TYPE__SUCCEEDED
321 else: 323 else:
322 updated_result_type = result_type 324 updated_result_type = result_type
323 extra_columns_dict = { 325 extra_columns_dict = {
324 results.KEY__EXTRACOLUMN__RESULT_TYPE: updated_result_type, 326 results.KEY__EXTRACOLUMN__RESULT_TYPE: updated_result_type,
325 results.KEY__EXTRACOLUMN__BUILDER: builder, 327 results.KEY__EXTRACOLUMN__BUILDER: builder,
326 results.KEY__EXTRACOLUMN__TEST: test, 328 results.KEY__EXTRACOLUMN__TEST: test,
327 results.KEY__EXTRACOLUMN__CONFIG: config, 329 results.KEY__EXTRACOLUMN__CONFIG: config,
328 } 330 }
(...skipping 47 matching lines...) Expand 10 before | Expand all | Expand 10 after
376 results_obj = ExpectationComparisons(actuals_root=args.actuals, 378 results_obj = ExpectationComparisons(actuals_root=args.actuals,
377 expected_root=args.expectations, 379 expected_root=args.expectations,
378 generated_images_root=args.workdir) 380 generated_images_root=args.workdir)
379 gm_json.WriteToFile( 381 gm_json.WriteToFile(
380 results_obj.get_packaged_results_of_type(results_type=args.results), 382 results_obj.get_packaged_results_of_type(results_type=args.results),
381 args.outfile) 383 args.outfile)
382 384
383 385
384 if __name__ == '__main__': 386 if __name__ == '__main__':
385 main() 387 main()
OLDNEW
« no previous file with comments | « gm/rebaseline_server/column.py ('k') | gm/rebaseline_server/imagepairset.py » ('j') | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698