[Findit] Modify tryjob pipelines to trigger try jobs for test failure.

appengine/findit/waterfall/try_job_result_format.md

Index: appengine/findit/waterfall/try_job_result_format.md
diff --git a/appengine/findit/waterfall/try_job_result_format.md b/appengine/findit/waterfall/try_job_result_format.md
new file mode 100644
index 0000000000000000000000000000000000000000..e927a3425f04f6a8e29dbfe0d7b93096e61a3658
--- /dev/null
+++ b/appengine/findit/waterfall/try_job_result_format.md
@@ -0,0 +1,143 @@
+# The format for recipe result for compile failures is:
+{
+    'report': {
+        'result': {
+            'rev1': 'passed',
+            'rev2': 'failed'
+        }
+    }
+}
+

[qyearsley, 2016/02/03 18:55:14]

It's very nice to have a document describing the format like this, although I
think it can be improved.

When this md file is converted to HTML for viewing, the examples will only be
displayed in "code block" style if they are indented one more level:


The format for recipe result for compile failures is:

    {
        'report': {
            'result': {
                'rev1': 'passed',
                'rev2': 'failed'
            }
        }
    }


Also, # Indicates a top-level header. You can see roughly how this document will
look when converted to HTML by using tools like http://dillinger.io/.

[chanli, 2016/02/03 23:44:13]

Yes. It does look much better now. Thank you : )

+
+# The format for final try-job result for compile failures saved in WfTryJob.compile_results is:
+[
+    {
+        'report': {
+            'result': {
+                'rev1': 'passed',
+                'rev2': 'failed'
+            }
+        },
+        'url': 'url',
+        'try_job_id': '1',
+        'culprit': {
+            'revision': 'rev2',
+            'commit_position': '2',
+            'review_url': 'url_2'
+        }
+    },
+    ...
+]
+
+
+# The format for recipe result for test failures is:
+# TODO(chanli): update the format after the changes on test recipe.
+'result': {
+    'rev1': {
+        'a_test': {
+            'status': 'failed',
+            'valid': True,
+            'failures': ['a_test1']
+        },
+        'b_test': {
+            'status': 'failed',
+            'valid': True,
+            'failures': ['b_test1']
+        },
+        'c_test': {
+            'status': 'passed',
+            'valid': True
+        }
+    },
+    'rev2': {
+        'a_test': {
+            'status': 'failed',
+            'valid': True,
+            'failures': ['a_test1', 'a_test2']
+        },
+        'b_test': {
+            'status': 'passed',
+            'valid': True
+        },
+        'c_test': {
+            'status': 'failed',
+            'valid': True,
+            'failures': []
+        }
+    }
+}
+
+
+# The format for final try-job result for test failures saved in WfTryJob.test_results is:
+[
+    {
+        'result': {
+            'rev1': {
+                'a_test': {
+                    'status': 'failed',
+                    'valid': True,
+                    'failures': ['a_test1']
+                },
+                'b_test': {
+                    'status': 'failed',
+                    'valid': True,
+                    'failures': ['b_test1']
+                },
+                'c_test': {
+                    'status': 'passed',
+                    'valid': True
+                }
+            },
+            'rev2': {
+                'a_test': {
+                    'status': 'failed',
+                    'valid': True,
+                    'failures': ['a_test1', 'a_test2']
+                },
+                'b_test': {
+                    'status': 'passed',
+                    'valid': True
+                },
+                'c_test': {
+                    'status': 'failed',
+                    'valid': True,
+                    'failures': []
+                }
+            }
+        },
+        'url': 'url',
+        'try_job_id': '1',
+        'culprit': {
+            'a_test': {
+                'tests': {
+                    'a_test1': {
+                      'revision': 'rev1',
+                      'commit_position': '1',
+                      'review_url': 'url_1'
+                    },
+                    'a_test2': {
+                      'revision': 'rev2',
+                      'commit_position': '2',
+                      'review_url': 'url_2'
+                    }
+                }
+            },
+            'b_test': {
+                'tests': {
+                    'b_test1': {
+                      'revision': 'rev1',
+                      'commit_position': '1',
+                      'review_url': 'url_1'
+                    }
+                }
+            },
+            'c_test': {
+                'revision': 'rev2',
+                'commit_position': '2',
+                'review_url': 'url_2',
+                'tests': {}
+            }
+        }
+    },
+    ...
+}