[Findit] Using ts_mon to track swarming/isolated server outages

appengine/findit/waterfall/monitoring.py

Index: appengine/findit/waterfall/monitoring.py
diff --git a/appengine/findit/waterfall/monitoring.py b/appengine/findit/waterfall/monitoring.py
index 591a9b1e333ca83da123c6571c0c24694cad25b4..1fb0d1436bb27c2a2fa4e045c05109fdfbbbcc91 100644
--- a/appengine/findit/waterfall/monitoring.py
+++ b/appengine/findit/waterfall/monitoring.py
@@ -7,6 +7,14 @@ import gae_ts_mon
 swarming_tasks = gae_ts_mon.CounterMetric(
     'findit/swarmingtasks', description='Swarming tasks triggered')
 
+swarming_server_failures = gae_ts_mon.CounterMetric(
+    'findit/swarmingserverfailures',

[stgao, 2016/12/01 22:25:15]

Maybe unify these two metrics as 'findit/httperrors', and use a field called
host for different server like Swarming, Isolate, buildbot, etc.

[lijeffrey, 2016/12/01 22:54:34]

Done.

+    description='Failed remote calls to swarming server')
+
+isolated_server_failures = gae_ts_mon.CounterMetric(
+    'findit/isolatedserverfailures',
+    description='Failed remote calls to isolated server')
+
 issues = gae_ts_mon.CounterMetric(
     'findit/issues', description='Bugs updated with findings')