Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(13)

Issue 2670003006: Revert of Dashboard - Remove pre-hook logic from alert.py. (Closed)

Created:
3 years, 10 months ago by shatch
Modified:
3 years, 10 months ago
Reviewers:
sullivan
CC:
catapult-reviews_chromium.org, perf-dashboard-reviews_chromium.org, eakuefner
Target Ref:
refs/heads/master
Project:
catapult
Visibility:
Public.

Description

Revert of Dashboard - Remove pre-hook logic from alert.py. (patchset #2 id:240001 of https://codereview.chromium.org/2650683007/ ) Reason for revert: Fixing flakey test. Original issue's description: > Previously alert.py has some pre-hook logic to update associated groups. This involved several sync gets + query, with some potential puts and deletes. The newer implementation strips the pre-hook out in favour of heavily batching async calls when alerts are updated. > > So ran through StackDriver re-triaging a bug with 53 alerts (did the new one first so that any memcache boosts would benefit the old one not the new one), gathered these timings: > > Demo: https://dev-simonhatch-66cc9519-dot-chromeperf.appspot.com/ > > Old: > > @479 ms > https://monorail-prod.appspot.com/_ah/api/monorail/v1/projects/chromium/issues?alt=json&sendEmail=true > > <Modify Alerts> > > @10,430 ms > https://monorail-prod.appspot.com/_ah/api/monorail/v1/projects/chromium/issues/685469/comments?alt=json&sendEmail=true > > @11,354 ms > https://cr-buildbucket.appspot.com/api/discovery/v1/apis/buildbucket/v1/rest?userIp=2620%3A0%3A1000%3A1409%3A4c33%3Ac669%3A2634%3Af3bd > > > New: > > @770 ms > https://monorail-prod.appspot.com/_ah/api/monorail/v1/projects/chromium/issues?alt=json&sendEmail=true > > <Modify Alerts> > > @2,072 ms > https://monorail-prod.appspot.com/_ah/api/monorail/v1/projects/chromium/issues/685468/comments?alt=json&sendEmail=true > > @3,121 ms > https://cr-buildbucket.appspot.com/api/discovery/v1/apis/buildbucket/v1/rest?userIp=2620%3A0%3A1000%3A1409%3A4c33%3Ac669%3A2634%3Af3bd > > > This would put the old implementation at about 9951 ms vs 1302 ms in this particular run if I'm understanding these traces correctly. > > Could probably make some of these endpoints faster by returning futures from alert_group.ModifyAlertsAndAssociatedGroups() and weaving in with the surrounding functions (like in /file_bug we could theoretically async the issue_tracker stuff). > > Also might want to file an issue after to refactor some of this Alert/AlertGroup code. Seems a bit brittle that you have these associated groups that need to be updated whenever attributes on an alert are modified. > > BUG=catapult:#2771 > > Review-Url: https://codereview.chromium.org/2650683007 > Committed: https://chromium.googlesource.com/external/github.com/catapult-project/catapult/+/20c5e0b31c76cfbcf8ee0f629fe4c3069367f3c4 TBR=sullivan@chromium.org # Skipping CQ checks because original CL landed less than 1 days ago. NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=catapult:#2771 Review-Url: https://codereview.chromium.org/2670003006 Committed: https://chromium.googlesource.com/external/github.com/catapult-project/catapult/+/4cc1200e5d9563db853de9a82ff7dc176aa95484

Patch Set 1 #

Unified diffs Side-by-side diffs Delta from patch set Stats (+127 lines, -209 lines) Patch
M dashboard/dashboard/associate_alerts.py View 2 chunks +3 lines, -2 lines 0 comments Download
M dashboard/dashboard/edit_anomalies.py View 4 chunks +19 lines, -16 lines 0 comments Download
M dashboard/dashboard/file_bug.py View 2 chunks +3 lines, -3 lines 0 comments Download
M dashboard/dashboard/models/alert.py View 1 chunk +82 lines, -0 lines 0 comments Download
M dashboard/dashboard/models/alert_group.py View 1 chunk +1 line, -121 lines 0 comments Download
M dashboard/dashboard/models/alert_group_test.py View 5 chunks +16 lines, -63 lines 0 comments Download
M dashboard/dashboard/update_bug_with_results.py View 2 chunks +3 lines, -4 lines 0 comments Download

Messages

Total messages: 6 (3 generated)
shatch
Created Revert of Dashboard - Remove pre-hook logic from alert.py.
3 years, 10 months ago (2017-02-03 16:57:46 UTC) #2
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.org/2670003006/1
3 years, 10 months ago (2017-02-03 16:57:49 UTC) #3
commit-bot: I haz the power
3 years, 10 months ago (2017-02-03 16:57:59 UTC) #6
Message was sent while issue was closed.
Committed patchset #1 (id:1) as
https://chromium.googlesource.com/external/github.com/catapult-project/catapu...

Powered by Google App Engine
This is Rietveld 408576698