Add verification to downloaded files

download_from_google_storage.py

Index: download_from_google_storage.py
diff --git a/download_from_google_storage.py b/download_from_google_storage.py
index a45f387ce2aeb3a2d9f8f820206ff8e597eb1e5c..a05287619fa4de61a747ba320e988f7dbd709ed6 100755
--- a/download_from_google_storage.py
+++ b/download_from_google_storage.py
@@ -227,6 +227,13 @@ def _downloader_worker_thread(thread_num, q, force, base_url,
     if code != 0:
       out_q.put('%d> %s' % (thread_num, err))
       ret_codes.put((code, err))

[Vadim Sh., 2015/07/29 20:43:49]

is it ok that there's no "continue" after this line? IIUC, its a failure to
download the file.

[Ryan Tseng, 2015/07/29 20:51:24]

Good catch there should be a continue here.  I think the lack thereof is due to
this being the final point in the loop before the executable bit stuff was
added.

+    remote_sha1 = get_sha1(output_filename)
+    if remote_sha1 != input_sha1_sum:
+      msg = ('%d> ERROR remote sha1 (%s) does not match expected sha1 (%s).' %
+             (thread_num, remote_sha1, input_sha1_sum))
+      out_q.put(msg)
+      ret_codes.put((20, msg))
+      continue
 
     # Set executable bit.
     if sys.platform == 'cygwin':