Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(42)

Issue 1974453003: Improve the toolchains-hash calculation. (Closed)

Created:
4 years, 7 months ago by Sébastien Marchand
Modified:
4 years, 5 months ago
Reviewers:
Nico, scottmg, brucedawson
CC:
chromium-reviews, dpranke+depot_tools_chromium.org, iannucci+depot_tools_chromium.org
Base URL:
https://chromium.googlesource.com/chromium/tools/depot_tools.git@master
Target Ref:
refs/heads/master
Visibility:
Public.

Description

Improve the toolchains-hash calculation. I often ends up with a corrupt toolchain because I've used Windbg and there's now a bunch of PDB files in win_sdk/Debuggers/sym/... , I think that it's safe to ignore these files (the original package doesn't contain any of these files). It's also useful to have more details about which files are missing and or which ones shouldn't be here when we get an invalid toolchain hash. Finally, if you the hash of a toolchain doesn't correspond to the name of its root directory then it should be removed. Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=300557

Patch Set 1 #

Total comments: 6

Patch Set 2 : Address Scott's comments. #

Total comments: 5
Unified diffs Side-by-side diffs Delta from patch set Stats (+43 lines, -8 lines) Patch
M win_toolchain/get_toolchain_if_necessary.py View 1 5 chunks +43 lines, -8 lines 5 comments Download

Messages

Total messages: 27 (7 generated)
Sébastien Marchand
PTAL.
4 years, 7 months ago (2016-05-11 18:55:28 UTC) #4
scottmg
https://codereview.chromium.org/1974453003/diff/1/win_toolchain/get_toolchain_if_necessary.py File win_toolchain/get_toolchain_if_necessary.py (right): https://codereview.chromium.org/1974453003/diff/1/win_toolchain/get_toolchain_if_necessary.py#newcode79 win_toolchain/get_toolchain_if_necessary.py:79: ignored_directories = ['wer\\reportqueue', Does this intentionally not have a ...
4 years, 7 months ago (2016-05-11 19:21:36 UTC) #5
Sébastien Marchand
Thanks, PTAnL. https://codereview.chromium.org/1974453003/diff/1/win_toolchain/get_toolchain_if_necessary.py File win_toolchain/get_toolchain_if_necessary.py (right): https://codereview.chromium.org/1974453003/diff/1/win_toolchain/get_toolchain_if_necessary.py#newcode79 win_toolchain/get_toolchain_if_necessary.py:79: ignored_directories = ['wer\\reportqueue', On 2016/05/11 19:21:36, scottmg ...
4 years, 7 months ago (2016-05-11 19:59:50 UTC) #7
scottmg
lgtm
4 years, 7 months ago (2016-05-11 21:03:55 UTC) #8
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1974453003/40001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1974453003/40001
4 years, 7 months ago (2016-05-12 14:24:19 UTC) #10
commit-bot: I haz the power
Committed patchset #2 (id:40001) as http://src.chromium.org/viewvc/chrome?view=rev&revision=300557
4 years, 7 months ago (2016-05-12 14:27:55 UTC) #12
Nico
https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py File win_toolchain/get_toolchain_if_necessary.py (right): https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py#newcode81 win_toolchain/get_toolchain_if_necessary.py:81: 'win_sdk\\debuggers\\x64\\sym\\'] this won't work on non-windows. it looks like ...
4 years, 6 months ago (2016-05-27 14:45:57 UTC) #14
Sébastien Marchand
https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py File win_toolchain/get_toolchain_if_necessary.py (right): https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py#newcode81 win_toolchain/get_toolchain_if_necessary.py:81: 'win_sdk\\debuggers\\x64\\sym\\'] On 2016/05/27 14:45:57, Nico (away until Tue May ...
4 years, 6 months ago (2016-05-27 15:16:22 UTC) #15
Nico
On 2016/05/27 15:16:22, Sébastien Marchand wrote: > https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py > File win_toolchain/get_toolchain_if_necessary.py (right): > > https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py#newcode81 ...
4 years, 6 months ago (2016-05-27 15:36:28 UTC) #16
Nico
https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py File win_toolchain/get_toolchain_if_necessary.py (right): https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py#newcode133 win_toolchain/get_toolchain_if_necessary.py:133: # missing. On my windows box, this just spent ...
4 years, 6 months ago (2016-06-22 15:09:11 UTC) #17
scottmg
On 2016/06/22 15:09:11, Nico wrote: > https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py > File win_toolchain/get_toolchain_if_necessary.py (right): > > https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py#newcode133 > ...
4 years, 6 months ago (2016-06-22 17:49:01 UTC) #18
Nico
On 2016/06/22 17:49:01, scottmg wrote: > On 2016/06/22 15:09:11, Nico wrote: > > > https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py ...
4 years, 6 months ago (2016-06-22 17:50:55 UTC) #19
brucedawson
Those are files that are supposed to be there, FWIW. So missing files presumably. I ...
4 years, 6 months ago (2016-06-22 17:59:01 UTC) #20
Sébastien Marchand
Sorry for that, I'll only display the 10 first extra/missing files !
4 years, 6 months ago (2016-06-22 18:02:41 UTC) #21
scottmg
On 2016/06/22 17:50:55, Nico wrote: > On 2016/06/22 17:49:01, scottmg wrote: > > On 2016/06/22 ...
4 years, 6 months ago (2016-06-22 18:09:31 UTC) #22
Sébastien Marchand
I don't think that we should log to a file, if you get more than ...
4 years, 6 months ago (2016-06-22 18:16:50 UTC) #23
Sébastien Marchand
FYI, this is fixed by https://codereview.chromium.org/2092753003/
4 years, 6 months ago (2016-06-23 17:44:23 UTC) #24
Nico
https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py File win_toolchain/get_toolchain_if_necessary.py (right): https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py#newcode175 win_toolchain/get_toolchain_if_necessary.py:175: if toolchain_hash != d: Do you really want to ...
4 years, 5 months ago (2016-07-08 14:38:30 UTC) #25
Sébastien Marchand
https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py File win_toolchain/get_toolchain_if_necessary.py (right): https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolchain_if_necessary.py#newcode175 win_toolchain/get_toolchain_if_necessary.py:175: if toolchain_hash != d: On 2016/07/08 14:38:30, Nico wrote: ...
4 years, 5 months ago (2016-07-08 14:44:22 UTC) #26
Nico
4 years, 5 months ago (2016-07-08 14:48:43 UTC) #27
Message was sent while issue was closed.
Ah ok. Thanks for explaining!

On Fri, Jul 8, 2016 at 10:44 AM, sebmarchand@chromium.org via
codereview.chromium.org <reply@chromiumcodereview-hr.appspotmail.com> wrote:

>
>
>
https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolc...
> File win_toolchain/get_toolchain_if_necessary.py (right):
>
>
>
https://codereview.chromium.org/1974453003/diff/40001/win_toolchain/get_toolc...
> win_toolchain/get_toolchain_if_necessary.py:175: if toolchain_hash != d:
> On 2016/07/08 14:38:30, Nico wrote:
> > Do you really want to compare toolchain_hash and d here? On My linux
> box, I got
> > several lines like
> >
> > Calculating hash of toolchain in vs_files/DIA SDK. Please wait...
> > The hash of a version of the toolchain has an unexpected value
> > (5b9fe12411cc48404db2dcdfdef641f1bc213804 instead of DIA SDK),
> removing it.
> >
> > It happened only once when an update was indeed necessary, but
> "5b9fe..." and
> > "DIA SDK" look like strings with different types.
>
> It's not a bug, it's a feature :). In the past it wasn't possible to
> keep several versions of the toolchain at the same time, so the
> win_toolchain directory structure looked like this:
>
> win_toolchain/vs_files/DIA_SDK
> |win_sdk
> |...
>
> Now each version of the toolchain is kept in a different subdirectory:
>
> win_toolchain/vs_files/{hash}/DIA_SDK
> |win_sdk
> |...
>
> So the original copy of the toolchain (the one directly in vs_files/)
> will look corrupt and each of these directory will get removed.
>
> It should only happen once.
>
> https://codereview.chromium.org/1974453003/
>

-- 
You received this message because you are subscribed to the Google Groups
"Chromium-reviews" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to chromium-reviews+unsubscribe@chromium.org.

Powered by Google App Engine
This is Rietveld 408576698