Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(291)

Side by Side Diff: appengine/isolate/doc/Design.md

Issue 2484133002: luci-py/isolateserver.py: Add support for tar archives when downloading. (Closed) Base URL: https://github.com/luci/luci-py.git@master
Patch Set: Rebase onto master. Created 4 years, 1 month ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
« no previous file with comments | « no previous file | client/isolated_format.py » ('j') | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 # Isolated Server 1 # Isolated Server
2 2
3 High performance Infrastructure to run an executable with all its dependencies 3 High performance Infrastructure to run an executable with all its dependencies
4 mapped in. 4 mapped in.
5 5
6 **One line description:** How to push 10000 files worth 2Gb in total to tens of 6 **One line description:** How to push 10000 files worth 2Gb in total to tens of
7 bots within a few seconds, *even on Windows or Android*. 7 bots within a few seconds, *even on Windows or Android*.
8 8
9 9
10 ## Objective 10 ## Objective
(...skipping 115 matching lines...) Expand 10 before | Expand all | Expand 10 after
126 will be eventually enforced. 126 will be eventually enforced.
127 - `relative_cwd`: relative directory inside the temporary directory tree when 127 - `relative_cwd`: relative directory inside the temporary directory tree when
128 the command should be executed from. 128 the command should be executed from.
129 - `version`: version of the file format. Increment the minor version for non 129 - `version`: version of the file format. Increment the minor version for non
130 breaking changes and the major version if code written for a previous 130 breaking changes and the major version if code written for a previous
131 version shouldn't be able to parse it. 131 version shouldn't be able to parse it.
132 132
133 133
134 ##### File types 134 ##### File types
135 135
136 There are two file types; 136 There are the following file types;
137 - `basic`: All normal files, the default type. 137 - `basic`: All normal files, the default type.
138 - `ar`: An [ar](https://en.wikipedia.org/wiki/Ar_(Unix)) archive containing a 138 - `ar`: An [ar](https://en.wikipedia.org/wiki/Ar_(Unix)) archive containing a
139 large number of small files. 139 large number of small files.
140 - `tar`: An [tar](https://en.wikipedia.org/wiki/Tar_(Unix)) archive
141 containing a large number of small files.
140 142
141 143
142 #### Arbitrary split vs recursive trees 144 #### Arbitrary split vs recursive trees
143 145
144 The `.isolated` format supports the `includes` key to split and merge back list 146 The `.isolated` format supports the `includes` key to split and merge back list
145 of files in separate `.isolated` files. It is in stark contrast with more 147 of files in separate `.isolated` files. It is in stark contrast with more
146 traditional tree of trees structure like the git tree object rooted to a git 148 traditional tree of trees structure like the git tree object rooted to a git
147 commit object. 149 commit object.
148 150
149 The reason is to leave a lot of room to the tool generating the `.isolated` 151 The reason is to leave a lot of room to the tool generating the `.isolated`
(...skipping 223 matching lines...) Expand 10 before | Expand all | Expand 10 after
373 375
374 ## Testing Plan 376 ## Testing Plan
375 377
376 - The isolate server code is unit, smoke and canary tested. Since most of the 378 - The isolate server code is unit, smoke and canary tested. Since most of the
377 isolate server code is OS-independent and written in python, testing is 379 isolate server code is OS-independent and written in python, testing is
378 relatively easy. 380 relatively easy.
379 - Support for hardlinks, symlinks and native path case need OS-specific code 381 - Support for hardlinks, symlinks and native path case need OS-specific code
380 which can be tested itself on Swarming to get coverage across OSes. 382 which can be tested itself on Swarming to get coverage across OSes.
381 - A canary Continuous Integration master is run by the chromium team at 383 - A canary Continuous Integration master is run by the chromium team at
382 http://build.chromium.org/p/chromium.swarm/waterfall. 384 http://build.chromium.org/p/chromium.swarm/waterfall.
OLDNEW
« no previous file with comments | « no previous file | client/isolated_format.py » ('j') | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698