Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(203)

Issues Search
    My Issues | Starred     Open | Closed | All

Side by Side Diff: mojo/tools/data/rtt_benchmarks

Issue 1414353006: Define measurements as a tuple of name and spec. (Closed) Base URL: git@github.com:domokit/mojo.git@master
Patch Set: Created 5 years, 1 month ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
« no previous file with comments | « mojo/tools/data/benchmarks ('k') | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 # This file contains a list of Mojo benchmarks. For description of the file 1 # This file contains a list of Mojo benchmarks. For description of the file
2 # format, see `mojo_benchmark --help`. 2 # format, see `mojo_benchmark --help`.
3 3
4 benchmarks = [ 4 benchmarks = [
5 { 5 {
6 'name': 'C++ <=> C++ IPC Round Trip Time', 6 'name': 'C++ <=> C++ IPC Round Trip Time',
7 'app': 'https://core.mojoapps.io/echo_benchmark.mojo', 7 'app': 'https://core.mojoapps.io/echo_benchmark.mojo',
8 'duration': 10, 8 'duration': 10,
9 'measurements': [ 9 'measurements': [
10 'avg_duration/echo_benchmark/ping', 10 {'name': 'avg ping', 'spec': 'avg_duration/echo_benchmark/ping'},
11 'percentile_duration/echo_benchmark/ping/0.10', 11 {'name': '10th percentile ping', 'spec': 'percentile_duration/echo_benchma rk/ping/0.10'},
12 'percentile_duration/echo_benchmark/ping/0.50', 12 {'name': '50th percentile ping', 'spec': 'percentile_duration/echo_benchma rk/ping/0.50'},
13 'percentile_duration/echo_benchmark/ping/0.90', 13 {'name': '90th percentile ping', 'spec': 'percentile_duration/echo_benchma rk/ping/0.90'},
14 ], 14 ],
15 'shell-args': [ 15 'shell-args': [
16 '--args-for=https://core.mojoapps.io/echo_benchmark.mojo --early-tracing', 16 '--args-for=https://core.mojoapps.io/echo_benchmark.mojo --early-tracing',
17 ] 17 ]
18 }, 18 },
19 { 19 {
20 'name': 'C++ <=> Dart IPC Round Trip Time', 20 'name': 'C++ <=> Dart IPC Round Trip Time',
21 'app': 'https://core.mojoapps.io/echo_benchmark.mojo', 21 'app': 'https://core.mojoapps.io/echo_benchmark.mojo',
22 'duration': 10, 22 'duration': 10,
23 'measurements': [ 23 'measurements': [
24 'avg_duration/echo_benchmark/ping', 24 {'name': 'avg ping', 'spec': 'avg_duration/echo_benchmark/ping'},
25 'percentile_duration/echo_benchmark/ping/0.10', 25 {'name': '10th percentile ping', 'spec': 'percentile_duration/echo_benchma rk/ping/0.10'},
26 'percentile_duration/echo_benchmark/ping/0.50', 26 {'name': '50th percentile ping', 'spec': 'percentile_duration/echo_benchma rk/ping/0.50'},
27 'percentile_duration/echo_benchmark/ping/0.90', 27 {'name': '90th percentile ping', 'spec': 'percentile_duration/echo_benchma rk/ping/0.90'},
28 ], 28 ],
29 'shell-args': [ 29 'shell-args': [
30 '--args-for=https://core.mojoapps.io/echo_benchmark.mojo --early-tracing - -dart-server', 30 '--args-for=https://core.mojoapps.io/echo_benchmark.mojo --early-tracing - -dart-server',
31 ] 31 ]
32 }, 32 },
33 { 33 {
34 'name': 'Dart <=> Dart IPC Round Trip Time', 34 'name': 'Dart <=> Dart IPC Round Trip Time',
35 'app': 'https://core.mojoapps.io/dart_rtt_benchmark.mojo', 35 'app': 'https://core.mojoapps.io/dart_rtt_benchmark.mojo',
36 'duration': 10, 36 'duration': 10,
37 'measurements': [ 37 'measurements': [
38 'avg_duration/mojo_rtt_benchmark/ping', 38 {'name': 'avg ping', 'spec': 'avg_duration/mojo_rtt_benchmark/ping'},
39 'percentile_duration/mojo_rtt_benchmark/ping/0.10', 39 {'name': '10th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.10'},
40 'percentile_duration/mojo_rtt_benchmark/ping/0.50', 40 {'name': '50th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.50'},
41 'percentile_duration/mojo_rtt_benchmark/ping/0.90', 41 {'name': '90th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.90'},
42 ] 42 ]
43 }, 43 },
44 { 44 {
45 'name': 'Dart <=> C++ IPC Round Trip Time', 45 'name': 'Dart <=> C++ IPC Round Trip Time',
46 'app': 'https://core.mojoapps.io/dart_rtt_benchmark.mojo', 46 'app': 'https://core.mojoapps.io/dart_rtt_benchmark.mojo',
47 'duration': 10, 47 'duration': 10,
48 'measurements': [ 48 'measurements': [
49 'avg_duration/mojo_rtt_benchmark/ping', 49 {'name': 'avg ping', 'spec': 'avg_duration/mojo_rtt_benchmark/ping'},
50 'percentile_duration/mojo_rtt_benchmark/ping/0.10', 50 {'name': '10th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.10'},
51 'percentile_duration/mojo_rtt_benchmark/ping/0.50', 51 {'name': '50th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.50'},
52 'percentile_duration/mojo_rtt_benchmark/ping/0.90', 52 {'name': '90th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.90'},
53 ], 53 ],
54 'shell-args': [ 54 'shell-args': [
55 '--args-for=https://core.mojoapps.io/dart_rtt_benchmark.mojo --cpp-server' , 55 '--args-for=https://core.mojoapps.io/dart_rtt_benchmark.mojo --cpp-server' ,
56 ] 56 ]
57 }, 57 },
58 { 58 {
59 'name': 'Dart Isolate Message Round Trip Time', 59 'name': 'Dart Isolate Message Round Trip Time',
60 'app': 'https://core.mojoapps.io/dart_isolate_rtt_benchmark.mojo', 60 'app': 'https://core.mojoapps.io/dart_isolate_rtt_benchmark.mojo',
61 'duration': 10, 61 'duration': 10,
62 'measurements': [ 62 'measurements': [
63 'avg_duration/isolate_rtt_benchmark/ping', 63 {'name': 'avg ping', 'spec': 'avg_duration/isolate_rtt_benchmark/ping'},
64 'percentile_duration/isolate_rtt_benchmark/ping/0.10', 64 {'name': '10th percentile ping', 'spec': 'percentile_duration/isolate_rtt_ benchmark/ping/0.10'},
65 'percentile_duration/isolate_rtt_benchmark/ping/0.50', 65 {'name': '50th percentile ping', 'spec': 'percentile_duration/isolate_rtt_ benchmark/ping/0.50'},
66 'percentile_duration/isolate_rtt_benchmark/ping/0.90', 66 {'name': '90th percentile ping', 'spec': 'percentile_duration/isolate_rtt_ benchmark/ping/0.90'},
67 ] 67 ]
68 }, 68 },
69 { 69 {
70 'name': 'Many client C++ <=> C++ IPC Round Trip Time', 70 'name': 'Many client C++ <=> C++ IPC Round Trip Time',
71 'app': 'https://core.mojoapps.io/echo_benchmark.mojo', 71 'app': 'https://core.mojoapps.io/echo_benchmark.mojo',
72 'duration': 10, 72 'duration': 10,
73 'measurements': [ 73 'measurements': [
74 'avg_duration/echo_benchmark/ping', 74 {'name': 'avg ping', 'spec': 'avg_duration/echo_benchmark/ping'},
75 'percentile_duration/echo_benchmark/ping/0.10', 75 {'name': '10th percentile ping', 'spec': 'percentile_duration/echo_benchma rk/ping/0.10'},
76 'percentile_duration/echo_benchmark/ping/0.50', 76 {'name': '50th percentile ping', 'spec': 'percentile_duration/echo_benchma rk/ping/0.50'},
77 'percentile_duration/echo_benchmark/ping/0.90', 77 {'name': '90th percentile ping', 'spec': 'percentile_duration/echo_benchma rk/ping/0.90'},
78 ], 78 ],
79 'shell-args': [ 79 'shell-args': [
80 '--args-for=https://core.mojoapps.io/echo_benchmark.mojo --early-tracing - -num-clients=100 --num-active-clients=100', 80 '--args-for=https://core.mojoapps.io/echo_benchmark.mojo --early-tracing - -num-clients=100 --num-active-clients=100',
81 ] 81 ]
82 }, 82 },
83 { 83 {
84 'name': 'Many client Dart <=> Dart IPC Round Trip Time', 84 'name': 'Many client Dart <=> Dart IPC Round Trip Time',
85 'app': 'https://core.mojoapps.io/dart_rtt_benchmark.mojo', 85 'app': 'https://core.mojoapps.io/dart_rtt_benchmark.mojo',
86 'duration': 10, 86 'duration': 10,
87 'measurements': [ 87 'measurements': [
88 'avg_duration/mojo_rtt_benchmark/ping', 88 {'name': 'avg ping', 'spec': 'avg_duration/mojo_rtt_benchmark/ping'},
89 'percentile_duration/mojo_rtt_benchmark/ping/0.10', 89 {'name': '10th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.10'},
90 'percentile_duration/mojo_rtt_benchmark/ping/0.50', 90 {'name': '50th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.50'},
91 'percentile_duration/mojo_rtt_benchmark/ping/0.90', 91 {'name': '90th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.90'},
92 ], 92 ],
93 'shell-args': [ 93 'shell-args': [
94 '--args-for=https://core.mojoapps.io/dart_rtt_benchmark.mojo --num-clients =100 --num-active-clients=100', 94 '--args-for=https://core.mojoapps.io/dart_rtt_benchmark.mojo --num-clients =100 --num-active-clients=100',
95 ] 95 ]
96 }, 96 },
97 { 97 {
98 'name': 'Many client Dart <=> C++ IPC Round Trip Time', 98 'name': 'Many client Dart <=> C++ IPC Round Trip Time',
99 'app': 'https://core.mojoapps.io/dart_rtt_benchmark.mojo', 99 'app': 'https://core.mojoapps.io/dart_rtt_benchmark.mojo',
100 'duration': 10, 100 'duration': 10,
101 'measurements': [ 101 'measurements': [
102 'avg_duration/mojo_rtt_benchmark/ping', 102 {'name': 'avg ping', 'spec': 'avg_duration/mojo_rtt_benchmark/ping'},
103 'percentile_duration/mojo_rtt_benchmark/ping/0.10', 103 {'name': '10th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.10'},
104 'percentile_duration/mojo_rtt_benchmark/ping/0.50', 104 {'name': '50th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.50'},
105 'percentile_duration/mojo_rtt_benchmark/ping/0.90', 105 {'name': '90th percentile ping', 'spec': 'percentile_duration/mojo_rtt_ben chmark/ping/0.90'},
106 ], 106 ],
107 'shell-args': [ 107 'shell-args': [
108 '--args-for=https://core.mojoapps.io/dart_rtt_benchmark.mojo --cpp-server --num-clients=100 --num-active-clients=100', 108 '--args-for=https://core.mojoapps.io/dart_rtt_benchmark.mojo --cpp-server --num-clients=100 --num-active-clients=100',
109 ] 109 ]
110 }, 110 },
111 ] 111 ]
OLDNEW
« no previous file with comments | « mojo/tools/data/benchmarks ('k') | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698