OLD | NEW |
(Empty) | |
| 1 <html> |
| 2 <head> |
| 3 <title>V8 Benchmark Suite Revisions</title> |
| 4 <link type="text/css" rel="stylesheet" href="style.css" /> |
| 5 </head> |
| 6 <body> |
| 7 <div> |
| 8 <div class="title"><h1>V8 Benchmark Suite Revisions</h1></div> |
| 9 <table> |
| 10 <tr> |
| 11 <td class="contents"> |
| 12 |
| 13 <p> |
| 14 |
| 15 The V8 benchmark suite is changed from time to time as we fix bugs or |
| 16 expand the scope of the benchmarks. Here is a list of revisions, with |
| 17 a description of the changes made. Note that benchmark results are |
| 18 not comparable unless both results are run with the same revision of |
| 19 the benchmark suite. |
| 20 |
| 21 </p> |
| 22 |
| 23 <div class="subtitle"><h3>Version 6 (<a href="http://v8.googlecode.com/svn/data/
benchmarks/v6/run.html">link</a>)</h3></div> |
| 24 |
| 25 <p>Removed dead code from the RayTrace benchmark and fixed a couple of |
| 26 typos in the DeltaBlue implementation. Changed the Splay benchmark to |
| 27 avoid converting the same numeric key to a string over and over again |
| 28 and to avoid inserting and removing the same element repeatedly thus |
| 29 increasing pressure on the memory subsystem. Changed the RegExp |
| 30 benchmark to exercise the regular expression engine on different input |
| 31 strings.</p> |
| 32 |
| 33 <p>Furthermore, the benchmark runner was changed to run the benchmarks |
| 34 for at least a few times to stabilize the reported numbers on slower |
| 35 machines.</p> |
| 36 |
| 37 <div class="subtitle"><h3>Version 5 (<a href="http://v8.googlecode.com/svn/data/
benchmarks/v5/run.html">link</a>)</h3></div> |
| 38 |
| 39 <p>Removed duplicate line in random seed code, and changed the name of |
| 40 the Object.prototype.inherits function in the DeltaBlue benchmark to |
| 41 inheritsFrom to avoid name clashes when running in Chromium with |
| 42 extensions enabled. |
| 43 </p> |
| 44 |
| 45 <div class="subtitle"><h3>Version 4 (<a href="http://v8.googlecode.com/svn/data/
benchmarks/v4/run.html">link</a>)</h3></div> |
| 46 |
| 47 <p>The <i>Splay</i> benchmark is a newcomer in version 4. It |
| 48 manipulates a splay tree by adding and removing data nodes, thus |
| 49 exercising the memory management subsystem of the JavaScript engine. |
| 50 </p> |
| 51 |
| 52 <p> |
| 53 Furthermore, all the unused parts of the Prototype library were |
| 54 removed from the RayTrace benchmark. This does not affect the running |
| 55 of the benchmark. |
| 56 </p> |
| 57 |
| 58 |
| 59 <div class="subtitle"><h3>Version 3 (<a href="http://v8.googlecode.com/svn/data/
benchmarks/v3/run.html">link</a>)</h3></div> |
| 60 |
| 61 <p>Version 3 adds a new benchmark, <i>RegExp</i>. The RegExp |
| 62 benchmark is generated by loading 50 of the most popular pages on the |
| 63 web and logging all regexp operations performed. Each operation is |
| 64 given a weight that is calculated from an estimate of the popularity |
| 65 of the pages where it occurs and the number of times it is executed |
| 66 while loading each page. Finally the literal letters in the data are |
| 67 encoded using ROT13 in a way that does not affect how the regexps |
| 68 match their input. |
| 69 </p> |
| 70 |
| 71 |
| 72 <div class="subtitle"><h3>Version 2 (<a href="http://v8.googlecode.com/svn/data/
benchmarks/v2/run.html">link</a>)</h3></div> |
| 73 |
| 74 <p>For version 2 the Crypto benchmark was fixed. Previously, the |
| 75 decryption stage was given plaintext as input, which resulted in an |
| 76 error. Now, the decryption stage is given the output of the |
| 77 encryption stage as input. The result is checked against the original |
| 78 plaintext. For this to give the correct results the crypto objects |
| 79 are reset for each iteration of the benchmark. In addition, the size |
| 80 of the plain text has been increased a little and the use of |
| 81 Math.random() and new Date() to build an RNG pool has been |
| 82 removed. </p> |
| 83 |
| 84 <p>Other benchmarks were fixed to do elementary verification of the |
| 85 results of their calculations. This is to avoid accidentally |
| 86 obtaining scores that are the result of an incorrect JavaScript engine |
| 87 optimization.</p> |
| 88 |
| 89 |
| 90 <div class="subtitle"><h3>Version 1 (<a href="http://v8.googlecode.com/svn/data/
benchmarks/v1/run.html">link</a>)</h3></div> |
| 91 |
| 92 <p>Initial release.</p> |
| 93 |
| 94 </td><td style="text-align: center"> |
| 95 </td></tr></table> |
| 96 |
| 97 </div> |
| 98 |
| 99 </body> |
| 100 </html> |
OLD | NEW |