OLD | NEW |
1 # Copyright 2011 the V8 project authors. All rights reserved. | 1 # Copyright 2011 the V8 project authors. All rights reserved. |
2 # Redistribution and use in source and binary forms, with or without | 2 # Redistribution and use in source and binary forms, with or without |
3 # modification, are permitted provided that the following conditions are | 3 # modification, are permitted provided that the following conditions are |
4 # met: | 4 # met: |
5 # | 5 # |
6 # * Redistributions of source code must retain the above copyright | 6 # * Redistributions of source code must retain the above copyright |
7 # notice, this list of conditions and the following disclaimer. | 7 # notice, this list of conditions and the following disclaimer. |
8 # * Redistributions in binary form must reproduce the above | 8 # * Redistributions in binary form must reproduce the above |
9 # copyright notice, this list of conditions and the following | 9 # copyright notice, this list of conditions and the following |
10 # disclaimer in the documentation and/or other materials provided | 10 # disclaimer in the documentation and/or other materials provided |
(...skipping 52 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
63 | 63 |
64 # These tests are simply wrong (i.e., they do not test what they intend | 64 # These tests are simply wrong (i.e., they do not test what they intend |
65 # to test). | 65 # to test). |
66 # In particular, these two compare numbers to NaN with != in the current | 66 # In particular, these two compare numbers to NaN with != in the current |
67 # version of the Mozilla tests. This is *fixed* in a later version. | 67 # version of the Mozilla tests. This is *fixed* in a later version. |
68 # The tests should be re-enabled when switching to a new version. | 68 # The tests should be re-enabled when switching to a new version. |
69 ecma_3/Date/15.9.3.2-1: SKIP | 69 ecma_3/Date/15.9.3.2-1: SKIP |
70 js1_2/function/Number: SKIP | 70 js1_2/function/Number: SKIP |
71 | 71 |
72 # TODO(2018): Temporarily allow timeout in debug mode. | 72 # TODO(2018): Temporarily allow timeout in debug mode. |
73 js1_5/GC/regress-203278-2: PASS || TIMEOUT if $mode == debug | 73 js1_5/GC/regress-203278-2: PASS || (TIMEOUT || FAIL) if $mode == debug |
74 | 74 |
75 ##################### SLOW TESTS ##################### | 75 ##################### SLOW TESTS ##################### |
76 | 76 |
77 # This takes a long time to run (~100 seconds). It should only be run | 77 # This takes a long time to run (~100 seconds). It should only be run |
78 # by the really patient. | 78 # by the really patient. |
79 js1_5/GC/regress-324278: SLOW | 79 js1_5/GC/regress-324278: SLOW |
80 | 80 |
81 # This takes a long time to run because our indexOf operation is | 81 # This takes a long time to run because our indexOf operation is |
82 # pretty slow - it causes a lot of GCs; see issue | 82 # pretty slow - it causes a lot of GCs; see issue |
83 # #926379. We could consider marking this SKIP because it takes a | 83 # #926379. We could consider marking this SKIP because it takes a |
(...skipping 15 matching lines...) Expand all Loading... |
99 | 99 |
100 # These tests time out in debug mode but pass in product mode | 100 # These tests time out in debug mode but pass in product mode |
101 js1_5/Regress/regress-360969-03: PASS || TIMEOUT if $mode == debug | 101 js1_5/Regress/regress-360969-03: PASS || TIMEOUT if $mode == debug |
102 js1_5/Regress/regress-360969-04: PASS || TIMEOUT if $mode == debug | 102 js1_5/Regress/regress-360969-04: PASS || TIMEOUT if $mode == debug |
103 js1_5/Regress/regress-360969-05: PASS || TIMEOUT if $mode == debug | 103 js1_5/Regress/regress-360969-05: PASS || TIMEOUT if $mode == debug |
104 js1_5/Regress/regress-360969-06: PASS || TIMEOUT if $mode == debug | 104 js1_5/Regress/regress-360969-06: PASS || TIMEOUT if $mode == debug |
105 js1_5/extensions/regress-365527: PASS || TIMEOUT if $mode == debug | 105 js1_5/extensions/regress-365527: PASS || TIMEOUT if $mode == debug |
106 | 106 |
107 js1_5/Regress/regress-280769-3: PASS || FAIL if $mode == debug | 107 js1_5/Regress/regress-280769-3: PASS || FAIL if $mode == debug |
108 js1_5/Regress/regress-203278-1: PASS || FAIL if $mode == debug | 108 js1_5/Regress/regress-203278-1: PASS || FAIL if $mode == debug |
109 js1_5/GC/regress-203278-2: PASS || FAIL if $mode == debug | |
110 js1_5/Regress/regress-244470: PASS || FAIL if $mode == debug | 109 js1_5/Regress/regress-244470: PASS || FAIL if $mode == debug |
111 ecma_3/RegExp/regress-209067: PASS || FAIL if $mode == debug | 110 ecma_3/RegExp/regress-209067: PASS || FAIL if $mode == debug |
112 js1_5/GC/regress-278725: PASS || FAIL if $mode == debug | 111 js1_5/GC/regress-278725: PASS || FAIL if $mode == debug |
113 # http://b/issue?id=1206983 | 112 # http://b/issue?id=1206983 |
114 js1_5/Regress/regress-367561-03: PASS || FAIL if $mode == debug | 113 js1_5/Regress/regress-367561-03: PASS || FAIL if $mode == debug |
115 ecma/Date/15.9.5.10-2: PASS || (FAIL || TIMEOUT if $mode == debug) | 114 ecma/Date/15.9.5.10-2: PASS || (FAIL || TIMEOUT if $mode == debug) |
116 | 115 |
117 # These tests create two Date objects just after each other and | 116 # These tests create two Date objects just after each other and |
118 # expects them to match. Sometimes this happens on the border | 117 # expects them to match. Sometimes this happens on the border |
119 # between one second and the next. | 118 # between one second and the next. |
120 ecma/Date/15.9.2.1: PASS || FAIL | 119 ecma/Date/15.9.2.1: PASS || FAIL |
121 ecma/Date/15.9.2.2-1: PASS || FAIL | 120 ecma/Date/15.9.2.2-1: PASS || FAIL |
122 ecma/Date/15.9.2.2-2: PASS || FAIL | 121 ecma/Date/15.9.2.2-2: PASS || FAIL |
123 ecma/Date/15.9.2.2-3: PASS || FAIL | 122 ecma/Date/15.9.2.2-3: PASS || FAIL |
124 ecma/Date/15.9.2.2-4: PASS || FAIL | 123 ecma/Date/15.9.2.2-4: PASS || FAIL |
125 ecma/Date/15.9.2.2-5: PASS || FAIL | 124 ecma/Date/15.9.2.2-5: PASS || FAIL |
126 ecma/Date/15.9.2.2-6: PASS || FAIL | 125 ecma/Date/15.9.2.2-6: PASS || FAIL |
127 | 126 |
128 # 1026139: These date tests fail on arm and mips | 127 # 1026139: These date tests fail on arm and mips |
129 ecma/Date/15.9.5.29-1: PASS || FAIL if ($arch == arm || $arch == mipsel) | 128 ecma/Date/15.9.5.29-1: PASS || FAIL if ($arch == arm || $arch == mipsel) |
130 ecma/Date/15.9.5.34-1: PASS || FAIL if ($arch == arm || $arch == mipsel) | |
131 ecma/Date/15.9.5.28-1: PASS || FAIL if ($arch == arm || $arch == mipsel) | 129 ecma/Date/15.9.5.28-1: PASS || FAIL if ($arch == arm || $arch == mipsel) |
132 | 130 |
133 # 1050186: Arm/MIPS vm is broken; probably unrelated to dates | 131 # 1050186: Arm/MIPS vm is broken; probably unrelated to dates |
134 ecma/Array/15.4.4.5-3: PASS || FAIL if ($arch == arm || $arch == mipsel) | 132 ecma/Array/15.4.4.5-3: PASS || FAIL if ($arch == arm || $arch == mipsel) |
135 ecma/Date/15.9.5.22-2: PASS || FAIL if ($arch == arm || $arch == mipsel) | 133 ecma/Date/15.9.5.22-2: PASS || FAIL if ($arch == arm || $arch == mipsel) |
136 | 134 |
137 # Flaky test that fails due to what appears to be a bug in the test. | 135 # Flaky test that fails due to what appears to be a bug in the test. |
138 # Occurs depending on current time | 136 # Occurs depending on current time |
139 ecma/Date/15.9.5.8: PASS || FAIL | 137 ecma/Date/15.9.5.8: PASS || FAIL |
140 | 138 |
(...skipping 31 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
172 # Tests based on shell that use dates in this gap are flaky. | 170 # Tests based on shell that use dates in this gap are flaky. |
173 ecma/Date/15.9.5.10-1: PASS || FAIL | 171 ecma/Date/15.9.5.10-1: PASS || FAIL |
174 ecma/Date/15.9.5.12-1: PASS || FAIL | 172 ecma/Date/15.9.5.12-1: PASS || FAIL |
175 ecma/Date/15.9.5.14: PASS || FAIL | 173 ecma/Date/15.9.5.14: PASS || FAIL |
176 ecma/Date/15.9.5.34-1: PASS || FAIL | 174 ecma/Date/15.9.5.34-1: PASS || FAIL |
177 | 175 |
178 | 176 |
179 # These tests sometimes pass (in particular on Windows). They build up | 177 # These tests sometimes pass (in particular on Windows). They build up |
180 # a lot of stuff on the stack, which normally causes a stack overflow, | 178 # a lot of stuff on the stack, which normally causes a stack overflow, |
181 # but sometimes it makes it through? | 179 # but sometimes it makes it through? |
182 js1_5/Regress/regress-290575: PASS || FAIL | |
183 js1_5/Regress/regress-98901: PASS || FAIL | 180 js1_5/Regress/regress-98901: PASS || FAIL |
184 | 181 |
185 | 182 |
186 # Tests that sorting arrays of ints is less than 3 times as fast | 183 # Tests that sorting arrays of ints is less than 3 times as fast |
187 # as sorting arrays of strings. | 184 # as sorting arrays of strings. |
188 js1_5/extensions/regress-371636: PASS || FAIL || TIMEOUT if $mode == debug | 185 js1_5/extensions/regress-371636: PASS || FAIL || TIMEOUT if $mode == debug |
189 | 186 |
190 | 187 |
191 # Tests depend on GC timings. Inherently flaky. | 188 # Tests depend on GC timings. Inherently flaky. |
192 js1_5/GC/regress-383269-01: PASS || FAIL | 189 js1_5/GC/regress-383269-01: PASS || FAIL |
(...skipping 198 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
391 js1_5/Regress/regress-410852: FAIL_OK | 388 js1_5/Regress/regress-410852: FAIL_OK |
392 ecma_3/RegExp/regress-375715-04: FAIL_OK | 389 ecma_3/RegExp/regress-375715-04: FAIL_OK |
393 js1_5/decompilation/regress-456964-01: FAIL_OK | 390 js1_5/decompilation/regress-456964-01: FAIL_OK |
394 js1_5/decompilation/regress-437288-02: FAIL_OK | 391 js1_5/decompilation/regress-437288-02: FAIL_OK |
395 js1_5/decompilation/regress-457824: FAIL_OK | 392 js1_5/decompilation/regress-457824: FAIL_OK |
396 js1_5/decompilation/regress-460116-01: FAIL_OK | 393 js1_5/decompilation/regress-460116-01: FAIL_OK |
397 js1_5/decompilation/regress-460116-02: FAIL_OK | 394 js1_5/decompilation/regress-460116-02: FAIL_OK |
398 js1_5/decompilation/regress-460501: FAIL_OK | 395 js1_5/decompilation/regress-460501: FAIL_OK |
399 js1_5/decompilation/regress-460116-03: FAIL_OK | 396 js1_5/decompilation/regress-460116-03: FAIL_OK |
400 js1_5/decompilation/regress-461110: FAIL_OK | 397 js1_5/decompilation/regress-461110: FAIL_OK |
401 js1_5/decompilation/regress-456964-01: FAIL_OK | |
402 js1_5/decompilation/regress-437288-02: FAIL_OK | |
403 js1_5/decompilation/regress-457824: FAIL_OK | |
404 js1_5/decompilation/regress-460116-01: FAIL_OK | |
405 js1_5/decompilation/regress-460116-02: FAIL_OK | |
406 js1_5/decompilation/regress-460116-03: FAIL_OK | |
407 js1_5/decompilation/regress-460501: FAIL_OK | |
408 js1_5/decompilation/regress-461110: FAIL_OK | |
409 | |
410 | 398 |
411 | 399 |
412 # Tests that use uneval. Non-ECMA. | 400 # Tests that use uneval. Non-ECMA. |
413 js1_5/GC/regress-418128: FAIL_OK | 401 js1_5/GC/regress-418128: FAIL_OK |
414 js1_5/extensions/regress-465276: FAIL_OK | 402 js1_5/extensions/regress-465276: FAIL_OK |
415 js1_5/Error/regress-465377: FAIL_OK | 403 js1_5/Error/regress-465377: FAIL_OK |
416 | 404 |
417 # Tests that use the watch method. Non-ECMA. | 405 # Tests that use the watch method. Non-ECMA. |
418 js1_5/extensions/regress-435345-01: FAIL_OK | 406 js1_5/extensions/regress-435345-01: FAIL_OK |
419 js1_5/extensions/regress-455413: FAIL_OK | 407 js1_5/extensions/regress-455413: FAIL_OK |
(...skipping 136 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
556 # behavior and not the ECMA spec. | 544 # behavior and not the ECMA spec. |
557 ecma_3/RegExp/perlstress-001: PASS || FAIL_OK | 545 ecma_3/RegExp/perlstress-001: PASS || FAIL_OK |
558 ecma_3/RegExp/regress-334158: PASS || FAIL | 546 ecma_3/RegExp/regress-334158: PASS || FAIL |
559 | 547 |
560 # This test fails due to http://code.google.com/p/v8/issues/detail?id=187 | 548 # This test fails due to http://code.google.com/p/v8/issues/detail?id=187 |
561 # Failure to clear captures when a lookahead is unwound. | 549 # Failure to clear captures when a lookahead is unwound. |
562 ecma_3/RegExp/15.10.2-1: PASS || FAIL_OK | 550 ecma_3/RegExp/15.10.2-1: PASS || FAIL_OK |
563 | 551 |
564 # This test requires a failure if we try to compile a function with more | 552 # This test requires a failure if we try to compile a function with more |
565 # than 65536 arguments. This seems to be a Mozilla restriction. | 553 # than 65536 arguments. This seems to be a Mozilla restriction. |
566 js1_5/Regress/regress-290575: FAIL_OK | 554 js1_5/Regress/regress-290575: PASS || FAIL_OK |
567 | 555 |
568 | 556 |
569 # Fails because of the way function declarations are | 557 # Fails because of the way function declarations are |
570 # handled in V8/JSC. V8 follows IE behavior and introduce | 558 # handled in V8/JSC. V8 follows IE behavior and introduce |
571 # all nested function declarations when entering the | 559 # all nested function declarations when entering the |
572 # surrounding function, whereas Spidermonkey declares | 560 # surrounding function, whereas Spidermonkey declares |
573 # them dynamically when the statement is executed. | 561 # them dynamically when the statement is executed. |
574 ecma_3/Function/scope-001: FAIL_OK | 562 ecma_3/Function/scope-001: FAIL_OK |
575 ecma_3/FunExpr/fe-001: FAIL_OK | 563 ecma_3/FunExpr/fe-001: FAIL_OK |
576 js1_5/Scope/regress-184107: FAIL_OK | 564 js1_5/Scope/regress-184107: FAIL_OK |
(...skipping 173 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
750 js1_5/extensions/regress-50447: FAIL_OK | 738 js1_5/extensions/regress-50447: FAIL_OK |
751 js1_5/extensions/regress-90596-001: FAIL_OK | 739 js1_5/extensions/regress-90596-001: FAIL_OK |
752 js1_5/extensions/regress-90596-002: FAIL_OK | 740 js1_5/extensions/regress-90596-002: FAIL_OK |
753 js1_5/extensions/regress-96284-001: FAIL_OK | 741 js1_5/extensions/regress-96284-001: FAIL_OK |
754 js1_5/extensions/regress-96284-002: FAIL_OK | 742 js1_5/extensions/regress-96284-002: FAIL_OK |
755 js1_5/extensions/toLocaleFormat-01: FAIL_OK | 743 js1_5/extensions/toLocaleFormat-01: FAIL_OK |
756 js1_5/extensions/toLocaleFormat-02: FAIL_OK | 744 js1_5/extensions/toLocaleFormat-02: FAIL_OK |
757 | 745 |
758 js1_5/extensions/regress-330569: TIMEOUT | 746 js1_5/extensions/regress-330569: TIMEOUT |
759 js1_5/extensions/regress-351448: TIMEOUT | 747 js1_5/extensions/regress-351448: TIMEOUT |
760 js1_5/extensions/regress-342960: FAIL_OK || TIMEOUT if $mode == debug | |
761 # In the 64-bit version, this test takes longer to run out of memory | 748 # In the 64-bit version, this test takes longer to run out of memory |
762 # than it does in the 32-bit version when attempting to generate a huge | 749 # than it does in the 32-bit version when attempting to generate a huge |
763 # error message in debug mode. | 750 # error message in debug mode. |
764 js1_5/extensions/regress-336410-1: FAIL_OK || TIMEOUT if ($mode == debug && $arc
h == x64) | 751 js1_5/extensions/regress-336410-1: FAIL_OK || TIMEOUT if ($mode == debug && $arc
h == x64) |
765 | 752 |
766 ##################### DECOMPILATION TESTS ##################### | 753 ##################### DECOMPILATION TESTS ##################### |
767 | 754 |
768 # We don't really about the outcome of running the | 755 # We don't really about the outcome of running the |
769 # decompilation tests as long as they don't crash or | 756 # decompilation tests as long as they don't crash or |
770 # timeout. | 757 # timeout. |
(...skipping 47 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
818 js1_5/decompilation/regress-375639: PASS || FAIL | 805 js1_5/decompilation/regress-375639: PASS || FAIL |
819 js1_5/decompilation/regress-375882: PASS || FAIL | 806 js1_5/decompilation/regress-375882: PASS || FAIL |
820 js1_5/decompilation/regress-376564: PASS || FAIL | 807 js1_5/decompilation/regress-376564: PASS || FAIL |
821 js1_5/decompilation/regress-383721: PASS || FAIL | 808 js1_5/decompilation/regress-383721: PASS || FAIL |
822 js1_5/decompilation/regress-406555: PASS || FAIL | 809 js1_5/decompilation/regress-406555: PASS || FAIL |
823 js1_5/decompilation/regress-460870: PASS || FAIL | 810 js1_5/decompilation/regress-460870: PASS || FAIL |
824 | 811 |
825 | 812 |
826 [ $arch == arm ] | 813 [ $arch == arm ] |
827 | 814 |
828 # Times out and print so much output that we need to skip it to not | |
829 # hang the builder. | |
830 js1_5/extensions/regress-342960: SKIP | |
831 | |
832 # BUG(3251229): Times out when running new crankshaft test script. | 815 # BUG(3251229): Times out when running new crankshaft test script. |
833 ecma_3/RegExp/regress-311414: SKIP | 816 ecma_3/RegExp/regress-311414: SKIP |
834 ecma/Date/15.9.5.8: SKIP | 817 ecma/Date/15.9.5.8: SKIP |
835 ecma/Date/15.9.5.10-2: SKIP | 818 ecma/Date/15.9.5.10-2: SKIP |
836 ecma/Date/15.9.5.11-2: SKIP | 819 ecma/Date/15.9.5.11-2: SKIP |
837 ecma/Date/15.9.5.12-2: SKIP | 820 ecma/Date/15.9.5.12-2: SKIP |
838 js1_5/Array/regress-99120-02: SKIP | 821 js1_5/Array/regress-99120-02: SKIP |
839 js1_5/extensions/regress-371636: SKIP | 822 js1_5/extensions/regress-371636: SKIP |
840 js1_5/Regress/regress-203278-1: SKIP | 823 js1_5/Regress/regress-203278-1: SKIP |
841 js1_5/Regress/regress-404755: SKIP | 824 js1_5/Regress/regress-404755: SKIP |
842 js1_5/Regress/regress-451322: SKIP | 825 js1_5/Regress/regress-451322: SKIP |
843 | 826 |
844 | 827 |
845 # BUG(1040): Allow this test to timeout. | 828 # BUG(1040): Allow this test to timeout. |
846 js1_5/GC/regress-203278-2: PASS || TIMEOUT | 829 js1_5/GC/regress-203278-2: PASS || TIMEOUT |
847 | 830 |
848 | 831 |
849 [ $arch == mipsel ] | 832 [ $arch == mipsel ] |
850 | 833 |
851 # Times out and print so much output that we need to skip it to not | |
852 # hang the builder. | |
853 js1_5/extensions/regress-342960: SKIP | |
854 | |
855 # BUG(3251229): Times out when running new crankshaft test script. | 834 # BUG(3251229): Times out when running new crankshaft test script. |
856 ecma_3/RegExp/regress-311414: SKIP | 835 ecma_3/RegExp/regress-311414: SKIP |
857 ecma/Date/15.9.5.8: SKIP | 836 ecma/Date/15.9.5.8: SKIP |
858 ecma/Date/15.9.5.10-2: SKIP | 837 ecma/Date/15.9.5.10-2: SKIP |
859 ecma/Date/15.9.5.11-2: SKIP | 838 ecma/Date/15.9.5.11-2: SKIP |
860 ecma/Date/15.9.5.12-2: SKIP | 839 ecma/Date/15.9.5.12-2: SKIP |
861 js1_5/Array/regress-99120-02: SKIP | 840 js1_5/Array/regress-99120-02: SKIP |
862 js1_5/extensions/regress-371636: SKIP | 841 js1_5/extensions/regress-371636: SKIP |
863 js1_5/Regress/regress-203278-1: SKIP | 842 js1_5/Regress/regress-203278-1: SKIP |
864 js1_5/Regress/regress-404755: SKIP | 843 js1_5/Regress/regress-404755: SKIP |
865 js1_5/Regress/regress-451322: SKIP | 844 js1_5/Regress/regress-451322: SKIP |
866 | 845 |
867 | 846 |
868 # BUG(1040): Allow this test to timeout. | 847 # BUG(1040): Allow this test to timeout. |
869 js1_5/GC/regress-203278-2: PASS || TIMEOUT | 848 js1_5/GC/regress-203278-2: PASS || TIMEOUT |
OLD | NEW |