| OLD | NEW |
| 1 # Copyright 2011 the V8 project authors. All rights reserved. | 1 # Copyright 2011 the V8 project authors. All rights reserved. |
| 2 # Redistribution and use in source and binary forms, with or without | 2 # Redistribution and use in source and binary forms, with or without |
| 3 # modification, are permitted provided that the following conditions are | 3 # modification, are permitted provided that the following conditions are |
| 4 # met: | 4 # met: |
| 5 # | 5 # |
| 6 # * Redistributions of source code must retain the above copyright | 6 # * Redistributions of source code must retain the above copyright |
| 7 # notice, this list of conditions and the following disclaimer. | 7 # notice, this list of conditions and the following disclaimer. |
| 8 # * Redistributions in binary form must reproduce the above | 8 # * Redistributions in binary form must reproduce the above |
| 9 # copyright notice, this list of conditions and the following | 9 # copyright notice, this list of conditions and the following |
| 10 # disclaimer in the documentation and/or other materials provided | 10 # disclaimer in the documentation and/or other materials provided |
| (...skipping 52 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 63 | 63 |
| 64 # These tests are simply wrong (i.e., they do not test what they intend | 64 # These tests are simply wrong (i.e., they do not test what they intend |
| 65 # to test). | 65 # to test). |
| 66 # In particular, these two compare numbers to NaN with != in the current | 66 # In particular, these two compare numbers to NaN with != in the current |
| 67 # version of the Mozilla tests. This is *fixed* in a later version. | 67 # version of the Mozilla tests. This is *fixed* in a later version. |
| 68 # The tests should be re-enabled when switching to a new version. | 68 # The tests should be re-enabled when switching to a new version. |
| 69 ecma_3/Date/15.9.3.2-1: SKIP | 69 ecma_3/Date/15.9.3.2-1: SKIP |
| 70 js1_2/function/Number: SKIP | 70 js1_2/function/Number: SKIP |
| 71 | 71 |
| 72 # TODO(2018): Temporarily allow timeout in debug mode. | 72 # TODO(2018): Temporarily allow timeout in debug mode. |
| 73 js1_5/GC/regress-203278-2: PASS || TIMEOUT if $mode == debug | 73 js1_5/GC/regress-203278-2: PASS || (TIMEOUT || FAIL) if $mode == debug |
| 74 | 74 |
| 75 ##################### SLOW TESTS ##################### | 75 ##################### SLOW TESTS ##################### |
| 76 | 76 |
| 77 # This takes a long time to run (~100 seconds). It should only be run | 77 # This takes a long time to run (~100 seconds). It should only be run |
| 78 # by the really patient. | 78 # by the really patient. |
| 79 js1_5/GC/regress-324278: SLOW | 79 js1_5/GC/regress-324278: SLOW |
| 80 | 80 |
| 81 # This takes a long time to run because our indexOf operation is | 81 # This takes a long time to run because our indexOf operation is |
| 82 # pretty slow - it causes a lot of GCs; see issue | 82 # pretty slow - it causes a lot of GCs; see issue |
| 83 # #926379. We could consider marking this SKIP because it takes a | 83 # #926379. We could consider marking this SKIP because it takes a |
| (...skipping 15 matching lines...) Expand all Loading... |
| 99 | 99 |
| 100 # These tests time out in debug mode but pass in product mode | 100 # These tests time out in debug mode but pass in product mode |
| 101 js1_5/Regress/regress-360969-03: PASS || TIMEOUT if $mode == debug | 101 js1_5/Regress/regress-360969-03: PASS || TIMEOUT if $mode == debug |
| 102 js1_5/Regress/regress-360969-04: PASS || TIMEOUT if $mode == debug | 102 js1_5/Regress/regress-360969-04: PASS || TIMEOUT if $mode == debug |
| 103 js1_5/Regress/regress-360969-05: PASS || TIMEOUT if $mode == debug | 103 js1_5/Regress/regress-360969-05: PASS || TIMEOUT if $mode == debug |
| 104 js1_5/Regress/regress-360969-06: PASS || TIMEOUT if $mode == debug | 104 js1_5/Regress/regress-360969-06: PASS || TIMEOUT if $mode == debug |
| 105 js1_5/extensions/regress-365527: PASS || TIMEOUT if $mode == debug | 105 js1_5/extensions/regress-365527: PASS || TIMEOUT if $mode == debug |
| 106 | 106 |
| 107 js1_5/Regress/regress-280769-3: PASS || FAIL if $mode == debug | 107 js1_5/Regress/regress-280769-3: PASS || FAIL if $mode == debug |
| 108 js1_5/Regress/regress-203278-1: PASS || FAIL if $mode == debug | 108 js1_5/Regress/regress-203278-1: PASS || FAIL if $mode == debug |
| 109 js1_5/GC/regress-203278-2: PASS || FAIL if $mode == debug | |
| 110 js1_5/Regress/regress-244470: PASS || FAIL if $mode == debug | 109 js1_5/Regress/regress-244470: PASS || FAIL if $mode == debug |
| 111 ecma_3/RegExp/regress-209067: PASS || FAIL if $mode == debug | 110 ecma_3/RegExp/regress-209067: PASS || FAIL if $mode == debug |
| 112 js1_5/GC/regress-278725: PASS || FAIL if $mode == debug | 111 js1_5/GC/regress-278725: PASS || FAIL if $mode == debug |
| 113 # http://b/issue?id=1206983 | 112 # http://b/issue?id=1206983 |
| 114 js1_5/Regress/regress-367561-03: PASS || FAIL if $mode == debug | 113 js1_5/Regress/regress-367561-03: PASS || FAIL if $mode == debug |
| 115 ecma/Date/15.9.5.10-2: PASS || (FAIL || TIMEOUT if $mode == debug) | 114 ecma/Date/15.9.5.10-2: PASS || (FAIL || TIMEOUT if $mode == debug) |
| 116 | 115 |
| 117 # These tests create two Date objects just after each other and | 116 # These tests create two Date objects just after each other and |
| 118 # expects them to match. Sometimes this happens on the border | 117 # expects them to match. Sometimes this happens on the border |
| 119 # between one second and the next. | 118 # between one second and the next. |
| 120 ecma/Date/15.9.2.1: PASS || FAIL | 119 ecma/Date/15.9.2.1: PASS || FAIL |
| 121 ecma/Date/15.9.2.2-1: PASS || FAIL | 120 ecma/Date/15.9.2.2-1: PASS || FAIL |
| 122 ecma/Date/15.9.2.2-2: PASS || FAIL | 121 ecma/Date/15.9.2.2-2: PASS || FAIL |
| 123 ecma/Date/15.9.2.2-3: PASS || FAIL | 122 ecma/Date/15.9.2.2-3: PASS || FAIL |
| 124 ecma/Date/15.9.2.2-4: PASS || FAIL | 123 ecma/Date/15.9.2.2-4: PASS || FAIL |
| 125 ecma/Date/15.9.2.2-5: PASS || FAIL | 124 ecma/Date/15.9.2.2-5: PASS || FAIL |
| 126 ecma/Date/15.9.2.2-6: PASS || FAIL | 125 ecma/Date/15.9.2.2-6: PASS || FAIL |
| 127 | 126 |
| 128 # 1026139: These date tests fail on arm and mips | 127 # 1026139: These date tests fail on arm and mips |
| 129 ecma/Date/15.9.5.29-1: PASS || FAIL if ($arch == arm || $arch == mipsel) | 128 ecma/Date/15.9.5.29-1: PASS || FAIL if ($arch == arm || $arch == mipsel) |
| 130 ecma/Date/15.9.5.34-1: PASS || FAIL if ($arch == arm || $arch == mipsel) | |
| 131 ecma/Date/15.9.5.28-1: PASS || FAIL if ($arch == arm || $arch == mipsel) | 129 ecma/Date/15.9.5.28-1: PASS || FAIL if ($arch == arm || $arch == mipsel) |
| 132 | 130 |
| 133 # 1050186: Arm/MIPS vm is broken; probably unrelated to dates | 131 # 1050186: Arm/MIPS vm is broken; probably unrelated to dates |
| 134 ecma/Array/15.4.4.5-3: PASS || FAIL if ($arch == arm || $arch == mipsel) | 132 ecma/Array/15.4.4.5-3: PASS || FAIL if ($arch == arm || $arch == mipsel) |
| 135 ecma/Date/15.9.5.22-2: PASS || FAIL if ($arch == arm || $arch == mipsel) | 133 ecma/Date/15.9.5.22-2: PASS || FAIL if ($arch == arm || $arch == mipsel) |
| 136 | 134 |
| 137 # Flaky test that fails due to what appears to be a bug in the test. | 135 # Flaky test that fails due to what appears to be a bug in the test. |
| 138 # Occurs depending on current time | 136 # Occurs depending on current time |
| 139 ecma/Date/15.9.5.8: PASS || FAIL | 137 ecma/Date/15.9.5.8: PASS || FAIL |
| 140 | 138 |
| (...skipping 31 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 172 # Tests based on shell that use dates in this gap are flaky. | 170 # Tests based on shell that use dates in this gap are flaky. |
| 173 ecma/Date/15.9.5.10-1: PASS || FAIL | 171 ecma/Date/15.9.5.10-1: PASS || FAIL |
| 174 ecma/Date/15.9.5.12-1: PASS || FAIL | 172 ecma/Date/15.9.5.12-1: PASS || FAIL |
| 175 ecma/Date/15.9.5.14: PASS || FAIL | 173 ecma/Date/15.9.5.14: PASS || FAIL |
| 176 ecma/Date/15.9.5.34-1: PASS || FAIL | 174 ecma/Date/15.9.5.34-1: PASS || FAIL |
| 177 | 175 |
| 178 | 176 |
| 179 # These tests sometimes pass (in particular on Windows). They build up | 177 # These tests sometimes pass (in particular on Windows). They build up |
| 180 # a lot of stuff on the stack, which normally causes a stack overflow, | 178 # a lot of stuff on the stack, which normally causes a stack overflow, |
| 181 # but sometimes it makes it through? | 179 # but sometimes it makes it through? |
| 182 js1_5/Regress/regress-290575: PASS || FAIL | |
| 183 js1_5/Regress/regress-98901: PASS || FAIL | 180 js1_5/Regress/regress-98901: PASS || FAIL |
| 184 | 181 |
| 185 | 182 |
| 186 # Tests that sorting arrays of ints is less than 3 times as fast | 183 # Tests that sorting arrays of ints is less than 3 times as fast |
| 187 # as sorting arrays of strings. | 184 # as sorting arrays of strings. |
| 188 js1_5/extensions/regress-371636: PASS || FAIL || TIMEOUT if $mode == debug | 185 js1_5/extensions/regress-371636: PASS || FAIL || TIMEOUT if $mode == debug |
| 189 | 186 |
| 190 | 187 |
| 191 # Tests depend on GC timings. Inherently flaky. | 188 # Tests depend on GC timings. Inherently flaky. |
| 192 js1_5/GC/regress-383269-01: PASS || FAIL | 189 js1_5/GC/regress-383269-01: PASS || FAIL |
| (...skipping 198 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 391 js1_5/Regress/regress-410852: FAIL_OK | 388 js1_5/Regress/regress-410852: FAIL_OK |
| 392 ecma_3/RegExp/regress-375715-04: FAIL_OK | 389 ecma_3/RegExp/regress-375715-04: FAIL_OK |
| 393 js1_5/decompilation/regress-456964-01: FAIL_OK | 390 js1_5/decompilation/regress-456964-01: FAIL_OK |
| 394 js1_5/decompilation/regress-437288-02: FAIL_OK | 391 js1_5/decompilation/regress-437288-02: FAIL_OK |
| 395 js1_5/decompilation/regress-457824: FAIL_OK | 392 js1_5/decompilation/regress-457824: FAIL_OK |
| 396 js1_5/decompilation/regress-460116-01: FAIL_OK | 393 js1_5/decompilation/regress-460116-01: FAIL_OK |
| 397 js1_5/decompilation/regress-460116-02: FAIL_OK | 394 js1_5/decompilation/regress-460116-02: FAIL_OK |
| 398 js1_5/decompilation/regress-460501: FAIL_OK | 395 js1_5/decompilation/regress-460501: FAIL_OK |
| 399 js1_5/decompilation/regress-460116-03: FAIL_OK | 396 js1_5/decompilation/regress-460116-03: FAIL_OK |
| 400 js1_5/decompilation/regress-461110: FAIL_OK | 397 js1_5/decompilation/regress-461110: FAIL_OK |
| 401 js1_5/decompilation/regress-456964-01: FAIL_OK | |
| 402 js1_5/decompilation/regress-437288-02: FAIL_OK | |
| 403 js1_5/decompilation/regress-457824: FAIL_OK | |
| 404 js1_5/decompilation/regress-460116-01: FAIL_OK | |
| 405 js1_5/decompilation/regress-460116-02: FAIL_OK | |
| 406 js1_5/decompilation/regress-460116-03: FAIL_OK | |
| 407 js1_5/decompilation/regress-460501: FAIL_OK | |
| 408 js1_5/decompilation/regress-461110: FAIL_OK | |
| 409 | |
| 410 | 398 |
| 411 | 399 |
| 412 # Tests that use uneval. Non-ECMA. | 400 # Tests that use uneval. Non-ECMA. |
| 413 js1_5/GC/regress-418128: FAIL_OK | 401 js1_5/GC/regress-418128: FAIL_OK |
| 414 js1_5/extensions/regress-465276: FAIL_OK | 402 js1_5/extensions/regress-465276: FAIL_OK |
| 415 js1_5/Error/regress-465377: FAIL_OK | 403 js1_5/Error/regress-465377: FAIL_OK |
| 416 | 404 |
| 417 # Tests that use the watch method. Non-ECMA. | 405 # Tests that use the watch method. Non-ECMA. |
| 418 js1_5/extensions/regress-435345-01: FAIL_OK | 406 js1_5/extensions/regress-435345-01: FAIL_OK |
| 419 js1_5/extensions/regress-455413: FAIL_OK | 407 js1_5/extensions/regress-455413: FAIL_OK |
| (...skipping 136 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 556 # behavior and not the ECMA spec. | 544 # behavior and not the ECMA spec. |
| 557 ecma_3/RegExp/perlstress-001: PASS || FAIL_OK | 545 ecma_3/RegExp/perlstress-001: PASS || FAIL_OK |
| 558 ecma_3/RegExp/regress-334158: PASS || FAIL | 546 ecma_3/RegExp/regress-334158: PASS || FAIL |
| 559 | 547 |
| 560 # This test fails due to http://code.google.com/p/v8/issues/detail?id=187 | 548 # This test fails due to http://code.google.com/p/v8/issues/detail?id=187 |
| 561 # Failure to clear captures when a lookahead is unwound. | 549 # Failure to clear captures when a lookahead is unwound. |
| 562 ecma_3/RegExp/15.10.2-1: PASS || FAIL_OK | 550 ecma_3/RegExp/15.10.2-1: PASS || FAIL_OK |
| 563 | 551 |
| 564 # This test requires a failure if we try to compile a function with more | 552 # This test requires a failure if we try to compile a function with more |
| 565 # than 65536 arguments. This seems to be a Mozilla restriction. | 553 # than 65536 arguments. This seems to be a Mozilla restriction. |
| 566 js1_5/Regress/regress-290575: FAIL_OK | 554 js1_5/Regress/regress-290575: PASS || FAIL_OK |
| 567 | 555 |
| 568 | 556 |
| 569 # Fails because of the way function declarations are | 557 # Fails because of the way function declarations are |
| 570 # handled in V8/JSC. V8 follows IE behavior and introduce | 558 # handled in V8/JSC. V8 follows IE behavior and introduce |
| 571 # all nested function declarations when entering the | 559 # all nested function declarations when entering the |
| 572 # surrounding function, whereas Spidermonkey declares | 560 # surrounding function, whereas Spidermonkey declares |
| 573 # them dynamically when the statement is executed. | 561 # them dynamically when the statement is executed. |
| 574 ecma_3/Function/scope-001: FAIL_OK | 562 ecma_3/Function/scope-001: FAIL_OK |
| 575 ecma_3/FunExpr/fe-001: FAIL_OK | 563 ecma_3/FunExpr/fe-001: FAIL_OK |
| 576 js1_5/Scope/regress-184107: FAIL_OK | 564 js1_5/Scope/regress-184107: FAIL_OK |
| (...skipping 173 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 750 js1_5/extensions/regress-50447: FAIL_OK | 738 js1_5/extensions/regress-50447: FAIL_OK |
| 751 js1_5/extensions/regress-90596-001: FAIL_OK | 739 js1_5/extensions/regress-90596-001: FAIL_OK |
| 752 js1_5/extensions/regress-90596-002: FAIL_OK | 740 js1_5/extensions/regress-90596-002: FAIL_OK |
| 753 js1_5/extensions/regress-96284-001: FAIL_OK | 741 js1_5/extensions/regress-96284-001: FAIL_OK |
| 754 js1_5/extensions/regress-96284-002: FAIL_OK | 742 js1_5/extensions/regress-96284-002: FAIL_OK |
| 755 js1_5/extensions/toLocaleFormat-01: FAIL_OK | 743 js1_5/extensions/toLocaleFormat-01: FAIL_OK |
| 756 js1_5/extensions/toLocaleFormat-02: FAIL_OK | 744 js1_5/extensions/toLocaleFormat-02: FAIL_OK |
| 757 | 745 |
| 758 js1_5/extensions/regress-330569: TIMEOUT | 746 js1_5/extensions/regress-330569: TIMEOUT |
| 759 js1_5/extensions/regress-351448: TIMEOUT | 747 js1_5/extensions/regress-351448: TIMEOUT |
| 760 js1_5/extensions/regress-342960: FAIL_OK || TIMEOUT if $mode == debug | |
| 761 # In the 64-bit version, this test takes longer to run out of memory | 748 # In the 64-bit version, this test takes longer to run out of memory |
| 762 # than it does in the 32-bit version when attempting to generate a huge | 749 # than it does in the 32-bit version when attempting to generate a huge |
| 763 # error message in debug mode. | 750 # error message in debug mode. |
| 764 js1_5/extensions/regress-336410-1: FAIL_OK || TIMEOUT if ($mode == debug && $arc
h == x64) | 751 js1_5/extensions/regress-336410-1: FAIL_OK || TIMEOUT if ($mode == debug && $arc
h == x64) |
| 765 | 752 |
| 766 ##################### DECOMPILATION TESTS ##################### | 753 ##################### DECOMPILATION TESTS ##################### |
| 767 | 754 |
| 768 # We don't really about the outcome of running the | 755 # We don't really about the outcome of running the |
| 769 # decompilation tests as long as they don't crash or | 756 # decompilation tests as long as they don't crash or |
| 770 # timeout. | 757 # timeout. |
| (...skipping 47 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 818 js1_5/decompilation/regress-375639: PASS || FAIL | 805 js1_5/decompilation/regress-375639: PASS || FAIL |
| 819 js1_5/decompilation/regress-375882: PASS || FAIL | 806 js1_5/decompilation/regress-375882: PASS || FAIL |
| 820 js1_5/decompilation/regress-376564: PASS || FAIL | 807 js1_5/decompilation/regress-376564: PASS || FAIL |
| 821 js1_5/decompilation/regress-383721: PASS || FAIL | 808 js1_5/decompilation/regress-383721: PASS || FAIL |
| 822 js1_5/decompilation/regress-406555: PASS || FAIL | 809 js1_5/decompilation/regress-406555: PASS || FAIL |
| 823 js1_5/decompilation/regress-460870: PASS || FAIL | 810 js1_5/decompilation/regress-460870: PASS || FAIL |
| 824 | 811 |
| 825 | 812 |
| 826 [ $arch == arm ] | 813 [ $arch == arm ] |
| 827 | 814 |
| 828 # Times out and print so much output that we need to skip it to not | |
| 829 # hang the builder. | |
| 830 js1_5/extensions/regress-342960: SKIP | |
| 831 | |
| 832 # BUG(3251229): Times out when running new crankshaft test script. | 815 # BUG(3251229): Times out when running new crankshaft test script. |
| 833 ecma_3/RegExp/regress-311414: SKIP | 816 ecma_3/RegExp/regress-311414: SKIP |
| 834 ecma/Date/15.9.5.8: SKIP | 817 ecma/Date/15.9.5.8: SKIP |
| 835 ecma/Date/15.9.5.10-2: SKIP | 818 ecma/Date/15.9.5.10-2: SKIP |
| 836 ecma/Date/15.9.5.11-2: SKIP | 819 ecma/Date/15.9.5.11-2: SKIP |
| 837 ecma/Date/15.9.5.12-2: SKIP | 820 ecma/Date/15.9.5.12-2: SKIP |
| 838 js1_5/Array/regress-99120-02: SKIP | 821 js1_5/Array/regress-99120-02: SKIP |
| 839 js1_5/extensions/regress-371636: SKIP | 822 js1_5/extensions/regress-371636: SKIP |
| 840 js1_5/Regress/regress-203278-1: SKIP | 823 js1_5/Regress/regress-203278-1: SKIP |
| 841 js1_5/Regress/regress-404755: SKIP | 824 js1_5/Regress/regress-404755: SKIP |
| 842 js1_5/Regress/regress-451322: SKIP | 825 js1_5/Regress/regress-451322: SKIP |
| 843 | 826 |
| 844 | 827 |
| 845 # BUG(1040): Allow this test to timeout. | 828 # BUG(1040): Allow this test to timeout. |
| 846 js1_5/GC/regress-203278-2: PASS || TIMEOUT | 829 js1_5/GC/regress-203278-2: PASS || TIMEOUT |
| 847 | 830 |
| 848 | 831 |
| 849 [ $arch == mipsel ] | 832 [ $arch == mipsel ] |
| 850 | 833 |
| 851 # Times out and print so much output that we need to skip it to not | |
| 852 # hang the builder. | |
| 853 js1_5/extensions/regress-342960: SKIP | |
| 854 | |
| 855 # BUG(3251229): Times out when running new crankshaft test script. | 834 # BUG(3251229): Times out when running new crankshaft test script. |
| 856 ecma_3/RegExp/regress-311414: SKIP | 835 ecma_3/RegExp/regress-311414: SKIP |
| 857 ecma/Date/15.9.5.8: SKIP | 836 ecma/Date/15.9.5.8: SKIP |
| 858 ecma/Date/15.9.5.10-2: SKIP | 837 ecma/Date/15.9.5.10-2: SKIP |
| 859 ecma/Date/15.9.5.11-2: SKIP | 838 ecma/Date/15.9.5.11-2: SKIP |
| 860 ecma/Date/15.9.5.12-2: SKIP | 839 ecma/Date/15.9.5.12-2: SKIP |
| 861 js1_5/Array/regress-99120-02: SKIP | 840 js1_5/Array/regress-99120-02: SKIP |
| 862 js1_5/extensions/regress-371636: SKIP | 841 js1_5/extensions/regress-371636: SKIP |
| 863 js1_5/Regress/regress-203278-1: SKIP | 842 js1_5/Regress/regress-203278-1: SKIP |
| 864 js1_5/Regress/regress-404755: SKIP | 843 js1_5/Regress/regress-404755: SKIP |
| 865 js1_5/Regress/regress-451322: SKIP | 844 js1_5/Regress/regress-451322: SKIP |
| 866 | 845 |
| 867 | 846 |
| 868 # BUG(1040): Allow this test to timeout. | 847 # BUG(1040): Allow this test to timeout. |
| 869 js1_5/GC/regress-203278-2: PASS || TIMEOUT | 848 js1_5/GC/regress-203278-2: PASS || TIMEOUT |
| OLD | NEW |