| OLD | NEW |
| 1 # Copyright 2008 the V8 project authors. All rights reserved. | 1 # Copyright 2008 the V8 project authors. All rights reserved. |
| 2 # Redistribution and use in source and binary forms, with or without | 2 # Redistribution and use in source and binary forms, with or without |
| 3 # modification, are permitted provided that the following conditions are | 3 # modification, are permitted provided that the following conditions are |
| 4 # met: | 4 # met: |
| 5 # | 5 # |
| 6 # * Redistributions of source code must retain the above copyright | 6 # * Redistributions of source code must retain the above copyright |
| 7 # notice, this list of conditions and the following disclaimer. | 7 # notice, this list of conditions and the following disclaimer. |
| 8 # * Redistributions in binary form must reproduce the above | 8 # * Redistributions in binary form must reproduce the above |
| 9 # copyright notice, this list of conditions and the following | 9 # copyright notice, this list of conditions and the following |
| 10 # disclaimer in the documentation and/or other materials provided | 10 # disclaimer in the documentation and/or other materials provided |
| (...skipping 70 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 81 js1_5/GC/regress-346794: SLOW | 81 js1_5/GC/regress-346794: SLOW |
| 82 | 82 |
| 83 # Runs out of memory while trying to build huge string of 'x' | 83 # Runs out of memory while trying to build huge string of 'x' |
| 84 # characters. This takes a long time to run (~32 seconds). | 84 # characters. This takes a long time to run (~32 seconds). |
| 85 js1_5/GC/regress-348532: SLOW | 85 js1_5/GC/regress-348532: SLOW |
| 86 | 86 |
| 87 | 87 |
| 88 ##################### FLAKY TESTS ##################### | 88 ##################### FLAKY TESTS ##################### |
| 89 | 89 |
| 90 # These tests time out in debug mode but pass in product mode | 90 # These tests time out in debug mode but pass in product mode |
| 91 js1_5/Regress/regress-360969-03: PASS || TIMEOUT if $mode == debug |
| 92 js1_5/Regress/regress-360969-04: PASS || TIMEOUT if $mode == debug |
| 93 js1_5/Regress/regress-360969-05: PASS || TIMEOUT if $mode == debug |
| 94 js1_5/Regress/regress-360969-06: PASS || TIMEOUT if $mode == debug |
| 95 |
| 91 js1_5/Regress/regress-280769-3: PASS || FAIL if $mode == debug | 96 js1_5/Regress/regress-280769-3: PASS || FAIL if $mode == debug |
| 92 js1_5/Regress/regress-203278-1: PASS || FAIL if $mode == debug | 97 js1_5/Regress/regress-203278-1: PASS || FAIL if $mode == debug |
| 93 js1_5/GC/regress-203278-2: PASS || FAIL if $mode == debug | 98 js1_5/GC/regress-203278-2: PASS || FAIL if $mode == debug |
| 94 js1_5/Regress/regress-244470: PASS || FAIL if $mode == debug | 99 js1_5/Regress/regress-244470: PASS || FAIL if $mode == debug |
| 95 ecma_3/RegExp/regress-209067: PASS || FAIL if $mode == debug | 100 ecma_3/RegExp/regress-209067: PASS || FAIL if $mode == debug |
| 96 js1_5/GC/regress-278725: PASS || FAIL if $mode == debug | 101 js1_5/GC/regress-278725: PASS || FAIL if $mode == debug |
| 97 js1_5/Regress/regress-360969-03: PASS || FAIL if $mode == debug | |
| 98 js1_5/Regress/regress-360969-04: PASS || FAIL if $mode == debug | |
| 99 js1_5/Regress/regress-360969-05: PASS || FAIL if $mode == debug | |
| 100 js1_5/Regress/regress-360969-06: PASS || FAIL if $mode == debug | |
| 101 js1_5/extensions/regress-365527: PASS || FAIL if $mode == debug | 102 js1_5/extensions/regress-365527: PASS || FAIL if $mode == debug |
| 102 # http://b/issue?id=1206983 | 103 # http://b/issue?id=1206983 |
| 103 js1_5/Regress/regress-367561-03: PASS || FAIL if $mode == debug | 104 js1_5/Regress/regress-367561-03: PASS || FAIL if $mode == debug |
| 104 ecma/Date/15.9.5.10-2: PASS || FAIL if $mode == debug | 105 ecma/Date/15.9.5.10-2: PASS || FAIL if $mode == debug |
| 105 | 106 |
| 106 # These tests create two Date objects just after each other and | 107 # These tests create two Date objects just after each other and |
| 107 # expects them to match. Sometimes this happens on the border | 108 # expects them to match. Sometimes this happens on the border |
| 108 # between one second and the next. | 109 # between one second and the next. |
| 109 ecma/Date/15.9.2.1: PASS || FAIL | 110 ecma/Date/15.9.2.1: PASS || FAIL |
| 110 ecma/Date/15.9.2.2-1: PASS || FAIL | 111 ecma/Date/15.9.2.2-1: PASS || FAIL |
| (...skipping 129 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 240 # 'minimum repeat count' is reached, the empty string must not match. | 241 # 'minimum repeat count' is reached, the empty string must not match. |
| 241 # In this case, we are similar but not identical to JSC. Hard to | 242 # In this case, we are similar but not identical to JSC. Hard to |
| 242 # support the JS behavior with PCRE, so maybe emulate JSC? | 243 # support the JS behavior with PCRE, so maybe emulate JSC? |
| 243 ecma_3/RegExp/regress-209919: PASS || FAIL_OK | 244 ecma_3/RegExp/regress-209919: PASS || FAIL_OK |
| 244 js1_5/extensions/regress-459606: PASS || FAIL_OK | 245 js1_5/extensions/regress-459606: PASS || FAIL_OK |
| 245 | 246 |
| 246 | 247 |
| 247 # PCRE's match limit is reached. SpiderMonkey hangs on the first one, | 248 # PCRE's match limit is reached. SpiderMonkey hangs on the first one, |
| 248 # JSC returns true somehow. Maybe they up the match limit? There is | 249 # JSC returns true somehow. Maybe they up the match limit? There is |
| 249 # an open V8 bug 676063 about this. | 250 # an open V8 bug 676063 about this. |
| 250 ecma_3/RegExp/regress-330684: FAIL_OK | 251 ecma_3/RegExp/regress-330684: TIMEOUT |
| 251 | 252 |
| 252 | 253 |
| 253 # This test contains a regexp that runs exponentially long. Spidermonkey | 254 # This test contains a regexp that runs exponentially long. Spidermonkey |
| 254 # standalone will hang, though apparently inside Firefox it will trigger a | 255 # standalone will hang, though apparently inside Firefox it will trigger a |
| 255 # long-running-script timeout. JSCRE passes by hitting the matchLimit and | 256 # long-running-script timeout. JSCRE passes by hitting the matchLimit and |
| 256 # just pretending that an exhaustive search found no match. | 257 # just pretending that an exhaustive search found no match. |
| 257 ecma_3/RegExp/regress-307456: PASS || FAIL_OK | 258 ecma_3/RegExp/regress-307456: PASS || TIMEOUT |
| 258 | 259 |
| 259 | 260 |
| 260 # We do not detect overflow in bounds for back references and {} | 261 # We do not detect overflow in bounds for back references and {} |
| 261 # quantifiers. Might fix by parsing numbers differently? | 262 # quantifiers. Might fix by parsing numbers differently? |
| 262 js1_5/Regress/regress-230216-2: FAIL_OK | 263 js1_5/Regress/regress-230216-2: FAIL_OK |
| 263 | 264 |
| 264 | 265 |
| 265 # Regexp too long for PCRE. | 266 # Regexp too long for PCRE. |
| 266 js1_5/Regress/regress-280769: PASS || FAIL | 267 js1_5/Regress/regress-280769: PASS || FAIL |
| 267 js1_5/Regress/regress-280769-1: PASS || FAIL | 268 js1_5/Regress/regress-280769-1: PASS || FAIL |
| (...skipping 319 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 587 ecma_2/Exceptions/lexical-011: FAIL | 588 ecma_2/Exceptions/lexical-011: FAIL |
| 588 ecma_2/Exceptions/lexical-014: FAIL | 589 ecma_2/Exceptions/lexical-014: FAIL |
| 589 ecma_2/Exceptions/lexical-016: FAIL | 590 ecma_2/Exceptions/lexical-016: FAIL |
| 590 ecma_2/Exceptions/lexical-021: FAIL | 591 ecma_2/Exceptions/lexical-021: FAIL |
| 591 ecma_2/LexicalConventions/keywords-001: FAIL | 592 ecma_2/LexicalConventions/keywords-001: FAIL |
| 592 js1_5/Regress/regress-306633: FAIL | 593 js1_5/Regress/regress-306633: FAIL |
| 593 | 594 |
| 594 | 595 |
| 595 # This test seems designed to fail (it produces a 700Mbyte string). | 596 # This test seems designed to fail (it produces a 700Mbyte string). |
| 596 # We fail on out of memory. The important thing is not to crash. | 597 # We fail on out of memory. The important thing is not to crash. |
| 597 js1_5/Regress/regress-303213: FAIL | 598 js1_5/Regress/regress-303213: FAIL || TIMEOUT if $mode == debug |
| 598 | 599 |
| 599 | 600 |
| 600 # Bug 1202592: New ecma_3/String/15.5.4.11 is failing. | 601 # Bug 1202592: New ecma_3/String/15.5.4.11 is failing. |
| 601 ecma_3/String/15.5.4.11: FAIL | 602 ecma_3/String/15.5.4.11: FAIL |
| 602 | 603 |
| 603 # Bug 1202597: New js1_5/Expressions/regress-394673 is failing. | 604 # Bug 1202597: New js1_5/Expressions/regress-394673 is failing. |
| 604 # Marked as: Will not fix. V8 throws an acceptable RangeError. | 605 # Marked as: Will not fix. V8 throws an acceptable RangeError. |
| 605 js1_5/Expressions/regress-394673: FAIL | 606 js1_5/Expressions/regress-394673: FAIL |
| 606 | 607 |
| 607 ##################### MOZILLA EXTENSION TESTS ##################### | 608 ##################### MOZILLA EXTENSION TESTS ##################### |
| (...skipping 15 matching lines...) Expand all Loading... |
| 623 js1_5/extensions/regress-311161: FAIL_OK | 624 js1_5/extensions/regress-311161: FAIL_OK |
| 624 js1_5/extensions/regress-311583: FAIL_OK | 625 js1_5/extensions/regress-311583: FAIL_OK |
| 625 js1_5/extensions/regress-311792-01: FAIL_OK | 626 js1_5/extensions/regress-311792-01: FAIL_OK |
| 626 js1_5/extensions/regress-312278: FAIL_OK | 627 js1_5/extensions/regress-312278: FAIL_OK |
| 627 js1_5/extensions/regress-313630: FAIL_OK | 628 js1_5/extensions/regress-313630: FAIL_OK |
| 628 js1_5/extensions/regress-313763: FAIL_OK | 629 js1_5/extensions/regress-313763: FAIL_OK |
| 629 js1_5/extensions/regress-313803: FAIL_OK | 630 js1_5/extensions/regress-313803: FAIL_OK |
| 630 js1_5/extensions/regress-314874: FAIL_OK | 631 js1_5/extensions/regress-314874: FAIL_OK |
| 631 js1_5/extensions/regress-322957: FAIL_OK | 632 js1_5/extensions/regress-322957: FAIL_OK |
| 632 js1_5/extensions/regress-328556: FAIL_OK | 633 js1_5/extensions/regress-328556: FAIL_OK |
| 633 js1_5/extensions/regress-330569: FAIL_OK | |
| 634 js1_5/extensions/regress-333541: FAIL_OK | 634 js1_5/extensions/regress-333541: FAIL_OK |
| 635 js1_5/extensions/regress-335700: FAIL_OK | 635 js1_5/extensions/regress-335700: FAIL_OK |
| 636 js1_5/extensions/regress-336409-1: FAIL_OK | 636 js1_5/extensions/regress-336409-1: FAIL_OK |
| 637 js1_5/extensions/regress-336409-2: FAIL_OK | 637 js1_5/extensions/regress-336409-2: FAIL_OK |
| 638 js1_5/extensions/regress-336410-1: FAIL_OK | 638 js1_5/extensions/regress-336410-1: FAIL_OK |
| 639 js1_5/extensions/regress-336410-2: FAIL_OK | 639 js1_5/extensions/regress-336410-2: FAIL_OK |
| 640 js1_5/extensions/regress-341956-01: FAIL_OK | 640 js1_5/extensions/regress-341956-01: FAIL_OK |
| 641 js1_5/extensions/regress-341956-02: FAIL_OK | 641 js1_5/extensions/regress-341956-02: FAIL_OK |
| 642 js1_5/extensions/regress-341956-03: FAIL_OK | 642 js1_5/extensions/regress-341956-03: FAIL_OK |
| 643 js1_5/extensions/regress-342960: FAIL_OK | |
| 644 js1_5/extensions/regress-345967: FAIL_OK | 643 js1_5/extensions/regress-345967: FAIL_OK |
| 645 js1_5/extensions/regress-346494-01: FAIL_OK | 644 js1_5/extensions/regress-346494-01: FAIL_OK |
| 646 js1_5/extensions/regress-346494: FAIL_OK | 645 js1_5/extensions/regress-346494: FAIL_OK |
| 647 js1_5/extensions/regress-347306-02: FAIL_OK | 646 js1_5/extensions/regress-347306-02: FAIL_OK |
| 648 js1_5/extensions/regress-348986: FAIL_OK | 647 js1_5/extensions/regress-348986: FAIL_OK |
| 649 js1_5/extensions/regress-349616: FAIL_OK | 648 js1_5/extensions/regress-349616: FAIL_OK |
| 650 js1_5/extensions/regress-350312-02: FAIL_OK | 649 js1_5/extensions/regress-350312-02: FAIL_OK |
| 651 js1_5/extensions/regress-350312-03: FAIL_OK | 650 js1_5/extensions/regress-350312-03: FAIL_OK |
| 652 js1_5/extensions/regress-350531: FAIL_OK | 651 js1_5/extensions/regress-350531: FAIL_OK |
| 653 js1_5/extensions/regress-351102-01: FAIL_OK | 652 js1_5/extensions/regress-351102-01: FAIL_OK |
| 654 js1_5/extensions/regress-351102-02: FAIL_OK | 653 js1_5/extensions/regress-351102-02: FAIL_OK |
| 655 js1_5/extensions/regress-351102-06: FAIL_OK | 654 js1_5/extensions/regress-351102-06: FAIL_OK |
| 656 js1_5/extensions/regress-351448: FAIL_OK | |
| 657 js1_5/extensions/regress-351973: FAIL_OK | 655 js1_5/extensions/regress-351973: FAIL_OK |
| 658 js1_5/extensions/regress-352060: FAIL_OK | 656 js1_5/extensions/regress-352060: FAIL_OK |
| 659 js1_5/extensions/regress-352094: FAIL_OK | 657 js1_5/extensions/regress-352094: FAIL_OK |
| 660 js1_5/extensions/regress-352261: FAIL_OK | 658 js1_5/extensions/regress-352261: FAIL_OK |
| 661 js1_5/extensions/regress-352281: FAIL_OK | 659 js1_5/extensions/regress-352281: FAIL_OK |
| 662 js1_5/extensions/regress-352372: FAIL_OK | 660 js1_5/extensions/regress-352372: FAIL_OK |
| 663 js1_5/extensions/regress-352455: FAIL_OK | 661 js1_5/extensions/regress-352455: FAIL_OK |
| 664 js1_5/extensions/regress-352604: FAIL_OK | 662 js1_5/extensions/regress-352604: FAIL_OK |
| 665 js1_5/extensions/regress-353214: FAIL_OK | 663 js1_5/extensions/regress-353214: FAIL_OK |
| 666 js1_5/extensions/regress-355339: FAIL_OK | 664 js1_5/extensions/regress-355339: FAIL_OK |
| (...skipping 42 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 709 js1_5/extensions/regress-50447-1: FAIL_OK | 707 js1_5/extensions/regress-50447-1: FAIL_OK |
| 710 js1_5/extensions/regress-50447: FAIL_OK | 708 js1_5/extensions/regress-50447: FAIL_OK |
| 711 js1_5/extensions/regress-90596-001: FAIL_OK | 709 js1_5/extensions/regress-90596-001: FAIL_OK |
| 712 js1_5/extensions/regress-90596-002: FAIL_OK | 710 js1_5/extensions/regress-90596-002: FAIL_OK |
| 713 js1_5/extensions/regress-96284-001: FAIL_OK | 711 js1_5/extensions/regress-96284-001: FAIL_OK |
| 714 js1_5/extensions/regress-96284-002: FAIL_OK | 712 js1_5/extensions/regress-96284-002: FAIL_OK |
| 715 js1_5/extensions/scope-001: FAIL_OK | 713 js1_5/extensions/scope-001: FAIL_OK |
| 716 js1_5/extensions/toLocaleFormat-01: FAIL_OK | 714 js1_5/extensions/toLocaleFormat-01: FAIL_OK |
| 717 js1_5/extensions/toLocaleFormat-02: FAIL_OK | 715 js1_5/extensions/toLocaleFormat-02: FAIL_OK |
| 718 | 716 |
| 717 js1_5/extensions/regress-330569: TIMEOUT |
| 718 js1_5/extensions/regress-351448: TIMEOUT |
| 719 js1_5/extensions/regress-342960: FAIL_OK || TIMEOUT if $mode == debug |
| 720 |
| 719 | 721 |
| 720 ##################### DECOMPILATION TESTS ##################### | 722 ##################### DECOMPILATION TESTS ##################### |
| 721 | 723 |
| 722 # We don't really about the outcome of running the | 724 # We don't really about the outcome of running the |
| 723 # decompilation tests as long as they don't crash or | 725 # decompilation tests as long as they don't crash or |
| 724 # timeout. | 726 # timeout. |
| 725 | 727 |
| 726 js1_5/decompilation/regress-344120: PASS || FAIL | 728 js1_5/decompilation/regress-344120: PASS || FAIL |
| 727 js1_5/decompilation/regress-346892: PASS || FAIL | 729 js1_5/decompilation/regress-346892: PASS || FAIL |
| 728 js1_5/decompilation/regress-346902: PASS || FAIL | 730 js1_5/decompilation/regress-346902: PASS || FAIL |
| (...skipping 40 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 769 js1_5/decompilation/regress-356248: PASS || FAIL | 771 js1_5/decompilation/regress-356248: PASS || FAIL |
| 770 js1_5/decompilation/regress-371692: PASS || FAIL | 772 js1_5/decompilation/regress-371692: PASS || FAIL |
| 771 js1_5/decompilation/regress-373678: PASS || FAIL | 773 js1_5/decompilation/regress-373678: PASS || FAIL |
| 772 js1_5/decompilation/regress-375639: PASS || FAIL | 774 js1_5/decompilation/regress-375639: PASS || FAIL |
| 773 js1_5/decompilation/regress-375882: PASS || FAIL | 775 js1_5/decompilation/regress-375882: PASS || FAIL |
| 774 js1_5/decompilation/regress-376564: PASS || FAIL | 776 js1_5/decompilation/regress-376564: PASS || FAIL |
| 775 js1_5/decompilation/regress-383721: PASS || FAIL | 777 js1_5/decompilation/regress-383721: PASS || FAIL |
| 776 js1_5/decompilation/regress-406555: PASS || FAIL | 778 js1_5/decompilation/regress-406555: PASS || FAIL |
| 777 | 779 |
| 778 | 780 |
| 779 [ $FAST == yes ] | |
| 780 | |
| 781 # These tests take an unreasonable amount of time so we skip them | 781 # These tests take an unreasonable amount of time so we skip them |
| 782 # in fast mode. | 782 # in fast mode. |
| 783 | 783 |
| 784 js1_5/Regress/regress-312588: SKIP | 784 js1_5/Regress/regress-312588: TIMEOUT || SKIP if $FAST == yes |
| 785 js1_5/Regress/regress-271716-n: SKIP | 785 js1_5/Regress/regress-271716-n: PASS || SKIP if $FAST == yes |
| 786 | 786 |
| 787 | 787 |
| 788 [ $FAST == yes && $ARCH == arm ] | 788 [ $FAST == yes && $ARCH == arm ] |
| 789 | 789 |
| 790 # In fast mode on arm we try to skip all tests that would time out, | 790 # In fast mode on arm we try to skip all tests that would time out, |
| 791 # since running the tests takes so long in the first place. | 791 # since running the tests takes so long in the first place. |
| 792 | 792 |
| 793 js1_5/Regress/regress-280769-2: SKIP | 793 js1_5/Regress/regress-280769-2: SKIP |
| 794 js1_5/Regress/regress-280769-3: SKIP | 794 js1_5/Regress/regress-280769-3: SKIP |
| 795 js1_5/Regress/regress-244470: SKIP | 795 js1_5/Regress/regress-244470: SKIP |
| (...skipping 16 matching lines...) Expand all Loading... |
| 812 ecma/Date/15.9.5.8: SKIP | 812 ecma/Date/15.9.5.8: SKIP |
| 813 ecma/Date/15.9.5.9: SKIP | 813 ecma/Date/15.9.5.9: SKIP |
| 814 ecma/Date/15.9.5.10-2: SKIP | 814 ecma/Date/15.9.5.10-2: SKIP |
| 815 ecma/Date/15.9.5.11-2: SKIP | 815 ecma/Date/15.9.5.11-2: SKIP |
| 816 ecma/Expressions/11.7.2: SKIP | 816 ecma/Expressions/11.7.2: SKIP |
| 817 ecma/Expressions/11.10-2: SKIP | 817 ecma/Expressions/11.10-2: SKIP |
| 818 ecma/Expressions/11.7.3: SKIP | 818 ecma/Expressions/11.7.3: SKIP |
| 819 ecma/Expressions/11.10-3: SKIP | 819 ecma/Expressions/11.10-3: SKIP |
| 820 ecma/Expressions/11.7.1: SKIP | 820 ecma/Expressions/11.7.1: SKIP |
| 821 ecma_3/RegExp/regress-209067: SKIP | 821 ecma_3/RegExp/regress-209067: SKIP |
| OLD | NEW |