OLD | NEW |
1 # Copyright 2008 the V8 project authors. All rights reserved. | 1 # Copyright 2008 the V8 project authors. All rights reserved. |
2 # Redistribution and use in source and binary forms, with or without | 2 # Redistribution and use in source and binary forms, with or without |
3 # modification, are permitted provided that the following conditions are | 3 # modification, are permitted provided that the following conditions are |
4 # met: | 4 # met: |
5 # | 5 # |
6 # * Redistributions of source code must retain the above copyright | 6 # * Redistributions of source code must retain the above copyright |
7 # notice, this list of conditions and the following disclaimer. | 7 # notice, this list of conditions and the following disclaimer. |
8 # * Redistributions in binary form must reproduce the above | 8 # * Redistributions in binary form must reproduce the above |
9 # copyright notice, this list of conditions and the following | 9 # copyright notice, this list of conditions and the following |
10 # disclaimer in the documentation and/or other materials provided | 10 # disclaimer in the documentation and/or other materials provided |
(...skipping 70 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
81 js1_5/GC/regress-346794: SLOW | 81 js1_5/GC/regress-346794: SLOW |
82 | 82 |
83 # Runs out of memory while trying to build huge string of 'x' | 83 # Runs out of memory while trying to build huge string of 'x' |
84 # characters. This takes a long time to run (~32 seconds). | 84 # characters. This takes a long time to run (~32 seconds). |
85 js1_5/GC/regress-348532: SLOW | 85 js1_5/GC/regress-348532: SLOW |
86 | 86 |
87 | 87 |
88 ##################### FLAKY TESTS ##################### | 88 ##################### FLAKY TESTS ##################### |
89 | 89 |
90 # These tests time out in debug mode but pass in product mode | 90 # These tests time out in debug mode but pass in product mode |
| 91 js1_5/Regress/regress-360969-03: PASS || TIMEOUT if $mode == debug |
| 92 js1_5/Regress/regress-360969-04: PASS || TIMEOUT if $mode == debug |
| 93 js1_5/Regress/regress-360969-05: PASS || TIMEOUT if $mode == debug |
| 94 js1_5/Regress/regress-360969-06: PASS || TIMEOUT if $mode == debug |
| 95 |
91 js1_5/Regress/regress-280769-3: PASS || FAIL if $mode == debug | 96 js1_5/Regress/regress-280769-3: PASS || FAIL if $mode == debug |
92 js1_5/Regress/regress-203278-1: PASS || FAIL if $mode == debug | 97 js1_5/Regress/regress-203278-1: PASS || FAIL if $mode == debug |
93 js1_5/GC/regress-203278-2: PASS || FAIL if $mode == debug | 98 js1_5/GC/regress-203278-2: PASS || FAIL if $mode == debug |
94 js1_5/Regress/regress-244470: PASS || FAIL if $mode == debug | 99 js1_5/Regress/regress-244470: PASS || FAIL if $mode == debug |
95 ecma_3/RegExp/regress-209067: PASS || FAIL if $mode == debug | 100 ecma_3/RegExp/regress-209067: PASS || FAIL if $mode == debug |
96 js1_5/GC/regress-278725: PASS || FAIL if $mode == debug | 101 js1_5/GC/regress-278725: PASS || FAIL if $mode == debug |
97 js1_5/Regress/regress-360969-03: PASS || FAIL if $mode == debug | |
98 js1_5/Regress/regress-360969-04: PASS || FAIL if $mode == debug | |
99 js1_5/Regress/regress-360969-05: PASS || FAIL if $mode == debug | |
100 js1_5/Regress/regress-360969-06: PASS || FAIL if $mode == debug | |
101 js1_5/extensions/regress-365527: PASS || FAIL if $mode == debug | 102 js1_5/extensions/regress-365527: PASS || FAIL if $mode == debug |
102 # http://b/issue?id=1206983 | 103 # http://b/issue?id=1206983 |
103 js1_5/Regress/regress-367561-03: PASS || FAIL if $mode == debug | 104 js1_5/Regress/regress-367561-03: PASS || FAIL if $mode == debug |
104 ecma/Date/15.9.5.10-2: PASS || FAIL if $mode == debug | 105 ecma/Date/15.9.5.10-2: PASS || FAIL if $mode == debug |
105 | 106 |
106 # These tests create two Date objects just after each other and | 107 # These tests create two Date objects just after each other and |
107 # expects them to match. Sometimes this happens on the border | 108 # expects them to match. Sometimes this happens on the border |
108 # between one second and the next. | 109 # between one second and the next. |
109 ecma/Date/15.9.2.1: PASS || FAIL | 110 ecma/Date/15.9.2.1: PASS || FAIL |
110 ecma/Date/15.9.2.2-1: PASS || FAIL | 111 ecma/Date/15.9.2.2-1: PASS || FAIL |
(...skipping 129 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
240 # 'minimum repeat count' is reached, the empty string must not match. | 241 # 'minimum repeat count' is reached, the empty string must not match. |
241 # In this case, we are similar but not identical to JSC. Hard to | 242 # In this case, we are similar but not identical to JSC. Hard to |
242 # support the JS behavior with PCRE, so maybe emulate JSC? | 243 # support the JS behavior with PCRE, so maybe emulate JSC? |
243 ecma_3/RegExp/regress-209919: PASS || FAIL_OK | 244 ecma_3/RegExp/regress-209919: PASS || FAIL_OK |
244 js1_5/extensions/regress-459606: PASS || FAIL_OK | 245 js1_5/extensions/regress-459606: PASS || FAIL_OK |
245 | 246 |
246 | 247 |
247 # PCRE's match limit is reached. SpiderMonkey hangs on the first one, | 248 # PCRE's match limit is reached. SpiderMonkey hangs on the first one, |
248 # JSC returns true somehow. Maybe they up the match limit? There is | 249 # JSC returns true somehow. Maybe they up the match limit? There is |
249 # an open V8 bug 676063 about this. | 250 # an open V8 bug 676063 about this. |
250 ecma_3/RegExp/regress-330684: FAIL_OK | 251 ecma_3/RegExp/regress-330684: TIMEOUT |
251 | 252 |
252 | 253 |
253 # This test contains a regexp that runs exponentially long. Spidermonkey | 254 # This test contains a regexp that runs exponentially long. Spidermonkey |
254 # standalone will hang, though apparently inside Firefox it will trigger a | 255 # standalone will hang, though apparently inside Firefox it will trigger a |
255 # long-running-script timeout. JSCRE passes by hitting the matchLimit and | 256 # long-running-script timeout. JSCRE passes by hitting the matchLimit and |
256 # just pretending that an exhaustive search found no match. | 257 # just pretending that an exhaustive search found no match. |
257 ecma_3/RegExp/regress-307456: PASS || FAIL_OK | 258 ecma_3/RegExp/regress-307456: PASS || TIMEOUT |
258 | 259 |
259 | 260 |
260 # We do not detect overflow in bounds for back references and {} | 261 # We do not detect overflow in bounds for back references and {} |
261 # quantifiers. Might fix by parsing numbers differently? | 262 # quantifiers. Might fix by parsing numbers differently? |
262 js1_5/Regress/regress-230216-2: FAIL_OK | 263 js1_5/Regress/regress-230216-2: FAIL_OK |
263 | 264 |
264 | 265 |
265 # Regexp too long for PCRE. | 266 # Regexp too long for PCRE. |
266 js1_5/Regress/regress-280769: PASS || FAIL | 267 js1_5/Regress/regress-280769: PASS || FAIL |
267 js1_5/Regress/regress-280769-1: PASS || FAIL | 268 js1_5/Regress/regress-280769-1: PASS || FAIL |
(...skipping 319 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
587 ecma_2/Exceptions/lexical-011: FAIL | 588 ecma_2/Exceptions/lexical-011: FAIL |
588 ecma_2/Exceptions/lexical-014: FAIL | 589 ecma_2/Exceptions/lexical-014: FAIL |
589 ecma_2/Exceptions/lexical-016: FAIL | 590 ecma_2/Exceptions/lexical-016: FAIL |
590 ecma_2/Exceptions/lexical-021: FAIL | 591 ecma_2/Exceptions/lexical-021: FAIL |
591 ecma_2/LexicalConventions/keywords-001: FAIL | 592 ecma_2/LexicalConventions/keywords-001: FAIL |
592 js1_5/Regress/regress-306633: FAIL | 593 js1_5/Regress/regress-306633: FAIL |
593 | 594 |
594 | 595 |
595 # This test seems designed to fail (it produces a 700Mbyte string). | 596 # This test seems designed to fail (it produces a 700Mbyte string). |
596 # We fail on out of memory. The important thing is not to crash. | 597 # We fail on out of memory. The important thing is not to crash. |
597 js1_5/Regress/regress-303213: FAIL | 598 js1_5/Regress/regress-303213: FAIL || TIMEOUT if $mode == debug |
598 | 599 |
599 | 600 |
600 # Bug 1202592: New ecma_3/String/15.5.4.11 is failing. | 601 # Bug 1202592: New ecma_3/String/15.5.4.11 is failing. |
601 ecma_3/String/15.5.4.11: FAIL | 602 ecma_3/String/15.5.4.11: FAIL |
602 | 603 |
603 # Bug 1202597: New js1_5/Expressions/regress-394673 is failing. | 604 # Bug 1202597: New js1_5/Expressions/regress-394673 is failing. |
604 # Marked as: Will not fix. V8 throws an acceptable RangeError. | 605 # Marked as: Will not fix. V8 throws an acceptable RangeError. |
605 js1_5/Expressions/regress-394673: FAIL | 606 js1_5/Expressions/regress-394673: FAIL |
606 | 607 |
607 ##################### MOZILLA EXTENSION TESTS ##################### | 608 ##################### MOZILLA EXTENSION TESTS ##################### |
(...skipping 15 matching lines...) Expand all Loading... |
623 js1_5/extensions/regress-311161: FAIL_OK | 624 js1_5/extensions/regress-311161: FAIL_OK |
624 js1_5/extensions/regress-311583: FAIL_OK | 625 js1_5/extensions/regress-311583: FAIL_OK |
625 js1_5/extensions/regress-311792-01: FAIL_OK | 626 js1_5/extensions/regress-311792-01: FAIL_OK |
626 js1_5/extensions/regress-312278: FAIL_OK | 627 js1_5/extensions/regress-312278: FAIL_OK |
627 js1_5/extensions/regress-313630: FAIL_OK | 628 js1_5/extensions/regress-313630: FAIL_OK |
628 js1_5/extensions/regress-313763: FAIL_OK | 629 js1_5/extensions/regress-313763: FAIL_OK |
629 js1_5/extensions/regress-313803: FAIL_OK | 630 js1_5/extensions/regress-313803: FAIL_OK |
630 js1_5/extensions/regress-314874: FAIL_OK | 631 js1_5/extensions/regress-314874: FAIL_OK |
631 js1_5/extensions/regress-322957: FAIL_OK | 632 js1_5/extensions/regress-322957: FAIL_OK |
632 js1_5/extensions/regress-328556: FAIL_OK | 633 js1_5/extensions/regress-328556: FAIL_OK |
633 js1_5/extensions/regress-330569: FAIL_OK | |
634 js1_5/extensions/regress-333541: FAIL_OK | 634 js1_5/extensions/regress-333541: FAIL_OK |
635 js1_5/extensions/regress-335700: FAIL_OK | 635 js1_5/extensions/regress-335700: FAIL_OK |
636 js1_5/extensions/regress-336409-1: FAIL_OK | 636 js1_5/extensions/regress-336409-1: FAIL_OK |
637 js1_5/extensions/regress-336409-2: FAIL_OK | 637 js1_5/extensions/regress-336409-2: FAIL_OK |
638 js1_5/extensions/regress-336410-1: FAIL_OK | 638 js1_5/extensions/regress-336410-1: FAIL_OK |
639 js1_5/extensions/regress-336410-2: FAIL_OK | 639 js1_5/extensions/regress-336410-2: FAIL_OK |
640 js1_5/extensions/regress-341956-01: FAIL_OK | 640 js1_5/extensions/regress-341956-01: FAIL_OK |
641 js1_5/extensions/regress-341956-02: FAIL_OK | 641 js1_5/extensions/regress-341956-02: FAIL_OK |
642 js1_5/extensions/regress-341956-03: FAIL_OK | 642 js1_5/extensions/regress-341956-03: FAIL_OK |
643 js1_5/extensions/regress-342960: FAIL_OK | |
644 js1_5/extensions/regress-345967: FAIL_OK | 643 js1_5/extensions/regress-345967: FAIL_OK |
645 js1_5/extensions/regress-346494-01: FAIL_OK | 644 js1_5/extensions/regress-346494-01: FAIL_OK |
646 js1_5/extensions/regress-346494: FAIL_OK | 645 js1_5/extensions/regress-346494: FAIL_OK |
647 js1_5/extensions/regress-347306-02: FAIL_OK | 646 js1_5/extensions/regress-347306-02: FAIL_OK |
648 js1_5/extensions/regress-348986: FAIL_OK | 647 js1_5/extensions/regress-348986: FAIL_OK |
649 js1_5/extensions/regress-349616: FAIL_OK | 648 js1_5/extensions/regress-349616: FAIL_OK |
650 js1_5/extensions/regress-350312-02: FAIL_OK | 649 js1_5/extensions/regress-350312-02: FAIL_OK |
651 js1_5/extensions/regress-350312-03: FAIL_OK | 650 js1_5/extensions/regress-350312-03: FAIL_OK |
652 js1_5/extensions/regress-350531: FAIL_OK | 651 js1_5/extensions/regress-350531: FAIL_OK |
653 js1_5/extensions/regress-351102-01: FAIL_OK | 652 js1_5/extensions/regress-351102-01: FAIL_OK |
654 js1_5/extensions/regress-351102-02: FAIL_OK | 653 js1_5/extensions/regress-351102-02: FAIL_OK |
655 js1_5/extensions/regress-351102-06: FAIL_OK | 654 js1_5/extensions/regress-351102-06: FAIL_OK |
656 js1_5/extensions/regress-351448: FAIL_OK | |
657 js1_5/extensions/regress-351973: FAIL_OK | 655 js1_5/extensions/regress-351973: FAIL_OK |
658 js1_5/extensions/regress-352060: FAIL_OK | 656 js1_5/extensions/regress-352060: FAIL_OK |
659 js1_5/extensions/regress-352094: FAIL_OK | 657 js1_5/extensions/regress-352094: FAIL_OK |
660 js1_5/extensions/regress-352261: FAIL_OK | 658 js1_5/extensions/regress-352261: FAIL_OK |
661 js1_5/extensions/regress-352281: FAIL_OK | 659 js1_5/extensions/regress-352281: FAIL_OK |
662 js1_5/extensions/regress-352372: FAIL_OK | 660 js1_5/extensions/regress-352372: FAIL_OK |
663 js1_5/extensions/regress-352455: FAIL_OK | 661 js1_5/extensions/regress-352455: FAIL_OK |
664 js1_5/extensions/regress-352604: FAIL_OK | 662 js1_5/extensions/regress-352604: FAIL_OK |
665 js1_5/extensions/regress-353214: FAIL_OK | 663 js1_5/extensions/regress-353214: FAIL_OK |
666 js1_5/extensions/regress-355339: FAIL_OK | 664 js1_5/extensions/regress-355339: FAIL_OK |
(...skipping 42 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
709 js1_5/extensions/regress-50447-1: FAIL_OK | 707 js1_5/extensions/regress-50447-1: FAIL_OK |
710 js1_5/extensions/regress-50447: FAIL_OK | 708 js1_5/extensions/regress-50447: FAIL_OK |
711 js1_5/extensions/regress-90596-001: FAIL_OK | 709 js1_5/extensions/regress-90596-001: FAIL_OK |
712 js1_5/extensions/regress-90596-002: FAIL_OK | 710 js1_5/extensions/regress-90596-002: FAIL_OK |
713 js1_5/extensions/regress-96284-001: FAIL_OK | 711 js1_5/extensions/regress-96284-001: FAIL_OK |
714 js1_5/extensions/regress-96284-002: FAIL_OK | 712 js1_5/extensions/regress-96284-002: FAIL_OK |
715 js1_5/extensions/scope-001: FAIL_OK | 713 js1_5/extensions/scope-001: FAIL_OK |
716 js1_5/extensions/toLocaleFormat-01: FAIL_OK | 714 js1_5/extensions/toLocaleFormat-01: FAIL_OK |
717 js1_5/extensions/toLocaleFormat-02: FAIL_OK | 715 js1_5/extensions/toLocaleFormat-02: FAIL_OK |
718 | 716 |
| 717 js1_5/extensions/regress-330569: TIMEOUT |
| 718 js1_5/extensions/regress-351448: TIMEOUT |
| 719 js1_5/extensions/regress-342960: FAIL_OK || TIMEOUT if $mode == debug |
| 720 |
719 | 721 |
720 ##################### DECOMPILATION TESTS ##################### | 722 ##################### DECOMPILATION TESTS ##################### |
721 | 723 |
722 # We don't really about the outcome of running the | 724 # We don't really about the outcome of running the |
723 # decompilation tests as long as they don't crash or | 725 # decompilation tests as long as they don't crash or |
724 # timeout. | 726 # timeout. |
725 | 727 |
726 js1_5/decompilation/regress-344120: PASS || FAIL | 728 js1_5/decompilation/regress-344120: PASS || FAIL |
727 js1_5/decompilation/regress-346892: PASS || FAIL | 729 js1_5/decompilation/regress-346892: PASS || FAIL |
728 js1_5/decompilation/regress-346902: PASS || FAIL | 730 js1_5/decompilation/regress-346902: PASS || FAIL |
(...skipping 40 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
769 js1_5/decompilation/regress-356248: PASS || FAIL | 771 js1_5/decompilation/regress-356248: PASS || FAIL |
770 js1_5/decompilation/regress-371692: PASS || FAIL | 772 js1_5/decompilation/regress-371692: PASS || FAIL |
771 js1_5/decompilation/regress-373678: PASS || FAIL | 773 js1_5/decompilation/regress-373678: PASS || FAIL |
772 js1_5/decompilation/regress-375639: PASS || FAIL | 774 js1_5/decompilation/regress-375639: PASS || FAIL |
773 js1_5/decompilation/regress-375882: PASS || FAIL | 775 js1_5/decompilation/regress-375882: PASS || FAIL |
774 js1_5/decompilation/regress-376564: PASS || FAIL | 776 js1_5/decompilation/regress-376564: PASS || FAIL |
775 js1_5/decompilation/regress-383721: PASS || FAIL | 777 js1_5/decompilation/regress-383721: PASS || FAIL |
776 js1_5/decompilation/regress-406555: PASS || FAIL | 778 js1_5/decompilation/regress-406555: PASS || FAIL |
777 | 779 |
778 | 780 |
779 [ $FAST == yes ] | |
780 | |
781 # These tests take an unreasonable amount of time so we skip them | 781 # These tests take an unreasonable amount of time so we skip them |
782 # in fast mode. | 782 # in fast mode. |
783 | 783 |
784 js1_5/Regress/regress-312588: SKIP | 784 js1_5/Regress/regress-312588: TIMEOUT || SKIP if $FAST == yes |
785 js1_5/Regress/regress-271716-n: SKIP | 785 js1_5/Regress/regress-271716-n: PASS || SKIP if $FAST == yes |
786 | 786 |
787 | 787 |
788 [ $FAST == yes && $ARCH == arm ] | 788 [ $FAST == yes && $ARCH == arm ] |
789 | 789 |
790 # In fast mode on arm we try to skip all tests that would time out, | 790 # In fast mode on arm we try to skip all tests that would time out, |
791 # since running the tests takes so long in the first place. | 791 # since running the tests takes so long in the first place. |
792 | 792 |
793 js1_5/Regress/regress-280769-2: SKIP | 793 js1_5/Regress/regress-280769-2: SKIP |
794 js1_5/Regress/regress-280769-3: SKIP | 794 js1_5/Regress/regress-280769-3: SKIP |
795 js1_5/Regress/regress-244470: SKIP | 795 js1_5/Regress/regress-244470: SKIP |
(...skipping 16 matching lines...) Expand all Loading... |
812 ecma/Date/15.9.5.8: SKIP | 812 ecma/Date/15.9.5.8: SKIP |
813 ecma/Date/15.9.5.9: SKIP | 813 ecma/Date/15.9.5.9: SKIP |
814 ecma/Date/15.9.5.10-2: SKIP | 814 ecma/Date/15.9.5.10-2: SKIP |
815 ecma/Date/15.9.5.11-2: SKIP | 815 ecma/Date/15.9.5.11-2: SKIP |
816 ecma/Expressions/11.7.2: SKIP | 816 ecma/Expressions/11.7.2: SKIP |
817 ecma/Expressions/11.10-2: SKIP | 817 ecma/Expressions/11.10-2: SKIP |
818 ecma/Expressions/11.7.3: SKIP | 818 ecma/Expressions/11.7.3: SKIP |
819 ecma/Expressions/11.10-3: SKIP | 819 ecma/Expressions/11.10-3: SKIP |
820 ecma/Expressions/11.7.1: SKIP | 820 ecma/Expressions/11.7.1: SKIP |
821 ecma_3/RegExp/regress-209067: SKIP | 821 ecma_3/RegExp/regress-209067: SKIP |
OLD | NEW |