Errata for SuperTest Vermeer Release

Errata for SuperTest Vermeer Release

  • [20190724] The test-file C99/7/24/1/t_0006f.c is retracted from SuperTest. The test incorrectly expects the WEOF macro to be a non-negative value, but this is not a constraint of the C programming language.
  • [20190723] Set ExcludeFromFS misses some tests. SuperTest defines the test-set file “ExcludeFromFS” in the SETS/ directory. It can be used to verify ‘freestanding’ (see the language specification for the definition of freestanding) compiler implementations. If can be used to easily construct the appropriate test-set expression. For example:
        @SETS/C99 – @SETS/ExcludeFromFS
    constructs the test set suitable for a freestanding C99 implementation.

    In the Vermeer release, the set “ExcludeFromFS” is missing a number of tests. As a result, they will be included in the test set for a freestanding implementation and may then incorrectly reports failures in the compiler implementation. These failures can be ignored.

    The missing tests are listed below. They can be added to the set “ExcludeFromFS” so that they are properly excluded.

    • 4/0/t3.c
    • 4/0/talloc.c
    • 4/0/tjohn1.c
    • 4/0/tnumcmp.c
    • 4/0/tspr1182.c
    • 4/0/tspr4165.cx.c
    • C99/6/3/1/6/tcomplex.c
    • C99/6/3/1/7/trealcomplex1.c
    • C99/6/3/1/7/trealcomplex2.c
    • C99/6/7/2/1/tfm3_fs.c
    • C11/6/10/8/3/tatomyesno.c
    • C11/6/4/1/tnoreturn.c
    • C11/6/4/5/tstrcmp_fs.c
    • C11/6/7/4/tnornodiag1.c
    • C11/6/7/4/tnornodiag2.c
    • C11/6/7/4/tnortwice.c
    • C11/6/7/4/xnordiag2.c
    • C11/6/7/9/tinit.c
    • C11/7/23/tnordef.c
  • [20190710] The test-file 3/5/4/xdeclmax.c is retracted from SuperTest. The test depends on undefined behavior and not on a constraint of the C programming language. Therefor, if the test result is FAILED for this test, it can be ignored.
  • [20190702] When using streport with the options ‘-full -html’, it generates an html report file in which some links to test-files do not work. This only happens on Windows when the generated html file is opened with the Firefox browser. If you run into this and would like to have it fixed, we can send an updated version of streport.
  • [20190628a] Test-file 3/5/4/3/t_0001.c contains an incorrect combination of a prototype declaration and a K&R style function definition. Hence, the test may be reported to FAIL incorrectly. This result should be ignored.
  • [20190628b] Test-file 4/12/1/t1.c incorrectly uses the macro CLK_TCK (as it is defined by POSIX), but instead should use the macro name CLOCKS_PER_SEC (as it is defined in the C programming language standards. This may cause the test to fail incorrectly. To fix it, change CLK_TCK in the test to CLOCKS_PER_SEC.
  • [20190606] The float, double and long double test-sets, which can be used to exclude tests that contain floating point types, are incomplete. If you are interested in receiving the complete test-sets, please contact support@solidsands.nl.
  • [20190523] On some POSIX systems, the valid test driver might get stuck while running the nulltest. This is caused by the file permissions of the nulltest being too restrictive. If you run into this problem, it can be solved by making test0.c writable using the following command:
        chmod +w suite/FIRST/test0.c