Errata for SuperTest Vermeer Release

Note: this page is no longer maintained since a new update of SuperTest was released. If you have any issues with specific tests, these issues might have been fixed in a newer SuperTest version, or the issue might be mentioned on the errata page of a newer SuperTest version. Click here for an overview of all errata pages for specific versions.

[20191220] The test-file C99/7/24/2/3/t3.c contains code that is writing out of bounds. The test-file has been updated to solve this problem. If you are interested in receiving the updated test-file, please contact support@solidsands.nl.
[20191213] The test-file C99/7/24/4/2/2/t_0001.c contains code that is writing out of bounds. To solve the problem, on line 38 of the test-file, replace 4 by 3.
[20191202a] The test-files conditional/C11BOUNDS/K/3/7/4/2/tstrerrorslen2.c and conditional/C11BOUNDS/K/3/7/4/2/tstrerrorslen3.c expect an incorrect result. To fix them, replace the lines containing CVAL_VERIFY(result != 0); with CVAL_VERIFY(result == 0);.
[20191202b] The test-file conditional/C11BOUNDS/K/3/7/2/1/tstrcatsmaxrp.c contains an incorrect string literal. To fix it, on line 36 of the test-file, replace "uvw" with "uvwxyz".
[20191125] The test-file Cxx11/13/3/1/2/t02.C contains undefined behavior. The test-file has been updated to solve this problem. If you are interested in receiving the updated test-file, please contact support@solidsands.nl.
[20191011] The test-file C99/6/3/1/2/tb1.0.c contains a unintended function call. To solve the problem, on line 70 of the test-file, replace from_double with from_pointer.
[20190924] The test-file C99/7/3/1/t_0003.c expects the presence of the imaginary macro even if the __STDC_IEC_559_COMPLEX__ macro is not set to 1. The test-file has been updated to solve this problem. If you are interested in receiving the updated test-file, please contact support@solidsands.nl.
[20190920] The test-files 3/6/5/2/t2.gen and 3/6/5/2/t3.gen contain calls to implicitly declared functions, which is only allowed in C90. The test-files have been updated to be compatible with later versions of the C standard as well. If you are interested in receiving the updated test-files, please contact support@solidsands.nl.
[20190919a] The test-file 3/1/2/1/tspr3444.c incorrectly relies on a conversion of a function pointer to an object pointer. The test-file has been updated to solve this problem. If you are interested in receiving the updated test-file, please contact support@solidsands.nl.
[20190919b] The test-file C99/7/1/3/xreservedid1.c is retracted from SuperTest. The test depends on undefined behavior and not on a constraint of the C programming language. Therefor, if the test result is FAILED, it can be ignored.
[20190916a] The test-file Cxx11/20/8/11/2/1/t_0002.C is incompatible with C++17. Therefor, if the test result is FAILED when using a C++17 compiler, it can be ignored.
[20190916b] The test-file Cxx11/20/8/11/2/1/t_0003.C is retracted from SuperTest. The test uses a non-existent prototype. Therefor, if the test result is FAILED, it can be ignored.
[20190829a] The test-file 3/2/1/2/0/c/t16.c is missing a CVAL_VERIFY statement. To solve the problem, add the following statement below line 123 of the file:
CVAL_VERIFY(in1 == in[i]);
[20190829b] The test-file suite/3/1/8/xspr6253.c contains an invalid closing comment at line 11. To solve the problem, delete line 11 from the file.
[20190829c] The test-file 3/8/1/xspr3949.c is retracted from SuperTest. The test depends on undefined behavior and not on a constraint of the C programming language. Therefor, if the test result is FAILED, it can be ignored.
[20190724] The test-file C99/7/24/1/t_0006f.c is retracted from SuperTest. The test incorrectly expects the WEOF macro to be a non-negative value, but this is not a constraint of the C programming language.
[20190723] Set ExcludeFromFS misses some tests. SuperTest defines the test-set file “ExcludeFromFS” in the SETS/ directory. It can be used to verify ‘freestanding’ (see the language specification for the definition of freestanding) compiler implementations. If can be used to easily construct the appropriate test-set expression. For example:
@SETS/C99 – @SETS/ExcludeFromFS
constructs the test set suitable for a freestanding C99 implementation.In the Vermeer release, the set “ExcludeFromFS” is missing a number of tests. As a result, they will be included in the test set for a freestanding implementation and may then incorrectly reports failures in the compiler implementation. These failures can be ignored.The missing tests are listed below. They can be added to the set “ExcludeFromFS” so that they are properly excluded.
- 4/0/t3.c
- 4/0/talloc.c
- 4/0/tjohn1.c
- 4/0/tnumcmp.c
- 4/0/tspr1182.c
- 4/0/tspr4165.cx.c
- C99/6/3/1/6/tcomplex.c
- C99/6/3/1/7/trealcomplex1.c
- C99/6/3/1/7/trealcomplex2.c
- C99/6/7/2/1/tfm3_fs.c
- C11/6/10/8/3/tatomyesno.c
- C11/6/4/1/tnoreturn.c
- C11/6/4/5/tstrcmp_fs.c
- C11/6/7/4/tnornodiag1.c
- C11/6/7/4/tnornodiag2.c
- C11/6/7/4/tnortwice.c
- C11/6/7/4/xnordiag2.c
- C11/6/7/9/tinit.c
- C11/7/23/tnordef.c
[20190710] The test-file 3/5/4/xdeclmax.c is retracted from SuperTest. The test depends on undefined behavior and not on a constraint of the C programming language. Therefor, if the test result is FAILED, it can be ignored.
[20190702] When using streport with the options ‘-full -html’, it generates an html report file in which some links to test-files do not work. This only happens on Windows when the generated html file is opened with the Firefox browser. If you run into this and would like to have it fixed, we can send an updated version of streport.
[20190628a] Test-file 3/5/4/3/t_0001.c contains an incorrect combination of a prototype declaration and a K&R style function definition. Hence, the test may be reported to FAIL incorrectly. This result should be ignored.
[20190628b] Test-file 4/12/1/t1.c incorrectly uses the macro CLK_TCK (as it is defined by POSIX), but instead should use the macro name CLOCKS_PER_SEC (as it is defined in the C programming language standards. This may cause the test to fail incorrectly. To fix it, change CLK_TCK in the test to CLOCKS_PER_SEC.
[20190606] The float, double and long double test-sets, which can be used to exclude tests that contain floating point types, are incomplete. If you are interested in receiving the complete test-sets, please contact support@solidsands.nl.
[20190523] On some POSIX systems, the valid test driver might get stuck while running the nulltest. This is caused by the file permissions of the nulltest being too restrictive. If you run into this problem, it can be solved by making test0.c writable using the following command:
chmod +w suite/FIRST/test0.c