Errata for SuperTest Vermeer Release Update 3

Errata for SuperTest Vermeer Release Update 3

Note: this page is no longer maintained since a new update of SuperTest was released. If you have any issues with specific tests, these issues might have been fixed in a newer SuperTest version, or the issue might be mentioned on the errata page of a newer SuperTest version. Click here for an overview of all errata pages for specific versions.

  • [20230420] The following tests use an array in an invalid heap form. To receive an updated version of the test files, please contact support@solidsands.nl.
    • iso14882/25/3/6/1/t01.C
    • iso14882/25/3/6/1/t02.C
  • [20230403] The following test files do not correctly consider the case when the compiler does not use the errno variable to communicate the error condition. To receive an updated version of the test files, please contact support@solidsands.nl.
    • C99/7/12/11/3/tnextafter_RangeError_1.c
    • C99/7/12/11/3/tnextafterf_RangeError_1.c
    • C99/7/12/11/3/tnextafterl_RangeError_1.c
    • C99/7/12/13/1/tfma_RangeError_1.c
    • C99/7/12/13/1/tfmaf_RangeError_1.c
    • C99/7/12/13/1/tfmal_RangeError_1.c
    • C99/7/12/4/1/t2.c
    • C99/7/12/4/1/tacos_c99_DomainError_1.c
    • C99/7/12/4/1/tacosf_DomainError_1.c
    • C99/7/12/4/1/tacosl_DomainError_1.c
    • C99/7/12/4/2/tasin_c99_DomainError_1.c
    • C99/7/12/4/2/tasinf_DomainError_1.c
    • C99/7/12/4/2/tasinl_DomainError_1.c
    • C99/7/12/5/1/t1.c
    • C99/7/12/5/1/t2.c
    • C99/7/12/5/1/t3.c
    • C99/7/12/5/3/tatanh_DomainError_1.c
    • C99/7/12/5/3/tatanhf_DomainError_1.c
    • C99/7/12/5/3/tatanhl_DomainError_1.c
    • C99/7/12/5/4/tcosh_c99_RangeError_1.c
    • C99/7/12/5/4/tcoshf_RangeError_1.c
    • C99/7/12/5/4/tcoshl_RangeError_1.c
    • C99/7/12/6/1/t1.c
    • C99/7/12/7/4/tpow_DomainError_or_range_1.c
    • C99/7/12/7/4/tpowf_DomainError_or_range_1.c
    • C99/7/12/7/4/tpowl_DomainError_or_range_1.c
    • C99/7/12/8/4/ttgamma_Domain_or_RangeError_1.c
    • C99/7/12/8/4/ttgammaf_Domain_or_RangeError_1.c
    • C99/7/12/8/4/ttgammal_Domain_or_RangeError_1.c
    • C99/7/12/9/5/tinexact_lrint_Exception_1.c
    • C99/7/12/tmatherrhandling_1.c
    • C99/7/12/tmatherrhandling_immutable_1.c
    • C99/7/12/xmatherrhandling_immutable_1.c
  • [20230328] The following test file is incompatible with C++17 and later implementations. Therefore, if the test result is FAILED when testing a C++17 or later implementation, it can be ignored.
    • Cxx11/20/7/2/2/7/t_0002.C
  • [20230320] The following test file does not correctly verify which destructor is called. To receive an updated version of the test file, please contact support@solidsands.nl.
    • iso14882/3/6/3/t_0002.C
  • [20230315] The following test files allocate memory but do not use it, allowing the compiler to optimize away the call of the memory management functions. To receive an updated version of the test files, please contact support@solidsands.nl.
    • 4/10/3/1/tcallocbig.c
    • 4/10/3/3/tmallocbig.c
  • [20230307] The following tests use an array in an invalid heap form. To receive an updated version of the test files, please contact support@solidsands.nl.
    • iso14882/25/3/6/2/t01.C
    • iso14882/25/3/6/2/t02.C
  • [20230120] The following test files access memory out of bounds. To receive an updated version of the test files, please contact support@solidsands.nl.
    • Cxx17/6/7/4/t_0001.C
    • Cxx17/6/7/4/t_0002.C
    • Cxx17/6/7/4/t_0003.C
    • Cxx17/6/7/4/t_0004.C
    • Cxx17/6/7/4/t_0005.C
    • Cxx17/6/7/4/t_0006a.C
    • Cxx17/6/7/4/t_0006b.C
    • Cxx17/6/7/4/t_0006c.C
    • Cxx17/6/7/4/t_0007a.C
    • Cxx17/6/7/4/t_0007b.C
    • Cxx17/6/7/4/t_0007c.C
    • Cxx17/6/7/4/t_0012.C
    • Cxx17/6/7/4/t_0012b.C
    • Cxx17/6/7/4/t_0015.C
    • Cxx17/6/7/4/t_0015b.C
    • Cxx17/6/7/4/t_0017.C
    • Cxx17/6/7/4/t_0019.C
    • Cxx17/6/7/4/t_0020.C
    • Cxx17/6/7/4/t_0021.C
    • Cxx17/6/7/4/t_0022.C
    • Cxx17/6/7/4/t_0023.C
    • Cxx17/6/7/4/t_0024.C
    • Cxx17/6/7/4/t_0025.C
    • Cxx17/6/7/4/t_0026.C
    • Cxx17/6/7/4/t_0027.C
    • Cxx17/6/7/4/t_0028.C
    • Cxx17/6/7/4/t_0029.C
    • Cxx17/6/7/4/t_0030.C
    • Cxx17/6/7/4/t_0031.C
    • Cxx17/6/7/4/t_0032.C
    • Cxx17/6/7/4/t_0033.C
    • Cxx17/6/7/4/t_0034.C
    • Cxx17/6/7/4/t_0035.C
    • Cxx17/6/7/4/t_0036.C
    • Cxx17/6/7/4/t_0040.C
    • Cxx17/6/7/4/t_0041.C
    • Cxx17/6/7/4/t_0013.C
    • Cxx17/8/3/4/t_0001.C
    • Cxx17/8/3/4/t_0002.C
  • [20221214b] The following test files in the directory Cxx17/23/17/6/7/ depend on locale-defined behavior. Furthermore, the test-file Cxx11/20/8/11/2/t_assign_id23.C is not valid for C++17 and later implementations. To receive updated versions of the test files, please contact support@solidsands.nl.
    • Cxx17/23/17/6/7/t_ceil.C
    • Cxx17/23/17/6/7/t_floor_1.C
    • Cxx17/23/17/6/7/t_round.C
    • Cxx11/20/8/11/2/t_assign_id23.C
  • [20221214] The following test files might fail to compile because they do not include the <iterator> header. To receive updated versions of the test files, please contact support@solidsands.nl.
    • Cxx11/20/6/10/t_operator_assignment_id3.C
    • Cxx11/20/6/10/t_operator_increment_id4.C
    • Cxx14/20/7/10/t_operator_assignment_id3.C
    • Cxx14/20/7/10/t_operator_increment_id4.C
  • [20220908] The test files in the Cxx11/26/8/ suite directory change the floating point environment rounding direction mode without enabling the FENV_ACCESS pragma. Therefore, the tests might fail when the compiler optimizes the code. To receive updated versions of the test files, please contact support@solidsands.nl.
  • [20220810] The test-file Cxx20/13/9/x_access_checking_on_specializations-3.C is retracted from SuperTest. The test does not violate a constraint of the C++ language. Therefore, if the test result is FAILED, it can be ignored.
  • [20220802] The test-file iso14882/5/9/t-n-378.C is retracted from SuperTest. The test is incorrect. Therefore, if the test result is FAILED, it can be ignored.
  • [20220706c] The test-file Cxx11/8/4/3/x01_8.C is not valid for C++17 and later implementations. Therefore, if the test result is FAILED when testing a C++17 or later implementation, it can be ignored.
  • [20220706b] The test-file Cxx11/8/4/2/x01_8.C is not valid for C++14 and later implementations. Therefore, if the test result is FAILED when testing a C++14 or later implementation, it can be ignored.
  • [20220706a] The test-file iso14882/15/3/x3.C is retracted from SuperTest. The test does not violate a constraint of the C++ language. Therefore, if the test result is FAILED, it can be ignored.
  • [20220628] The following test files are not valid for C++11 and C++14 implementations. Therefore, if the test result is FAILED when testing a C++11 or C++14 implementation, it can be ignored.
    • Cxx11/20/4/2/5/t_0002.C
    • Cxx11/20/4/2/5/t_0003.C
    • Cxx11/20/4/2/5/t_0004.C
  • [20220517] The following test files are not valid for C++11 implementations. Therefore, if the test result is FAILED when testing a C++11 implementation, it can be ignored.
    • Cxx11/23/3/6/5/t_emplace_vector_bool_3.C
    • Cxx11/23/3/6/5/t_emplace_back_vector_bool.C
  • [20220510] The following test files do not take into account constraints on stream orientation (C99:7.19.2). To receive an updated version of the test files, please contact support@solidsands.nl.
    • C99/7/24/2/11/t1.c
    • C99/7/24/3/9/t1.c
  • [20220316] The following test files are incompatible with C++17. Therefore, if the test result is FAILED when using a C++17 compiler, it can be ignored.
    • Cxx11/24/6/3/t_operator__id14.C
    • Cxx14/24/6/3/t_operator__id14.C
  • [20220119] The following test files are retracted from SuperTest. The tests depend on unspecified behavior with regards to the order of evaluation. Therefore, if the test result is FAILED for any of these tests, it can be ignored.
    • iso14882/8/3/2/t117-005.C
    • iso14882/8/3/2/t117-006.C
    • iso14882/8/3/2/t117-007.C
    • iso14882/8/3/2/t117-025.C
    • iso14882/8/3/2/t117-026.C
    • iso14882/8/3/2/t117-027.C