Errata for SuperTest Vermeer Release Update 4

Note: this page is no longer maintained since a new update of SuperTest was released. If you have any issues with specific tests, these issues might have been fixed in a newer SuperTest version, or the issue might be mentioned on the errata page of a newer SuperTest version. Click here for an overview of all errata pages for specific versions.

[20240228] The following tests had functions at risk of elimination by high optimization. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/C99/7/12/4/1/tacos_c99_DomainError_1.c
- suite/C99/7/12/4/1/tacosf_DomainError_1.
- suite/C99/7/12/4/1/tacosl_DomainError_1.c
- suite/C99/7/12/4/2/tasin_c99_DomainError_1.c
- suite/C99/7/12/4/2/tasinf_DomainError_1.c
- suite/C99/7/12/4/2/tasinl_DomainError_1.c
- suite/C99/7/12/5/1/t1.c
- suite/C99/7/12/5/1/t2.c
- suite/C99/7/12/5/1/t3.c
- suite/C99/7/12/5/3/tatanh_DomainError_1.c
- suite/C99/7/12/5/3/tatanhf_DomainError_1.c
- suite/C99/7/12/5/3/tatanhl_DomainError_1.c
- suite/C99/7/12/6/7/tlog_DomainError_1.c
- suite/C99/7/12/6/7/tlogf_DomainError_1.c
- suite/C99/7/12/6/7/tlogl_DomainError_1.c
- suite/C99/7/12/7/5/t1.c
- suite/C99/7/12/7/5/t2.c
- suite/C99/7/12/7/5/t3.c
- suite/C99/7/12/8/4/ttgamma_Domain_or_RangeError_1.c
- suite/C99/7/12/8/4/ttgammaf_Domain_or_RangeError_1.c
- suite/C99/7/12/8/4/ttgammal_Domain_or_RangeError_1.c
- suite/C99/7/23/3/5/t2.c
[20240131] The following tests had macro adjustments performed. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/C99/7/12/tfp_fast_fma_macros_1.c
- suite/C99/7/12/tfp_fast_fma_macros_1ld.c

[20240124] The following tests underwent necessary refactoring and had unneeded checks removed. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/C99/7/12/tfp_fast_fma_macros_1.c
- suite/C99/7/12/tfp_fast_fma_macros_1ld.c
- suite/C11/7/28/1/1/tsizet1.c
- suite/C11/7/28/1/1/tsizet2.c
- suite/C11/7/28/1/1/tsizet3.c
- suite/C11/7/28/1/1/tsizet123.c
[20240109a] The following tests had incorrect syntax regarding the decltype-specifier removed. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/Cxx20/6/3/t_lambdas_unevaluated_contexts-10.gen
- suite/Cxx20/6/3/t_lambdas_unevaluated_contexts-11.C
- suite/Cxx20/6/3/t_lambdas_unevaluated_contexts-7.C
- suite/Cxx20/6/3/t_lambdas_unevaluated_contexts-8.gen
- suite/Cxx20/6/3/t_lambdas_unevaluated_contexts-9.C
[20240109] The following tests had a transitive included header added to them. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/Cxx11/20/12/1/t_construct_b1id36.C
- suite/Cxx11/20/12/1/t_destroy_b1id38.C
- suite/Cxx11/20/12/1/t_construct_b1id34.C
- suite/Cxx11/20/12/1/t_construct_b1id37.C
- suite/Cxx11/20/12/1/t_allocate_b1id28.C
- suite/Cxx11/20/12/1/t_construct_b1id35.C
- suite/Cxx11/20/12/1/t_select_on_container_copy_construction_b1id39.C
- suite/Cxx11/20/12/1/t_allocate_b1id29.C
- suite/Cxx11/20/12/1/t_inner_allocator_b1id25.C
- suite/Cxx11/20/12/1/t_outer_allocator_b1id27.C
- suite/Cxx11/20/12/1/t_construct_b1id33.C
- suite/Cxx11/20/12/1/t_operator_not_eq_id2.C
- suite/Cxx11/20/12/1/t_deallocate_b1id30.C
- suite/Cxx11/20/12/1/t_construct_b1id32.C
- suite/Cxx11/20/12/1/t_outer_allocator_b1id26.C
- suite/Cxx11/20/12/1/t_operator_equal_b1id40.C
- suite/Cxx11/20/12/1/t_max_size_b1id31.C
- suite/Cxx11/20/12/1/t_inner_allocator_b1id24.C
- suite/Cxx11/20/12/1/t_operator_not_eq_b1id41.C
- suite/Cxx11/20/12/1/t_operator_equal_id1.C
- suite/Cxx17/24/4/2/t_remove_suffix_id37.C
- suite/Cxx17/24/4/2/t_remove_prefix_id36.C
- suite/Cxx14/21/7/x_0001.C
[20231215] The following tests depended on a weak assumption in the alignment and assignment of the new[] operator. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/Cxx17/6/7/4/t_0002.C
- suite/Cxx17/6/7/4/t_0004.C
- suite/Cxx17/6/7/4/t_0017.C
[20231211] The following tests were too permissive, the tests now also verify radix and where appropriate other constraints. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/iso14882/18/2/1/t01d.C
- suite/iso14882/18/2/1/t01.C
- suite/iso14882/18/2/1/t01ld.C
- suite/iso14882/18/2/1/t01f.C
[20231127] The following test now verifies that on throw the function calls effect is reverted to the state before it. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/Cxx11/21/4/4/t_reserve_zero_on_little_on_reserved_throwing.C
[20231114] The following test was removed due to reliance on unspecified behavior. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/iso14882/5/2/10/t-n-10.C
[20231109] The following tests missed a const in their declaration of operator[] for the reverse iterator. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/iso14882/24/1/5/t01.C
- suite/iso14882/24/4/1/3/1/t01.C
- suite/iso14882/24/4/1/3/10/t01.C
- suite/iso14882/24/4/1/3/11/t01.C
- suite/iso14882/24/4/1/3/12/t01.C
- suite/iso14882/24/4/1/3/13/t01.C
- suite/iso14882/24/4/1/3/14/t01.C
- suite/iso14882/24/4/1/3/15/t01.C
- suite/iso14882/24/4/1/3/16/t01.C
- suite/iso14882/24/4/1/3/17/t01.C
- suite/iso14882/24/4/1/3/18/t01.C
- suite/iso14882/24/4/1/3/19/t01.C
- suite/iso14882/24/4/1/3/2/t01.C
- suite/iso14882/24/4/1/3/3/t01.C
- suite/iso14882/24/4/1/3/4/t01.C
- suite/iso14882/24/4/1/3/5/t01.C
- suite/iso14882/24/4/1/3/5/t02.C
- suite/iso14882/24/4/1/3/6/t01.C
- suite/iso14882/24/4/1/3/6/t02.C
- suite/iso14882/24/4/1/3/7/t01.C
- suite/iso14882/24/4/1/3/8/t01.C
- suite/iso14882/24/4/1/3/9/t01.C

[20231107] The following tests have various concerns. View details below. To receive an updated version of the test files, please contact support@solidsands.nl.
- The following tests apply to an incomplete set of language versions.
  - suite/Cxx11/23/4/x_set.C
  - suite/Cxx11/23/4/x_multiset.C
- The following test uses an incorrect allocator type.
  - suite/Cxx11/20/8/11/2/2/t_assign_id23.C
- The following tests have been removed because they rely on unspecified behavior.
  - suite/iso14882/26/1/t02.C
  - suite/iso14882/26/1/t03.C
- The following test contains a syntax error.
  - suite/Cxx11/24/6/3/t_operator__id14.C
- The following test makes an incomplete assertion.
  - suite/Cxx11/23/5/6/1/t_move_constructor_self.C
- The following test makes a wrong assertion.
  - suite/Cxx11/21/4/4/t_reserve_zero.C
- The following test does not use the correct constructor for reference_wrapper.
  - suite/Cxx11/20/8/3/1/x_deleted.C
- The following test calls a function with incorrect parameters.
  - suite/Cxx11/20/8/11/2/1/t_0002.C
[20231102] The following test makes an incomplete assertion. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/Cxx11/23/5/6/1/t_move_constructor_self.C
[20231013] The following test makes an incomplete assertion. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/Cxx11/19/5/4/t_0002.C
[20231004] The following x test has been corrected. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/Cxx20/7/5/4/1/x_immediate_functions_consteval-7.C
[20231003] The following test has been corrected. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/Cxx20/11/4/10/t_signed_int_two_complement-1.C
[20230922] The following test overlaps source and destination operands, relying on undefined behavior. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/iso14882/26/3/5/2/t03.C
- suite/iso14882/26/3/7/2/t03.C
- suite/iso14882/26/3/8/2/t03.C
- suite/iso14882/26/3/9/2/t03.C
[20230904] The following test files may fail to compile because they unintentionally violate some design principles of the test suite. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/C11/7/22/4/3/t_exitnoatq.c
- suite/misra2004/cconform/C90/rule5_5/tTAR35992.gen
[20230829] The following tests improperly tested linking in relation to templates; the x test has been removed and the t test has been corrected. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/iso14882/14/t-tem-24.C
- suite/iso14882/14/x-tem-23.C
[20230815e] The following test files expect too many characters to be scanned. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/4/9/6/2/t9.c
- suite/4/9/6/4/t9.c
- suite/4/9/6/6/t9.c
- suite/C99/7/19/6/11/t9.c
- suite/C99/7/19/6/14/t9.c
- suite/C99/7/19/6/9/t9.c
[20230815d] The following test files use subnormal floating point without verifying that IEC 60559-compatible floating point is supported by the compiler. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/C99/7/12/13/1/t3.c
- suite/C99/7/12/5/3/t3.c
- suite/C99/7/12/7/1/t3.c
[20230815c] The following test file incorrectly requires FILE to be a complete type. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/4/9/1/tdeclared.c
[20230815b] The following test file allocates memory but does not use it, allowing the compiler to optimize away the call of the memory management functions. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/4/10/3/4/t_0002.c
[20230815a] The following test file has been improved to more accurately verify the return value of the mktime function when the calendar time cannot be represented. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/4/12/2/3/treturnerror.c
[20230810] The following test file has been improved to more accurately verify that std::chrono defines duration_values. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/Cxx11/20/11/4/2/x_0001.C
[20230809] The following test files are retracted from SuperTest. The tests do not violate a constraint of the C++ language. Therefore, if the test result is FAILED, it can be ignored.
- suite/Cxx20/12/4/2/9/x_ctad_for_aggregates-5.C
- suite/Cxx20/12/4/2/9/x_ctad_for_aggregates-6.C
[20230719] The following test files might fail to compile because they do not include the <functional> header. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/Cxx11/23/2/1/t_general_container.gen
- suite/Cxx11/23/6/4/x_explicit_66.C
- suite/Cxx11/23/6/4/2/x_0001.C
- suite/Cxx11/23/6/4/4/x_0002.C
- suite/Cxx17/21/6/3/2/t_0001.C
- suite/Cxx17/24/4/2/t_max_size_id29.C
- suite/Cxx17/26/4/4/1/t_merge_id86.C
- suite/Cxx17/26/4/4/1/t_merge_id87.C
- suite/Cxx17/26/4/4/1/t_merge_id88.C
- suite/Cxx17/26/4/4/1/t_merge_id89.C
- suite/Cxx17/26/4/5/1/t_merge_id73.C
- suite/Cxx17/26/4/5/1/t_merge_id74.C
- suite/Cxx17/26/4/5/1/t_merge_id75.C
- suite/Cxx17/26/4/6/1/t_merge_id68.C
- suite/Cxx17/28/2/t_clamp_id234.C
- suite/Cxx17/28/2/t_includes_id176.C
- suite/Cxx17/28/2/t_inplace_merge_id172.C
- suite/Cxx17/28/2/t_is_heap_id204.C
- suite/Cxx17/28/2/t_is_heap_until_id208.C
- suite/Cxx17/28/2/t_is_sorted_id148.C
- suite/Cxx17/28/2/t_is_sorted_until_id152.C
- suite/Cxx17/28/2/t_lexicographical_compare_id238.C
- suite/Cxx17/28/2/t_max_element_id228.C
- suite/Cxx17/28/2/t_merge_id168.C
- suite/Cxx17/28/2/t_minmax_element_id232.C
- suite/Cxx17/28/2/t_min_element_id224.C
- suite/Cxx17/28/2/t_nth_element_id156.C
- suite/Cxx17/28/2/t_partial_sort_copy_id144.C
- suite/Cxx17/28/2/t_partial_sort_id140.C
- suite/Cxx17/28/2/t_set_difference_id188.C
- suite/Cxx17/28/2/t_set_intersection_id184.C
- suite/Cxx17/28/2/t_set_symmetric_difference_id192.C
- suite/Cxx17/28/2/t_set_union_id180.C
- suite/Cxx17/28/2/t_sort_id132.C
- suite/Cxx17/28/2/t_stable_sort_id136.C
- suite/Cxx17/28/2/t_transform_id77.C
- suite/Cxx17/29/8/1/t_reduce_id4.C
- suite/Cxx17/29/8/1/t_reduce_id7.C
- suite/iso14882/25/3/1/1/t01_threshold_2.C
[20230706] The following test files are missing the noexcept specifier on the replaced non-throwing allocation functions. To receive an updated version of the test files, please contact support@solidsands.nl.
- suite/Cxx17/6/7/4/t_0040.C
- suite/Cxx17/6/7/4/t_0041.C
[20230705] The SuperTest GUI incorrectly ignores the setting for the maximum number of Tempest tests that may be generated. As a result, the GUI may generate a very large number of tests. To receive an updated version of the GUI, please contact support@solidsands.nl.
[20230608] The following tests relied on the behavior of value-initialized iterators not guaranteed by the C++ standard. They compare a value-initialized iterator with the end()-iterator of a container object. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/Cxx14/24/2/5/t_null_value_forward_iterator_1.C
- suite/Cxx14/24/2/5/t_null_value_forward_iterator_2.C
- suite/Cxx14/24/2/5/t_null_value_forward_iterator_3.C
- suite/Cxx14/24/2/5/t_null_value_forward_iterator_4.C
- suite/Cxx14/24/2/5/t_null_value_forward_iterator_5.C
- suite/Cxx14/24/2/5/t_null_value_forward_iterator_6.C
- suite/Cxx14/24/2/5/t_null_value_forward_iterator_7.C
- suite/Cxx14/24/2/5/t_null_value_forward_iterator_8.C
- suite/Cxx14/24/2/5/t_null_value_forward_iterator_9.C
[20230531] The following test has a potential memory leak when reallocation fails. To receive an updated version of the test file, please contact support@solidsands.nl.
- suite/4/10/3/4/t2.c