New SuperTest update features native Windows support and requirements traceability for C and C++ language specifications

Latest update of Solid Sands’ SuperTest compiler test and validation suite installs out-of-the-box to Windows environments

Also becomes the world’s first compiler test and validation suite to offer direct traceability of results back to specific C and C++ language constructs, helping users identify compiler bugs and mitigate their impact



Amsterdam, the Netherlands – 22 October 2018 – Solid Sands, the world leader in compiler testing and validation, today announced the latest update to its SuperTest™ Mondrian release. This significant update adds a raft of new features, including out-of-the-box installation into Windows environments, direct traceability of pass/fail test results back to specific constructs for a range of C and C++ language variants, and a new Python-based test driver. It also features support for the Bounds-Checking Interfaces in C11 Annex K, easy integration of test reports into Jenkins continuous integration (CI) tools and numerous improvements and additions to its language and library suites.

Previous versions of SuperTest utilized a POSIX shell for scripting the compiler-under-test and its execution environment. Today’s update now also provides a native Windows installer and comes with test-driver interfaces in both POSIX and Python.

“With so much of today’s software development done in Windows environments, we’ve made SuperTest really easy to install and configure out-of-the-box via an interface that Windows users are familiar with,” said Dr. Marcel Beemster, Chief Technology Officer at Solid Sands. “Combined with SuperTest’s new ability to generate test reports that are compatible with continuous integration environments, it means that SuperTest now fits seamlessly into standard Windows and POSIX based software development tool chains.”

Update #3 to the SuperTest Mondrian release also contains a new requirements traceability feature that links individual compiler test results directly back to the C and C++ language constructs that initiated them. Different variants of the language have different section and subsection numbering, which can make it difficult to pinpoint the exact C or C++ language constructs that a compiler fails to implement properly. Mapping individual test results to the section/subsection of the relevant language specification, and layering this on top of SuperTest’s unique test coverage and fine-grain reporting, offers the unprecedented ability to identify and deal with compiler errors – a facility that is equally useful to both compiler and application developers. Mappings are currently available for C90, C99 and C++03. Mappings for other C-language variants are in the pipeline.

“A compiler developer’s reputation relies on its ability to deliver compilers that generate error-free code, while application developers need to be sure they can mitigate the impact of compiler errors that do exist, particularly in safety-critical applications,” said Marcel Beemster. “SuperTest’s new reporting features now offer end-to-end traceability throughout the complete life-cycle of compiler development, ongoing support and use, with application developers being able to report detailed information back to their compiler supplier or develop reliable well-documented work-arounds.”

Update #3 to the SuperTest Mondrian release also includes numerous improvements and additions to SuperTest’s language and library suites. The release is commercially available now.