System testing in scientific numerical software frameworks using the example of DUNE
Dominic Kempf, Timo Koch · University Library Heidelberg · 2016
We present dune-testtools, a collection of tools for system testing in scientific soft- ware using the example of the Distributed Unified Numerics Environment (Dune). Testing is acknowledged as indispensible support for scientific software development and assurance of software quality to produce trustworthy simulation results. Most of the time, testing in soft- ware frameworks developed at research facilities is restricted to either unit testing or simple benchmark programs. However, in a modern numerical software framework, the number of pos- sible feature combinations constituting a program is vast. Only system testing, meaning testing within a possible end user environment also emulating variability, can assess software quality and reproducibility of numerical results. We provide an easy-to-use interface taking workload off developers and administrators in open-source scientific numerical software framework projects. In our approach, the large number of possible combinations is reduced using the scientific expert knowledge of developers to identify the practically relevant combinations. Our approach to system testing is designed to be integrated in the workflow of a research software developing scientist.
Cited by 9 works. doi:10.11588/ans.2017.1.27447
Authors
References
- What every computer scientist should know about floating-point arithmetic
- Automated Solution of Differential Equations by the Finite Element Method: The FEniCS Book
- deal.II—A general-purpose object-oriented finite element library
- Verification, validation, and predictive capability in computational engineering and physics
- A generic grid interface for parallel and adaptive scientific computing. Part I: abstract framework
- DuMux: DUNE for multi-{phase,component,scale,physics,…} flow and transport in porous media
- GENERIC IMPLEMENTATION OF FINITE ELEMENT METHODS IN THE DISTRIBUTED AND UNIFIED NUMERICS ENVIRONMENT (DUNE)
- Testing for trustworthiness in scientific software
- Supporting the testing of scientific frameworks with software product line engineering
- Supporting the Quality Assurance of a Scientific Framework