Quantifying Software Validity by Sampling
Joe W. Duran, John J. Wiorkowski · IEEE Transactions on Reliability · 1980
The point of all validation techniques is to raise assurance about the program under study, but no current methods can be realistically thought to give 100% assurance that a validated program will perform correctly. There are currently no useful ways for quantifying how 'well-validated' a program is. One measure of program correctness is the proportion of elements in the program's input domain for which it fails to execute correctly, since the proportion is zero i.f.f. the program is correct. This proportion can be estimated statistically from the results of program tests and from prior subjective assessments of the program's correctness. Three examples are presented of methods for determining s-confidence bounds on the failure proportion. It is shown that there are reasonable conditions (for programs with a finite number of paths) for which ensuring the testing of all paths does not give better assurance of program correctness.
Cited by 55 works. doi:10.1109/tr.1980.5220756
Authors
References
- Toward a theory of test data selection
- On the Automated Generation of Program Test Data
- An Approach to Program Testing
- Social processes and proofs of theorems and programs
- Observations of Fallibility in Applications of Modern Programming Methodologies
- An evaluation of the effectiveness of symbolic testing
- Theoretical and Empirical Studies of Program Testing
- Theoretical and empirical studies of program testing
- Algorithms and Complexity
- Toward models for probabilistic program correctness