Fuzzing and delta-debugging SMT solvers
Robert Brummayer, Armin Biere · 2009
SMT solvers are widely used as core engines in many applications. Therefore, robustness and correctness are essential criteria. Current testing techniques used by developers of SMT solvers do not satisfy the high demand for correct and robust solvers, as our testing experiments show. To improve this situation, we propose to complement traditional testing techniques with grammar-based blackbox fuzz testing, combined with delta-debugging. We demonstrate the effectiveness of our approach and report on critical bugs and incorrect results which we found in current state-of-the-art SMT solvers for bit-vectors and arrays.
Cited by 101 works. doi:10.1145/1670412.1670413
Authors
References
- KLEE: unassisted and automatic generation of high-coverage tests for complex systems programs
- Automated Whitebox Fuzz Testing.
- Simplifying and isolating failure-inducing input
- EXE
- Fuzz Revisited: A Re-examination of the Reliability of UNIX Utilities and Services
- QuickCheck
- QuickCheck
- Fuzzing: Brute Force Vulnerability Discovery
- A Decision Procedure for Bit-Vectors and Arrays
- Pex–White Box Test Generation for .NET