Data Validation
Mark van der Loo, Edwin de Jonge · Wiley StatsRef: Statistics Reference Online · 2020
Abstract Data validation is the activity where one decides whether or not a particular data set is fit for a given purpose. Formalizing the requirements that drive this decision process allows for unambiguous communication of the requirements, automation of the decision process, and opens up ways to maintain and investigate the decision process itself. The purpose of this article is to formalize the definition of data validation and to demonstrate some of the properties that can be derived from this definition. In particular, it is shown how a formal view of the concept permits a classification of data quality requirements, allowing them to be ordered in increasing levels of complexity. Some subtleties arising from combining possibly many such requirements are pointed out as well.
Cited by 10 works. doi:10.1002/9781118445112.stat08255
Authors
References
- A relational model of data for large shared data banks
- Logic‐Based Methods for Optimization
- Handbook of Statistical Data Editing and Imputation
- A Comparative Study of Redundant Constraints Identification Methods in Linear Programming Problems
- Statistical Data Cleaning with Applications in R
- Optimization Methods for Logical Inference
- Small Formulas for Large Programs: On-Line Constraint Simplification in Scalable Static Analysis
- Data Validation Infrastructure for R
- Error correction for massive datasets
- A Formal Procedure for Finding Contradictions into a Set of Rules