Validating “Data Validation”

Abstract

We have more access to data than ever before, but it is difficult to make sense of it when the data is incomplete or inaccurate. As such, data validation is necessary to increase data quality for effective decision making. The authors have discussed some of the essential key concepts and challenges regarding data validation. It is evident that when it comes to data validation, human oversight cannot be completely removed from the practice. Data invaluable human traits that cannot be learned. Even today, no matter how advanced data validation software is, or automated methodologies are, humans are unlikely to proceed with decisions that are not vetted by another human. A data validation dashboard might serve as a means for an experienced data practitioner to monitor data analysis processes from start to finish. The dashboard could enable teams or project managers to allocate resources, tasks, and also more effectively supervise the status and the best outcome possible for projects.