Enhancing Organizational Data Integrity and Efficiency through Effective Data Lineage
Carlos Alberto da Silva, Maryam Abbasi, Pedro Martins et al. · International Conference On Smart Technologies For Smart Nation (SmartTechCon) · 2023
In the era of exponential data growth and the growing reliance of organizations on data-driven decision-making, understanding the origin, transformation, processing, and destination of data has become crucial. Unfortunately, data arriving at organizations is often incorrect or structured differently, leading to analytical errors and compromising data integrity. Without well-documented data mapping and lineage, organizations risk making strategic decisions based on flawed or inaccurate data. Consequently, the implementation of a robust Data Lineage solution has emerged as a vital component for organizational success. Such a solution not only enables error identification, but also facilitates cost reduction by pinpointing inefficient data processing points and driving efficiency improvements. However, finding the right Data Lineage solution tailored to an organization’s specific requirements remains a challenge. Therefore, it is imperative to select and implement a suitable solution that aligns with each organization’s needs.
Cited by 3 works. doi:10.1109/smarttechcon57526.2023.10391436
Authors
References
- Data Visualization and its Key Fundamentals: A Comprehensive Survey
- Automating ETL process with scripting technology
- ETL, ELT and Reverse ETL: A business case Study
- Moonlight: A Push-based API for Tracking Data Lineage in Modern ETL processes
- Comparing Tabular and Multidimentional Model in a real BI solution
- Tracer : a machine learning approach to data lineage
- cost of poor quality (COPQ)