Cold Storage Data Archives
Bunjamin Memishi, Raja Appuswamy, Marcus Paradies · International Workshop on Data Management on New Hardware (DaMoN) · 2019
The abundance of available sensor and derived data from large scientific experiments, such as earth observation programs, radio astronomy sky surveys, and high-energy physics already exceeds the storage hardware globally fabricated per year. To that end, cold storage data archives are the---often overlooked---spearheads of modern big data analytics in scientific, data-intensive application domains. While high-performance data analytics has received much attention from the research community, the growing number of problems in designing and deploying cold storage archives has only received very little attention.
Cited by 5 works. doi:10.1145/3329785.3329921
Authors
References
- A DNA-Based Archival Storage System
- TPC-H Analyzed: Hidden Messages and Lessons Learned from an Influential Benchmark
- Canopy
- Pelican: a building block for exascale cold data storage
- Analysis of the ECMWF storage landscape
- Casacore Table Data System and its use in the MeasurementSet
- OligoArchive: Using DNA in the DBMS storage hierarchy
- An efficient, modular and simple tape archiving solution for LHC Run-3
- ROS
- Big Data Management in Earth Observation: The German satellite data archive at the German Aerospace Center