A Reference-Free Algorithm for Computational Normalization of Shotgun Sequencing Data
C. Titus Brown, Adina Howe, Qingpeng Zhang et al. · arXiv (Cornell University) · 2012
Deep shotgun sequencing and analysis of genomes, transcriptomes, amplified single-cell genomes, and metagenomes has enabled investigation of a wide range of organisms and ecosystems. However, sampling variation in short-read data sets and high sequencing error rates of modern sequencers present many new computational challenges in data interpretation. These challenges have led to the development of new classes of mapping tools and {\em de novo} assemblers. These algorithms are challenged by the continued improvement in sequencing throughput. We here describe digital normalization, a single-pass computational algorithm that systematizes coverage in shotgun sequencing data sets, thereby decreasing sampling variation, discarding redundant data, and removing the majority of errors. Digital normalization substantially reduces the size of shotgun data sets and decreases the memory and time requirements for {\em de novo} sequence assembly, all without significantly impacting content of the generated contigs. We apply digital normalization to the assembly of microbial genomic data, amplified single-cell genomic data, and transcriptomic data. Our implementation is freely available for use and modification.
Cited by 228 works. doi:10.48550/arxiv.1203.4802 Open-access PDF
Authors
References
- Ultrafast and memory-efficient alignment of short DNA sequences to the human genome
- Velvet: Algorithms for de novo short read assembly using de Bruijn graphs
- Full-length transcriptome assembly from RNA-Seq data without a reference genome
- Sequencing technologies — the next generation
- ABySS: A parallel assembler for short read sequence data
- High-quality draft assemblies of mammalian genomes from massively parallel sequence data
- CloudBurst: highly sensitive read mapping with MapReduce
- Construction and characterization of a normalized cDNA library.
- An improved data stream summary: the count-min sketch and its applications
- Quake: quality-aware detection and correction of sequencing errors