Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2011 Aug 1;27(15):2159-60.
doi: 10.1093/bioinformatics/btr325. Epub 2011 Jun 22.

SEAL: a distributed short read mapping and duplicate removal tool

Affiliations

SEAL: a distributed short read mapping and duplicate removal tool

Luca Pireddu et al. Bioinformatics. .

Abstract

Summary: SEAL is a scalable tool for short read pair mapping and duplicate removal. It computes mappings that are consistent with those produced by BWA and removes duplicates according to the same criteria employed by Picard MarkDuplicates. On a 16-node Hadoop cluster, it is capable of processing about 13 GB per hour in map+rmdup mode, while reaching a throughput of 19 GB per hour in mapping-only mode.

Availability: SEAL is available online at http://biodoop-seal.sourceforge.net/.

PubMed Disclaimer

Figures

Fig. 1.
Fig. 1.
Throughput per node of the entire SEAL workflow: finding paired reads in different files; computing the alignment; and removing duplicate reads. An ideal system would produce a flat line, scaling perfectly as the cluster size grows. The three datasets used are described in Table 1. By comparison, a single-node workflow we wrote for testing—performing the same work as SEAL but using the standard multithreaded BWA and Picard—reaches a throughput of ~1100 pairs/s on the 5M dataset.

Similar articles

Cited by

References

    1. Dean J., Ghemawat S. OSDI '04: 6th Symposium on Operating Systems Design and Impl. USENIX Association; 2004. MapReduce: simplified data processing on large clusters.
    1. Durbin R.M., et al. A map of human genome variation from population-scale sequencing. Nature. 2010;467:1061–1073. - PMC - PubMed
    1. Fujita P.A., et al. The UCSC Genome Browser database: update 2011. Nucleic Acids Res. 2010;39(Suppl. 1):D876–D882. - PMC - PubMed
    1. Illumina, Inc. Illumina. 2009. Sequencing Analysis Software User Guide For Pipeline Version 1.4 and CASAVA Version 1.0.
    1. Kozarewa I., et al. Amplification-free Illumina sequencing-library preparation facilitates improved mapping and assembly of (G+C)-biased genomes. Nat. Methods. 2009;6:291–295. - PMC - PubMed
-