PrecisionFDA Truth Challenge V2: Calling variants from short and long reads in difficult-to-map regions.


Journal

Cell genomics
ISSN: 2666-979X
Titre abrégé: Cell Genom
Pays: United States
ID NLM: 9918284260106676

Informations de publication

Date de publication:
11 May 2022
Historique:
entrez: 20 6 2022
pubmed: 21 6 2022
medline: 21 6 2022
Statut: ppublish

Résumé

The precisionFDA Truth Challenge V2 aimed to assess the state of the art of variant calling in challenging genomic regions. Starting with FASTQs, 20 challenge participants applied their variant-calling pipelines and submitted 64 variant call sets for one or more sequencing technologies (Illumina, PacBio HiFi, and Oxford Nanopore Technologies). Submissions were evaluated following best practices for benchmarking small variants with updated Genome in a Bottle benchmark sets and genome stratifications. Challenge submissions included numerous innovative methods, with graph-based and machine learning methods scoring best for short-read and long-read datasets, respectively. With machine learning approaches, combining multiple sequencing technologies performed particularly well. Recent developments in sequencing and variant calling have enabled benchmarking variants in challenging genomic regions, paving the way for the identification of previously unknown clinically relevant variants.

Identifiants

pubmed: 35720974
doi: 10.1016/j.xgen.2022.100129
pmc: PMC9205427
mid: NIHMS1809019
pii:
doi:

Types de publication

Journal Article

Langues

eng

Subventions

Organisme : NIGMS NIH HHS
ID : R01 GM132713
Pays : United States
Organisme : NHGRI NIH HHS
ID : UM1 HG008898
Pays : United States

Déclaration de conflit d'intérêts

DECLARATION OF INTERESTS C.B. is an employee and shareholder of SAGA Diagnostics AB. A.C., P.-C.C., A.K., M.N., G.B., S.G., and H.Y. are employees of Google, and A.C. is a shareholder. S.D.-B., D.K.-Z., D.T., Ö.K., G.B., K.N., E.A., R.B., I.J.J., A.D., V.S., A.J., and H.S.T. are employees of Seven Bridges Genomics. O.S. and S. T.W. are employees of DNAnexus. G.L., C.M., L.T.F., Y.D., and S.Z. are employees of Genetalks. V.J., M.R., B.L., C.R., S.C., and R.M. are employees of Illumina. S.M.E.S. and M.M. are employees of Roche. C.H. is an employee of Wasai Technology. H.F., Z.L., and L.C. are employees of Sentieon.

Références

Cell Genom. 2022 May;2(5):
pubmed: 36452119
Bioinformatics. 2012 Jul 15;28(14):1919-20
pubmed: 22576172
Nat Biotechnol. 2019 Oct;37(10):1155-1162
pubmed: 31406327
Bioinformatics. 2020 Jul 1;36(Suppl_1):i111-i118
pubmed: 32657365
Genome Res. 2001 Jun;11(6):1005-17
pubmed: 11381028
Nature. 2015 Oct 1;526(7571):68-74
pubmed: 26432245
Hum Mutat. 2019 Sep;40(9):1197-1201
pubmed: 31334884
Bioinformatics. 2018 Sep 15;34(18):3094-3100
pubmed: 29750242
Hum Mutat. 2017 Sep;38(9):1039-1041
pubmed: 28817245
Nat Genet. 2019 Feb;51(2):354-362
pubmed: 30643257
J Virol. 2020 Jun 16;94(13):
pubmed: 32303592
Genome Biol. 2018 Nov 6;19(1):188
pubmed: 30400818
Nature. 2021 Feb;590(7846):E53
pubmed: 33536625
Nature. 2015 Oct 1;526(7571):75-81
pubmed: 26432246
Nat Commun. 2020 Sep 22;11(1):4794
pubmed: 32963235
Science. 2002 Aug 9;297(5583):1003-7
pubmed: 12169732
Genet Med. 2021 Sep;23(9):1673-1680
pubmed: 34007000
J Mol Diagn. 2018 Jan;20(1):4-27
pubmed: 29154853
Nucleic Acids Res. 1999 Jan 15;27(2):573-80
pubmed: 9862982
Genome Res. 2017 Jan;27(1):157-164
pubmed: 27903644
Bioinformatics. 2018 Mar 1;34(5):867-868
pubmed: 29096012
Nature. 2016 Oct 13;538(7624):201-206
pubmed: 27654912
Nat Biotechnol. 2020 Sep;38(9):1044-1053
pubmed: 32686750
Nat Biotechnol. 2020 Jan;38(1):97-107
pubmed: 31919445
Trends Genet. 2000 Sep;16(9):418-20
pubmed: 10973072
PLoS One. 2012;7(1):e30377
pubmed: 22276185
J Comput Biol. 2014 Jun;21(6):405-19
pubmed: 24874280
Nat Biotechnol. 2019 May;37(5):555-560
pubmed: 30858580
Nat Biotechnol. 2019 May;37(5):561-566
pubmed: 30936564
Genome Biol. 2013 May 29;14(5):R51
pubmed: 23718773
Nat Methods. 2015 Jul;12(7):623-30
pubmed: 25984700
Nat Methods. 2018 Aug;15(8):591-594
pubmed: 30013048

Auteurs

Nathan D Olson (ND)

Material Measurement Laboratory, National Institute of Standards and Technology, 100 Bureau Dr, MS8312, Gaithersburg, MD 20899, USA.
Lead contact.

Justin Wagner (J)

Material Measurement Laboratory, National Institute of Standards and Technology, 100 Bureau Dr, MS8312, Gaithersburg, MD 20899, USA.

Jennifer McDaniel (J)

Material Measurement Laboratory, National Institute of Standards and Technology, 100 Bureau Dr, MS8312, Gaithersburg, MD 20899, USA.

Sarah H Stephens (SH)

Booz Allen Hamilton, 8283 Greensboro Drive, Mclean, VA 22102, USA.

Samuel T Westreich (ST)

DNAnexus, Inc., 1975 W El Camino Real #204, Mountain View, CA 94040, USA.

Anish G Prasanna (AG)

Booz Allen Hamilton, 8283 Greensboro Drive, Mclean, VA 22102, USA.

Elaine Johanson (E)

Office of Health Informatics, Office of the Chief Scientist, Office of the Commissioner, US Food and Drug Administration, Silver Spring, MD, USA.

Emily Boja (E)

Office of Health Informatics, Office of the Chief Scientist, Office of the Commissioner, US Food and Drug Administration, Silver Spring, MD, USA.

Ezekiel J Maier (EJ)

Booz Allen Hamilton, 8283 Greensboro Drive, Mclean, VA 22102, USA.

Omar Serang (O)

DNAnexus, Inc., 1975 W El Camino Real #204, Mountain View, CA 94040, USA.

David Jáspez (D)

Genomics Division, Instituto Tecnológico y de Energías Renovables (ITER), Santa Cruz de Tenerife, Spain.

José M Lorenzo-Salazar (JM)

Genomics Division, Instituto Tecnológico y de Energías Renovables (ITER), Santa Cruz de Tenerife, Spain.

Adrián Muñoz-Barrera (A)

Genomics Division, Instituto Tecnológico y de Energías Renovables (ITER), Santa Cruz de Tenerife, Spain.

Luis A Rubio-Rodríguez (LA)

Genomics Division, Instituto Tecnológico y de Energías Renovables (ITER), Santa Cruz de Tenerife, Spain.

Carlos Flores (C)

Genomics Division, Instituto Tecnológico y de Energías Renovables (ITER), Santa Cruz de Tenerife, Spain.
CIBER de Enfermedades Respiratorias, Instituto de Salud Carlos III, Madrid, Spain.
Research Unit, Hospital Universitario N.S. de Candelaria, Santa Cruz de Tenerife, Spain.
Instituto de Tecnologías Biomédicas (ITB), Universidad de La Laguna, 38200 San Cristóbal de La Laguna, Spain.

Konstantinos Kyriakidis (K)

School of Pharmacy, Aristotle University of Thessaloniki (AUTH), 541 24 Thessaloniki, Greece.
Genomics and Epigenomics Translational Research (GENeTres), Center for Interdisciplinary Research and Innovation, 570 01 Thessaloniki, Greece.

Andigoni Malousi (A)

Genomics and Epigenomics Translational Research (GENeTres), Center for Interdisciplinary Research and Innovation, 570 01 Thessaloniki, Greece.
Laboratory of Biological Chemistry, School of Medicine, Aristotle University of Thessaloniki (AUTH), 541 24 Thessaloniki, Greece.

Kishwar Shafin (K)

UC Santa Cruz Genomics Institute, University of California, Santa Cruz, 1156 High Street, Santa Cruz, CA, USA.

Trevor Pesout (T)

UC Santa Cruz Genomics Institute, University of California, Santa Cruz, 1156 High Street, Santa Cruz, CA, USA.

Miten Jain (M)

UC Santa Cruz Genomics Institute, University of California, Santa Cruz, 1156 High Street, Santa Cruz, CA, USA.

Benedict Paten (B)

UC Santa Cruz Genomics Institute, University of California, Santa Cruz, 1156 High Street, Santa Cruz, CA, USA.

Pi-Chuan Chang (PC)

Google Inc, 1600 Amphitheater Pkwy, Mountain View, CA 94040, USA.

Alexey Kolesnikov (A)

Google Inc, 1600 Amphitheater Pkwy, Mountain View, CA 94040, USA.

Maria Nattestad (M)

Google Inc, 1600 Amphitheater Pkwy, Mountain View, CA 94040, USA.

Gunjan Baid (G)

Google Inc, 1600 Amphitheater Pkwy, Mountain View, CA 94040, USA.

Sidharth Goel (S)

Google Inc, 1600 Amphitheater Pkwy, Mountain View, CA 94040, USA.

Howard Yang (H)

Google Inc, 1600 Amphitheater Pkwy, Mountain View, CA 94040, USA.

Andrew Carroll (A)

Google Inc, 1600 Amphitheater Pkwy, Mountain View, CA 94040, USA.

Robert Eveleigh (R)

The Canadian Center for Computational Genomics (C3G), Montréal, QC, Canada.

Mathieu Bourgey (M)

The Canadian Center for Computational Genomics (C3G), Montréal, QC, Canada.

Guillaume Bourque (G)

The Canadian Center for Computational Genomics (C3G), Montréal, QC, Canada.

Gen Li (G)

HuXinDao, QingZhuHu TaiYangShan Road, KaiFu, ChangSha, HuNan, China.

ChouXian Ma (C)

HuXinDao, QingZhuHu TaiYangShan Road, KaiFu, ChangSha, HuNan, China.

LinQi Tang (L)

HuXinDao, QingZhuHu TaiYangShan Road, KaiFu, ChangSha, HuNan, China.

YuanPing Du (Y)

HuXinDao, QingZhuHu TaiYangShan Road, KaiFu, ChangSha, HuNan, China.

ShaoWei Zhang (S)

HuXinDao, QingZhuHu TaiYangShan Road, KaiFu, ChangSha, HuNan, China.

Jordi Morata (J)

CNAG-CRG, Centre for Genomic Regulation (CRG), Barcelona Institute of Science and Technology (BIST), Baldiri i Reixac 4, 08028 Barcelona, Spain.
Universitat Pompeu Fabra (UPF), Barcelona, Spain.

Raúl Tonda (R)

CNAG-CRG, Centre for Genomic Regulation (CRG), Barcelona Institute of Science and Technology (BIST), Baldiri i Reixac 4, 08028 Barcelona, Spain.
Universitat Pompeu Fabra (UPF), Barcelona, Spain.

Genís Parra (G)

CNAG-CRG, Centre for Genomic Regulation (CRG), Barcelona Institute of Science and Technology (BIST), Baldiri i Reixac 4, 08028 Barcelona, Spain.
Universitat Pompeu Fabra (UPF), Barcelona, Spain.

Jean-Rémi Trotta (JR)

CNAG-CRG, Centre for Genomic Regulation (CRG), Barcelona Institute of Science and Technology (BIST), Baldiri i Reixac 4, 08028 Barcelona, Spain.
Universitat Pompeu Fabra (UPF), Barcelona, Spain.

Christian Brueffer (C)

Division of Oncology, Department of Clinical Sciences, Lund University, Lund, Sweden.

Sinem Demirkaya-Budak (S)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Duygu Kabakci-Zorlu (D)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Deniz Turgut (D)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Özem Kalay (Ö)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Gungor Budak (G)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Kübra Narcı (K)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Elif Arslan (E)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Richard Brown (R)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Ivan J Johnson (IJ)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Alexey Dolgoborodov (A)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Vladimir Semenyuk (V)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Amit Jain (A)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

H Serhat Tetikol (HS)

Seven Bridges Genomics, Inc, Charlestown, MA, USA.

Varun Jain (V)

Illumina, Inc., San Diego, CA, USA.

Mike Ruehle (M)

Illumina, Inc., San Diego, CA, USA.

Bryan Lajoie (B)

Illumina, Inc., San Diego, CA, USA.

Cooper Roddey (C)

Illumina, Inc., San Diego, CA, USA.

Severine Catreux (S)

Illumina, Inc., San Diego, CA, USA.

Rami Mehio (R)

Illumina, Inc., San Diego, CA, USA.

Mian Umair Ahsan (MU)

Raymond G. Perelman Center for Cellular and Molecular Therapeutics, Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA.

Qian Liu (Q)

Raymond G. Perelman Center for Cellular and Molecular Therapeutics, Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA.

Kai Wang (K)

Raymond G. Perelman Center for Cellular and Molecular Therapeutics, Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA.
Department of Pathology and Laboratory Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA.

Sayed Mohammad Ebrahim Sahraeian (SME)

Roche Sequencing Solutions, Santa Clara, CA 95050, USA.

Li Tai Fang (LT)

Roche Sequencing Solutions, Santa Clara, CA 95050, USA.

Marghoob Mohiyuddin (M)

Roche Sequencing Solutions, Santa Clara, CA 95050, USA.

Calvin Hung (C)

WASAI Technology, Taipei, Taiwan.

Chirag Jain (C)

National Human Genome Research Institute, National Institutes of Health, Bethesda, MD, USA.

Hanying Feng (H)

Sentieon Inc., San Jose, CA, USA.

Zhipan Li (Z)

Sentieon Inc., San Jose, CA, USA.

Luoqi Chen (L)

Sentieon Inc., San Jose, CA, USA.

Fritz J Sedlazeck (FJ)

Human Genome Sequencing Center, Baylor College of Medicine, One Baylor Plaza, Houston, TX 77030, USA.

Justin M Zook (JM)

Material Measurement Laboratory, National Institute of Standards and Technology, 100 Bureau Dr, MS8312, Gaithersburg, MD 20899, USA.

Classifications MeSH