Evaluating the analytical validity of circulating tumor DNA sequencing assays for precision oncology.
Journal
Nature biotechnology
ISSN: 1546-1696
Titre abrégé: Nat Biotechnol
Pays: United States
ID NLM: 9604648
Informations de publication
Date de publication:
09 2021
09 2021
Historique:
received:
20
07
2020
accepted:
15
02
2021
pubmed:
14
4
2021
medline:
23
9
2021
entrez:
13
4
2021
Statut:
ppublish
Résumé
Circulating tumor DNA (ctDNA) sequencing is being rapidly adopted in precision oncology, but the accuracy, sensitivity and reproducibility of ctDNA assays is poorly understood. Here we report the findings of a multi-site, cross-platform evaluation of the analytical performance of five industry-leading ctDNA assays. We evaluated each stage of the ctDNA sequencing workflow with simulations, synthetic DNA spike-in experiments and proficiency testing on standardized, cell-line-derived reference samples. Above 0.5% variant allele frequency, ctDNA mutations were detected with high sensitivity, precision and reproducibility by all five assays, whereas, below this limit, detection became unreliable and varied widely between assays, especially when input material was limited. Missed mutations (false negatives) were more common than erroneous candidates (false positives), indicating that the reliable sampling of rare ctDNA fragments is the key challenge for ctDNA assays. This comprehensive evaluation of the analytical performance of ctDNA assays serves to inform best practice guidelines and provides a resource for precision oncology.
Identifiants
pubmed: 33846644
doi: 10.1038/s41587-021-00857-z
pii: 10.1038/s41587-021-00857-z
pmc: PMC8434938
mid: NIHMS1674229
doi:
Substances chimiques
Circulating Tumor DNA
0
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Research Support, N.I.H., Intramural
Research Support, Non-U.S. Gov't
Validation Study
Langues
eng
Sous-ensembles de citation
IM
Pagination
1115-1128Subventions
Organisme : U.S. Department of Health & Human Services | U.S. Food and Drug Administration (U.S. Food & Drug Administration)
ID : E0765001
Organisme : NIGMS NIH HHS
ID : R15 GM114739
Pays : United States
Organisme : U.S. Department of Health & Human Services | U.S. Food and Drug Administration (U.S. Food & Drug Administration)
ID : E0767001
Organisme : Science and Technology Commission of Shanghai Municipality (Shanghai Municipal Science and Technology Commission)
ID : 2017SHZDZX01
Organisme : NIGMS NIH HHS
ID : R15 GM137288
Pays : United States
Organisme : U.S. Department of Health & Human Services | U.S. Food and Drug Administration (U.S. Food & Drug Administration)
ID : BAA grant HHSF223201510172C
Organisme : Intramural FDA HHS
ID : FD999999
Pays : United States
Organisme : Department of Health | National Health and Medical Research Council (NHMRC)
ID : APP1108254
Organisme : Cancer Institute NSW (Cancer Institute New South Wales)
ID : Early Career Fellowship 2018/ECF013
Organisme : NIGMS NIH HHS
ID : P50 GM021700
Pays : United States
Informations de copyright
© 2021. This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply.
Références
Leon, S. A., Shapiro, B., Sklaroff, D. M. & Yaros, M. J. Free DNA in the serum of cancer patients and the effect of therapy. Cancer Res. 37, 646–650 (1977).
pubmed: 837366
Stroun, M., Anker, P., Lyautey, J., Lederrey, C. & Maurice, P. A. Isolation and characterization of DNA from the plasma of cancer patients. Eur. J. Cancer Clin. Oncol. 23, 707–712 (1987).
pubmed: 3653190
doi: 10.1016/0277-5379(87)90266-5
Abbosh, C. et al. Phylogenetic ctDNA analysis depicts early-stage lung cancer evolution. Nature 545, 446–451 (2017).
pubmed: 28445469
pmcid: 5812436
doi: 10.1038/nature22364
Bettegowda, C. et al. Detection of circulating tumor DNA in early- and late-stage human malignancies. Sci. Transl. Med. 6, 224ra24 (2014).
pubmed: 24553385
pmcid: 4017867
doi: 10.1126/scitranslmed.3007094
Abbosh, C., Birkbak, N. J. & Swanton, C. Early stage NSCLC - challenges to implementing ctDNA-based screening and MRD detection. Nat. Rev. Clin. Oncol. 15, 577–586 (2018).
pubmed: 29968853
doi: 10.1038/s41571-018-0058-3
Aggarwal, C. et al. Strategies for the successful implementation of plasma-based NSCLC genotyping in clinical practice. Nat. Rev. Clin. Oncol. 18, 56–62 (2020).
Aravanis, A. M., Lee, M. & Klausner, R. D. Next-generation sequencing of circulating tumor DNA for early cancer detection. Cell 168, 571–574 (2017).
pubmed: 28187279
doi: 10.1016/j.cell.2017.01.030
Siravegna, G., Marsoni, S., Siena, S. & Bardelli, A. Integrating liquid biopsies into the management of cancer. Nat. Rev. Clin. Oncol. 14, 531–548 (2017).
pubmed: 28252003
doi: 10.1038/nrclinonc.2017.14
Wan, J. C. M. et al. Liquid biopsies come of age: towards implementation of circulating tumour DNA. Nat. Rev. Cancer 17, 223–238 (2017).
pubmed: 28233803
doi: 10.1038/nrc.2017.7
Volckmar, A.-L. et al. A field guide for cancer diagnostics using cell-free DNA: from principles to practice and clinical applications. Genes Chromosomes Cancer 57, 123–139 (2017).
pubmed: 29205637
doi: 10.1002/gcc.22517
Ross, M. G. et al. Characterizing and measuring bias in sequence data. Genome Biol. 14, R51 (2013).
pubmed: 23718773
pmcid: 4053816
doi: 10.1186/gb-2013-14-5-r51
Brannon, A. R. et al. Enhanced specificity of high sensitivity somatic variant profiling in cell-free DNA via paired normal sequencing: design, validation, and clinical experience of the MSK-ACCESS liquid biopsy assay. Preprint at bioRxiv https://doi.org/10.1101/2020.06.27.175471 (2020).
Clark, T. A. et al. Analytical validation of a hybrid capture-based next-generation sequencing clinical assay for genomic profiling of cell-free circulating tumor DNA. J. Mol. Diagn. 20, 686–702 (2018).
pubmed: 29936259
pmcid: 6593250
doi: 10.1016/j.jmoldx.2018.05.004
Dawson, S.-J. et al. Analysis of circulating tumor DNA to monitor metastatic breast cancer. N. Engl. J. Med. 368, 1199–1209 (2013).
pubmed: 23484797
doi: 10.1056/NEJMoa1213261
Forshew, T. et al. Noninvasive identification and monitoring of cancer mutations by targeted deep sequencing of plasma DNA. Sci. Transl. Med. 4, 136ra68 (2012).
pubmed: 22649089
doi: 10.1126/scitranslmed.3003726
Kinde, I., Wu, J., Papadopoulos, N., Kinzler, K. W. & Vogelstein, B. Detection and quantification of rare mutations with massively parallel sequencing. Proc. Natl Acad. Sci. USA 108, 9530–9535 (2011).
pubmed: 21586637
pmcid: 3111315
doi: 10.1073/pnas.1105422108
Klein, E. A. et al. Development of a comprehensive cell-free DNA (cfDNA) assay for early detection of multiple tumor types: the Circulating Cell-free Genome Atlas (CCGA) study. J. Clin. Oncol. 36, 12021–12021 (2018).
doi: 10.1200/JCO.2018.36.15_suppl.12021
Miller, A. M. et al. Tracking tumour evolution in glioma through liquid biopsies of cerebrospinal fluid. Nature 565, 654–658 (2019).
pubmed: 30675060
pmcid: 6457907
doi: 10.1038/s41586-019-0882-3
Murtaza, M. et al. Non-invasive analysis of acquired resistance to cancer therapy by sequencing of plasma DNA. Nature 497, 108–112 (2013).
doi: 10.1038/nature12065
pubmed: 23563269
Murtaza, M. et al. Multifocal clonal evolution characterized using circulating tumour DNA in a case of metastatic breast cancer. Nat. Commun. 6, 8760 (2015).
pubmed: 26530965
doi: 10.1038/ncomms9760
Newman, A. M. et al. An ultrasensitive method for quantitating circulating tumor DNA with broad patient coverage. Nat. Med. 20, 548–554 (2014).
pubmed: 24705333
pmcid: 4016134
doi: 10.1038/nm.3519
Newman, A. M. et al. Integrated digital error suppression for improved detection of circulating tumor DNA. Nat. Biotechnol. 34, 547–555 (2016).
pubmed: 27018799
pmcid: 4907374
doi: 10.1038/nbt.3520
Odegaard, J. I. et al. Validation of a plasma-based comprehensive cancer genotyping assay utilizing orthogonal tissue- and plasma-based methodologies. Clin. Cancer Res. 24, 3539 (2018).
pubmed: 29691297
doi: 10.1158/1078-0432.CCR-17-3831
Plagnol, V. et al. Analytical validation of a next generation sequencing liquid biopsy assay for high sensitivity broad molecular profiling. PLoS ONE 13, e0193802 (2018).
pubmed: 29543828
pmcid: 5854321
doi: 10.1371/journal.pone.0193802
Kuderer, N. M. et al. Comparison of 2 commercially available next-generation sequencing platforms in oncology. JAMA Oncol. 3, 996–998 (2017).
pubmed: 27978570
doi: 10.1001/jamaoncol.2016.4983
Stetson, D. et al. Orthogonal comparison of four plasma NGS tests with tumor suggests technical factors are a major source of assay discordance. JCO Precis. Oncol. https://doi.org/10.1200/PO.18.00191 (2019).
Torga, G. & Pienta, K. J. Patient-paired sample congruence between 2 commercial liquid biopsy tests. JAMA Oncol. 4, 868–870 (2018).
pubmed: 29242909
doi: 10.1001/jamaoncol.2017.4027
Merker, J. D. et al. Circulating tumor DNA analysis in patients with cancer: American Society of Clinical Oncology and College of American Pathologists joint review. J. Clin. Oncol. 36, 1631–1641 (2018).
pubmed: 29504847
doi: 10.1200/JCO.2017.76.8671
Shiraishi, Y. et al. A comprehensive characterization of cis-acting splicing-associated variants in human cancer. Genome Res. 28, 1111–1125 (2018).
pubmed: 30012835
pmcid: 6071634
doi: 10.1101/gr.231951.117
Bos, J. L. The ras gene family and human carcinogenesis. Mutat. Res. 195, 255–271 (1988).
pubmed: 3283542
doi: 10.1016/0165-1110(88)90004-8
Blackburn, J. et al. Use of synthetic DNA spike-in controls (sequins) for human genome sequencing. Nat. Protoc. 14, 2119–2151 (2019).
pubmed: 31217595
doi: 10.1038/s41596-019-0175-1
Deveson, I. W. et al. Chiral DNA sequences as commutable controls for clinical genomics. Nat. Commun. 10, 1342 (2019).
Horn, S. et al. TERT promoter mutations in familial and sporadic melanoma. Science 339, 959–961 (2013).
pubmed: 23348503
doi: 10.1126/science.1230062
Jones, W. et al. A verified genomic reference sample for assessing performance of cancer panels detecting small variants of low allele frequency. Genome Biol. https://doi.org/10.1186/s13059-021-02316-z (2021).
Fu, G. K., Hu, J., Wang, P.-H. & Fodor, S. P. A. Counting individual DNA molecules by the stochastic attachment of diverse labels. Proc. Natl Acad. Sci. USA 108, 9026–9031 (2011).
pubmed: 21562209
pmcid: 3107322
doi: 10.1073/pnas.1017621108
Saito, T. & Rehmsmeier, M. The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PLoS ONE 10, e0118432 (2015).
pubmed: 25738806
pmcid: 4349800
doi: 10.1371/journal.pone.0118432
Hardwick, S. A., Deveson, I. W. & Mercer, T. R. Reference standards for next-generation sequencing. Nat. Rev. Genet. 18, 473–484 (2017).
pubmed: 28626224
doi: 10.1038/nrg.2017.44
Hodis, E. et al. A landscape of driver mutations in melanoma. Cell 150, 251–263 (2012).
pubmed: 22817889
pmcid: 3600117
doi: 10.1016/j.cell.2012.06.024
Sheridan, C. Investors keep the faith in cancer liquid biopsies. Nat. Biotechnol. 37, 972–974 (2019).
pubmed: 31485041
doi: 10.1038/d41587-019-00022-7
Lanman, R. B. et al. Analytical and clinical validation of a digital sequencing panel for quantitative, highly accurate evaluation of cell-free circulating tumor DNA. PLoS ONE 10, e0140712 (2015).
pubmed: 26474073
pmcid: 4608804
doi: 10.1371/journal.pone.0140712
Phallen, J. et al. Direct detection of early-stage cancers using circulating tumor DNA. Sci. Transl. Med. 9, eaan2415 (2017).
pubmed: 28814544
pmcid: 6714979
doi: 10.1126/scitranslmed.aan2415
Cohen, J. D. et al. Detection and localization of surgically resectable cancers with a multi-analyte blood test. Science 359, 926–930 (2018).
pubmed: 29348365
pmcid: 6080308
doi: 10.1126/science.aar3247
Tie, J. et al. Circulating tumor DNA analysis detects minimal residual disease and predicts recurrence in patients with stage II colon cancer. Sci. Transl. Med. 8, 346ra92 (2016).
pubmed: 27384348
pmcid: 5346159
doi: 10.1126/scitranslmed.aaf6219
Diehl, F. et al. Circulating mutant DNA to assess tumor dynamics. Nat. Med. 14, 985–990 (2008).
pubmed: 18670422
doi: 10.1038/nm.1789
Mouliere, F. et al. Enhanced detection of circulating tumor DNA by fragment size analysis. Sci. Transl. Med. 10, eaat4921 (2018).
pubmed: 30404863
pmcid: 6483061
doi: 10.1126/scitranslmed.aat4921
Underhill, H. R. et al. Fragment length of circulating tumor DNA. PLoS Genet. 12, e1006162 (2016).
pubmed: 27428049
pmcid: 4948782
doi: 10.1371/journal.pgen.1006162
Shen, S. Y. et al. Sensitive tumour detection and classification using plasma cell-free DNA methylomes. Nature 563, 579–583 (2018).
pubmed: 30429608
doi: 10.1038/s41586-018-0703-0
Kim, Y.-W. et al. Monitoring circulating tumor DNA by analyzing personalized cancer-specific rearrangements to detect recurrence in gastric cancer. Exp. Mol. Med. 51, 1–10 (2019).
pubmed: 31827074
pmcid: 6881327
Klega, K. et al. Detection of somatic structural variants enables quantification and characterization of circulating tumor DNA in children with solid tumors. JCO Precis. Oncol. 2018, PO.17.00285 (2018).
Peng, H. et al. CNV detection from circulating tumor DNA in late stage non-small cell lung cancer patients. Genes (Basel) 10, 926 (2019).
doi: 10.3390/genes10110926
Cai, Z. et al. Detection of microsatellite instability from circulating tumor DNA by targeted deep sequencing. J. Mol. Diagn. 22, 860–870 (2020).
pubmed: 32428677
doi: 10.1016/j.jmoldx.2020.04.210
Hu, Y. et al. False-positive plasma genotyping due to clonal hematopoiesis. Clin. Cancer Res. 24, 4437–4443 (2018).
pubmed: 29567812
doi: 10.1158/1078-0432.CCR-18-0143
McKenna, A. et al. The Genome Analysis Toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data. Genome Res. 20, 1297–1303 (2010).
pubmed: 20644199
pmcid: 2928508
Li, H. & Durbin, R. Fast and accurate short read alignment with Burrows–Wheeler transform. Bioinformatics 25, 1754–1760 (2009).
pubmed: 19451168
pmcid: 2705234
doi: 10.1093/bioinformatics/btp324
Koboldt, D. C. et al. VarScan 2: somatic mutation and copy number alteration discovery in cancer by exome sequencing. Genome Res. 22, 568–576 (2012).
pubmed: 22300766
pmcid: 3290792