Rapidly adaptable automated interpretation of point-of-care COVID-19 diagnostics.
Journal
Communications medicine
ISSN: 2730-664X
Titre abrégé: Commun Med (Lond)
Pays: England
ID NLM: 9918250414506676
Informations de publication
Date de publication:
23 Jun 2023
23 Jun 2023
Historique:
received:
24
10
2022
accepted:
01
06
2023
medline:
24
6
2023
pubmed:
24
6
2023
entrez:
23
6
2023
Statut:
epublish
Résumé
Point-of-care diagnostic devices, such as lateral-flow assays, are becoming widely used by the public. However, efforts to ensure correct assay operation and result interpretation rely on hardware that cannot be easily scaled or image processing approaches requiring large training datasets, necessitating large numbers of tests and expert labeling with validated specimens for every new test kit format. We developed a software architecture called AutoAdapt POC that integrates automated membrane extraction, self-supervised learning, and few-shot learning to automate the interpretation of POC diagnostic tests using smartphone cameras in a scalable manner. A base model pre-trained on a single LFA kit is adapted to five different COVID-19 tests (three antigen, two antibody) using just 20 labeled images. Here we show AutoAdapt POC to yield 99% to 100% accuracy over 726 tests (350 positive, 376 negative). In a COVID-19 drive-through study with 74 untrained users self-testing, 98% found image collection easy, and the rapidly adapted models achieved classification accuracies of 100% on both COVID-19 antigen and antibody test kits. Compared with traditional visual interpretation on 105 test kit results, the algorithm correctly identified 100% of images; without a false negative as interpreted by experts. Finally, compared to a traditional convolutional neural network trained on an HIV test kit, the algorithm showed high accuracy while requiring only 1/50th of the training images. The study demonstrates how rapid domain adaptation in machine learning can provide quality assurance, linkage to care, and public health tracking for untrained users across diverse POC diagnostic tests. It can be difficult to correctly interpret the results of rapid diagnostic tests that give a visual readout, such as COVID rapid tests. We developed a computational algorithm to interpret rapid test results using an image taken by a smartphone camera. This algorithm can easily be adapted for use on results from different test kits. The algorithm was accurate at interpreting results obtained by members of the public using various COVID rapid tests and diagnostic tests with similar outputs used for other infections. The use of this algorithm should enable accurate interpretation of rapid diagnostic tests by members of the public and hence enable improved medical care.
Sections du résumé
BACKGROUND
BACKGROUND
Point-of-care diagnostic devices, such as lateral-flow assays, are becoming widely used by the public. However, efforts to ensure correct assay operation and result interpretation rely on hardware that cannot be easily scaled or image processing approaches requiring large training datasets, necessitating large numbers of tests and expert labeling with validated specimens for every new test kit format.
METHODS
METHODS
We developed a software architecture called AutoAdapt POC that integrates automated membrane extraction, self-supervised learning, and few-shot learning to automate the interpretation of POC diagnostic tests using smartphone cameras in a scalable manner. A base model pre-trained on a single LFA kit is adapted to five different COVID-19 tests (three antigen, two antibody) using just 20 labeled images.
RESULTS
RESULTS
Here we show AutoAdapt POC to yield 99% to 100% accuracy over 726 tests (350 positive, 376 negative). In a COVID-19 drive-through study with 74 untrained users self-testing, 98% found image collection easy, and the rapidly adapted models achieved classification accuracies of 100% on both COVID-19 antigen and antibody test kits. Compared with traditional visual interpretation on 105 test kit results, the algorithm correctly identified 100% of images; without a false negative as interpreted by experts. Finally, compared to a traditional convolutional neural network trained on an HIV test kit, the algorithm showed high accuracy while requiring only 1/50th of the training images.
CONCLUSIONS
CONCLUSIONS
The study demonstrates how rapid domain adaptation in machine learning can provide quality assurance, linkage to care, and public health tracking for untrained users across diverse POC diagnostic tests.
It can be difficult to correctly interpret the results of rapid diagnostic tests that give a visual readout, such as COVID rapid tests. We developed a computational algorithm to interpret rapid test results using an image taken by a smartphone camera. This algorithm can easily be adapted for use on results from different test kits. The algorithm was accurate at interpreting results obtained by members of the public using various COVID rapid tests and diagnostic tests with similar outputs used for other infections. The use of this algorithm should enable accurate interpretation of rapid diagnostic tests by members of the public and hence enable improved medical care.
Autres résumés
Type: plain-language-summary
(eng)
It can be difficult to correctly interpret the results of rapid diagnostic tests that give a visual readout, such as COVID rapid tests. We developed a computational algorithm to interpret rapid test results using an image taken by a smartphone camera. This algorithm can easily be adapted for use on results from different test kits. The algorithm was accurate at interpreting results obtained by members of the public using various COVID rapid tests and diagnostic tests with similar outputs used for other infections. The use of this algorithm should enable accurate interpretation of rapid diagnostic tests by members of the public and hence enable improved medical care.
Identifiants
pubmed: 37353603
doi: 10.1038/s43856-023-00312-x
pii: 10.1038/s43856-023-00312-x
pmc: PMC10290128
doi:
Types de publication
Journal Article
Langues
eng
Pagination
91Informations de copyright
© 2023. The Author(s).
Références
Proc Natl Acad Sci U S A. 2021 Mar 23;118(12):
pubmed: 33674422
IEEE Trans Biomed Eng. 2011 Jul;58(7):1959-66
pubmed: 21245000
ACS Nano. 2017 Mar 28;11(3):2934-2943
pubmed: 28234452
PLoS One. 2018 Aug 27;13(8):e0202786
pubmed: 30148894
AIDS Behav. 2014 May;18(5):933-49
pubmed: 24281697
Clin Infect Dis. 2022 Feb 11;74(3):407-415
pubmed: 33972994
JAMA Intern Med. 2022 Mar 01;182(3):332-341
pubmed: 35099501
AIDS Behav. 2022 Jan;26(1):35-46
pubmed: 34037931
Anal Chem. 2018 Jun 5;90(11):6967-6974
pubmed: 29715012
Lab Chip. 2018 Dec 18;19(1):59-67
pubmed: 30534677
AIDS Behav. 2020 May;24(5):1560-1573
pubmed: 31679075
Nature. 2015 Dec 3;528(7580):S50-2
pubmed: 26633765
Sci Adv. 2020 Dec 16;6(51):
pubmed: 33328239
Science. 2015 Dec 11;350(6266):1332-8
pubmed: 26659050
Nat Biomed Eng. 2021 Jun;5(6):571-585
pubmed: 34112997
Diagn Microbiol Infect Dis. 2020 Nov;98(3):115161
pubmed: 32947206
Nat Med. 2021 Jul;27(7):1165-1170
pubmed: 34140702
IEEE J Transl Eng Health Med. 2021 Nov 23;9:1900415
pubmed: 34873497
Cell Rep Med. 2022 Oct 18;3(10):100784
pubmed: 36240756
Sci Rep. 2021 Jul 7;11(1):14026
pubmed: 34234188
IEEE Trans Pattern Anal Mach Intell. 2020 Feb;42(2):386-397
pubmed: 29994331
Nat Med. 2020 Aug;26(8):1183-1192
pubmed: 32770165
ACS Nano. 2020 Jan 28;14(1):229-240
pubmed: 31849225
AIMS Microbiol. 2020 Aug 26;6(3):280-304
pubmed: 33134745
Anal Chem. 2017 Jan 3;89(1):102-123
pubmed: 27958710
JAMA Netw Open. 2022 May 2;5(5):e2210559
pubmed: 35522284
NPJ Digit Med. 2021 Jul 15;4(1):112
pubmed: 34267312
Public Health. 2000 Mar;114(2):137-42
pubmed: 10800154
Essays Biochem. 2016 Jun 30;60(1):111-20
pubmed: 27365041
AIDS Behav. 2014 Jul;18 Suppl 4:S422-32
pubmed: 24947852
Int J Infect Dis. 2022 Aug;121:58-65
pubmed: 35483554
Biosensors (Basel). 2021 Aug 25;11(9):
pubmed: 34562885
Anal Bioanal Chem. 2009 Jan;393(2):569-82
pubmed: 18696055
ACS Nano. 2021 Jan 26;15(1):665-673
pubmed: 33226787
JMIR Public Health Surveill. 2018 Aug 07;4(3):e11203
pubmed: 30087088
Mikrochim Acta. 2019 Jan 19;186(2):119
pubmed: 30661134
NPJ Digit Med. 2020 May 7;3:66
pubmed: 32411827
Nature. 2019 Feb;566(7745):467-474
pubmed: 30814711
Clin Infect Dis. 2021 May 4;72(9):e384-e393
pubmed: 32785665
Commun Med (Lond). 2022 Jul 6;2:78
pubmed: 35814295
Sci Transl Med. 2017 Mar 22;9(382):
pubmed: 28330865
Lab Chip. 2021 Nov 25;21(23):4517-4548
pubmed: 34778896
Sensors (Basel). 2015 Nov 24;15(11):29569-93
pubmed: 26610513