Qualitative threshold method validation and uncertainty evaluation: A theoretical framework and application to a 40 analytes liquid chromatography-tandem mass spectrometry method.
method validation
qualitative
threshold
uncertainty of measurement
Journal
Drug testing and analysis
ISSN: 1942-7611
Titre abrégé: Drug Test Anal
Pays: England
ID NLM: 101483449
Informations de publication
Date de publication:
Sep 2020
Sep 2020
Historique:
received:
05
03
2020
revised:
11
05
2020
accepted:
27
05
2020
pubmed:
2
6
2020
medline:
2
10
2021
entrez:
2
6
2020
Statut:
ppublish
Résumé
Qualitative methods hold an important place in drug testing, filling central needs in screening and analyses, among others, linked to per se legislation. Nevertheless, the bioanalytical method validation guidelines do not discuss this type of method or describe method validation procedures ill-adapted to qualitative methods. The output of qualitative methods are typically categorical, binary results, such as presence/absence or above cut-off/below cut-off. As the goal of any method validation is to demonstrate fitness for use under production conditions, qualitative validation guidelines should evaluate performance based on discrete, binary results instead of the continuous measurements obtained from the instrument (e.g. area). A tentative validation guideline for threshold qualitative methods was developed by in silico modelling of measurements and derived binary results. This preliminary guideline was applied to a liquid chromatography-tandem mass spectrometry method for 40 analytes, each with a defined threshold concentration. Validation parameters calculated from the analysis of 30 samples spiked above and below the threshold concentration (false negative rate, false positive rate, selectivity rate, sensitivity rate and reliability rate) showed a surprisingly high failure rate. Overall, 13 out of the 40 analytes were not considered validated. A subsequent examination found that this was attributable to an appreciable shift in the standard deviation of the area ratio on a day-to-day basis, a previously undescribed and unaccounted-for behaviour in the qualitative threshold method validation literature. Consequently, the developed guideline was modified and used to validate a qualitative threshold method, based on the binary results for performance evaluation and incorporating measurement uncertainty.
Types de publication
Journal Article
Validation Study
Langues
eng
Sous-ensembles de citation
IM
Pagination
1287-1297Subventions
Organisme : Australian Research Council
ID : DP #140100125
Organisme : Canada First Research Excellence Fund
Organisme : Fonds de Recherche du Québec - Nature et Technologies
Organisme : Natural Sciences and Engineering Research Council of Canada
Informations de copyright
© 2020 John Wiley & Sons, Ltd.
Références
Scientific Working Group for Forensic Toxicology. Scientific working Group for Forensic Toxicology (SWGTOX) standard practices for method validation in forensic toxicology. J Anal Toxicol. 2013;37:452-474.
González O, Blanco ME, Iriarte G, Bartolomé L, Maguregui MI, Alonso RM. Bioanalytical chromatographic method validation according to current regulations, with a special focus on the non-well defined parameters limit of quantification, robustness and matrix effect. J Chromatogr a. 2014;1353:10-27.
Hartmann C, Smeyers-Verbeke J, Massart DL, McDowall RD. Validation of bioanalytical chromatographic methods. J Pharm Biomed Anal. 1998;17(2):193-218.
Hubert P, Nguyen-Huu J-J, Boulanger B, et al. Harmonization of strategies for the validation of quantitative analytical procedures. A SFSTP Proposal--Part III J Pharm Biomed Anal. 2007;45(1):82-96.
Peters FT, Drummer OH, Musshoff F. Validation of new methods. Forensic Sci Int. 2007;165(2-3):216-224.
Peters FT, Maurer HH. Bioanalytical method validation and its implications for forensic and clinical toxicology - a review. Accreditation Qual Assur. 2002;7(11):441-449.
Wille SMR, Coucke W, De Baere T, Peters FT. Update of standard practices for new method validation in forensic toxicology. Curr Pharm des. 2017;23(36):5442-5454.
Food and Drug Administration. Bioanalytical Method Validation: Guidance for Industry. USA: Silver Springs; 2018. https://www.fda.gov/files/drugs/published/Bioanalytical-Method-Validation-Guidance-for-Industry.pdf
European Medicines Agency. Guideline on Bioanalytical Method Validation. London, United Kingdom; 2015. https://www.ema.europa.eu/en/documents/scientific-guideline/guideline-bioanalytical-method-validation_en.pdf
AAFS Standards Board. Standard Practices for Method Validation in Forensic Toxicology. USA: Colorado Springs; 2018. http://www.asbstandardsboard.org/wp-content/uploads/2019/11/036_Std_e1.pdf
International Organization for Standardization. General requirements for the competence of testing and calibration laboratories. Geneva, Switzerland; 2017. https://www.iso.org/standard/66912.html
Gesellschaft für Toxikologische und Forensische Chemie (GTFCh). Guideline for quality control in forensic-toxicological analyses, 2018. https://www.gtfch.org/cms/index.php/en/guidelines
Wille SMR, Peters FT, Di Fazio V, Samyn N. Practical aspects concerning validation and quality control for forensic and clinical bioanalytical quantitative methods. Accreditation Qual Assur. 2011;16(6):279-292.
de Gondim CS, Coelho OAM, Alvarenga RL, Junqueira RG, de Souza SVC. An appropriate and systematized procedure for validating qualitative methods: its application in the detection of sulfonamide residues in raw milk. Anal Chim Acta Theriol. 2014;830:11-22.
López MI, Callao MP, Ruisánchez I. A tutorial on the validation of qualitative methods: from the univariate to the multivariate approach. Anal Chim Acta. 2015;891:62-72.
Trullols E, Ruisánchez I, Rius FX, Huguet J. Validation of qualitative methods of analysis that use control samples. TrAC Trends Anal Chem. 2005;24(6):516-524.
Parikh R, Mathai A, Parikh S, Chandra Sekhar G, Thomas R. Understanding and using sensitivity, specificity and predictive values. Indian J Ophthalmol. 2008;56(1):45-50.
Altman DG, Bland JM. Diagnostic tests. 1: sensitivity and specificity. BMJ. 1994;308(6943):1552.
Côté C, Desharnais B, Morel M-A, et al. High Throughput Protein Precipitation: Screening and Quantification of 106 Drugs and their Metabolites using LC-MS/MS. In: 2017 Society of Forensic Toxicologists (SOFT) and 55th Annual Meeting of the International Association of Forensic Toxicologists (TIAFT). USA: Boca Raton; 2018.
European Commission Directorate General for Health and Food Safety. Guidance document on analytical quality control and method validation procedures for pesticide residues and analysis in food and feed, 2017. https://ec.europa.eu/food/sites/food/files/plant/docs/pesticides_mrl_guidelines_wrkdoc_2017-11813.pdf
Trullols E, Ruisánchez I, Rius FX. Validation of qualitative analytical methods. TrAC Trends Anal Chem. 2004;23(2):137-145.
Yi GY. Statistical Analysis with Measurement Error or Misclassification: Strategy, Method and Application. New York: Springer-Verlag; 2017.