Validation of the Antifungal National Antimicrobial Prescribing Survey (AF-NAPS) quality assessment tool.
Journal
The Journal of antimicrobial chemotherapy
ISSN: 1460-2091
Titre abrégé: J Antimicrob Chemother
Pays: England
ID NLM: 7513617
Informations de publication
Date de publication:
01 06 2023
01 06 2023
Historique:
received:
27
10
2022
accepted:
08
03
2023
medline:
2
6
2023
pubmed:
12
4
2023
entrez:
11
4
2023
Statut:
ppublish
Résumé
The Antifungal National Antimicrobial Prescribing Survey (AF-NAPS) was developed to undertake streamlined quality audits of antifungal prescribing. The validity and reliability of such tools is not characterized. To assess the validity and reliability of the AF-NAPS quality assessment tool. Case vignettes describing antifungal prescribing were prepared. A steering group was assembled to determine gold-standard classifications for appropriateness and guideline compliance. Infectious diseases physicians, antimicrobial stewardship (AMS) and specialist pharmacists undertook a survey to classify appropriateness and guideline compliance of prescriptions utilizing the AF-NAPS tool. Validity was measured as accuracy, sensitivity and specificity compared with gold standard. Inter-rater reliability was measured using Fleiss' kappa statistics. Assessors' responses and comments were thematically analysed to determine reasons for incorrect classification. Twenty-eight clinicians assessed 59 antifungal prescriptions. Overall accuracy of appropriateness assessment was 77.0% (sensitivity 85.3%, specificity 68.0%). Highest accuracy was seen amongst specialist (81%) and AMS pharmacists (79%). Prescriptions with lowest accuracy were in the haematology setting (69%), use of echinocandins (73%), mould-active azoles (75%) and for prophylaxis (71%). Inter-rater reliability was fair overall (0.3906), with moderate reliability amongst specialist pharmacists (0.5304). Barriers to accurate classification were incorrect use of the appropriateness matrix, knowledge gaps and lack of guidelines for some indications. The AF-NAPS is a valid tool, assisting assessors to correctly classify appropriate prescriptions more accurately than inappropriate prescriptions. Specialist and AMS pharmacists had similar performance, providing confidence that both can undertake AF-NAPS audits to a high standard. Identified reasons for incorrect classification will be targeted in the online tool and educational materials.
Sections du résumé
BACKGROUND
The Antifungal National Antimicrobial Prescribing Survey (AF-NAPS) was developed to undertake streamlined quality audits of antifungal prescribing. The validity and reliability of such tools is not characterized.
OBJECTIVES
To assess the validity and reliability of the AF-NAPS quality assessment tool.
METHODS
Case vignettes describing antifungal prescribing were prepared. A steering group was assembled to determine gold-standard classifications for appropriateness and guideline compliance. Infectious diseases physicians, antimicrobial stewardship (AMS) and specialist pharmacists undertook a survey to classify appropriateness and guideline compliance of prescriptions utilizing the AF-NAPS tool. Validity was measured as accuracy, sensitivity and specificity compared with gold standard. Inter-rater reliability was measured using Fleiss' kappa statistics. Assessors' responses and comments were thematically analysed to determine reasons for incorrect classification.
RESULTS
Twenty-eight clinicians assessed 59 antifungal prescriptions. Overall accuracy of appropriateness assessment was 77.0% (sensitivity 85.3%, specificity 68.0%). Highest accuracy was seen amongst specialist (81%) and AMS pharmacists (79%). Prescriptions with lowest accuracy were in the haematology setting (69%), use of echinocandins (73%), mould-active azoles (75%) and for prophylaxis (71%). Inter-rater reliability was fair overall (0.3906), with moderate reliability amongst specialist pharmacists (0.5304). Barriers to accurate classification were incorrect use of the appropriateness matrix, knowledge gaps and lack of guidelines for some indications.
CONCLUSIONS
The AF-NAPS is a valid tool, assisting assessors to correctly classify appropriate prescriptions more accurately than inappropriate prescriptions. Specialist and AMS pharmacists had similar performance, providing confidence that both can undertake AF-NAPS audits to a high standard. Identified reasons for incorrect classification will be targeted in the online tool and educational materials.
Identifiants
pubmed: 37038993
pii: 7113313
doi: 10.1093/jac/dkad085
doi:
Substances chimiques
Antifungal Agents
0
Anti-Infective Agents
0
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1367-1377Informations de copyright
© The Author(s) 2023. Published by Oxford University Press on behalf of British Society for Antimicrobial Chemotherapy. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.