The staging and grading system in defining periodontitis cases: consistency and accuracy amongst periodontal experts, general dentists and undergraduate students.
classification
data accuracy
diagnosis
periodontitis
reproducibility of results
Journal
Journal of clinical periodontology
ISSN: 1600-051X
Titre abrégé: J Clin Periodontol
Pays: United States
ID NLM: 0425123
Informations de publication
Date de publication:
02 2021
02 2021
Historique:
received:
24
06
2020
revised:
28
09
2020
accepted:
24
11
2020
pubmed:
2
12
2020
medline:
22
4
2021
entrez:
1
12
2020
Statut:
ppublish
Résumé
The objective of this study was to evaluate consistency and accuracy of the periodontitis staging and grading classification system. Thirty participants (10 periodontal experts, 10 general dentists and 10 undergraduate students) and a gold-standard examiner were asked to classify 25 fully documented periodontitis cases twice. Fleiss kappa was used to estimate consistency across examiners. Intraclass correlation coefficient (ICC) was used to calculate consistency across time. Quadratic weighted kappa and percentage of complete agreement versus gold standard were computed to assess accuracy. Fleiss kappa for stage, extent and grade were 0.48, 0.37 and 0.45 respectively. The highest ICC was provided by students for stage (0.91), whereas the lowest ICC by general dentists for extent (0.79). Pairwise comparisons against gold standard showed mean value of kappa >0.81 for stage and >0.41 for grade and extent. Agreement with the gold standard for all three components of the case definition was achieved in 47.2% of cases. The study identified specific factors associated with lower consistency and accuracy. Diagnosis was highly consistent across time and moderately between examiners. Accuracy was almost perfect for stage and moderate for grade and extent. Additional efforts are required to improve training of general dentists.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
205-215Informations de copyright
© 2020 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.
Références
Albandar, J. M., Susin, C., & Hughes, F. J. (2018). Manifestations of systemic diseases and conditions that affect the periodontal attachment apparatus: Case definitions and diagnostic considerations. Journal of Clinical Periodontology, 45(Suppl 20), S171-S189. https://doi.org/10.1111/jcpe.12947
Armitage, G. C. (1999). Development of a classification system for periodontal diseases and conditions. Annals of Periodontology, 4, 1-6. https://doi.org/10.1902/annals.1999.4.1.1
Bewick, V., Cheek, L., & Ball, J. (2004). Statistics review 12: survival analysis. Critical Care, 8, 389-394. https://doi.org/10.1186/cc2955
Cairo, F., Nieri, M., Cattabriga, M., Cortellini, P., De Paoli, S., De Sanctis, M., Fonzar, A., Francetti, L., Merli, M., Rasperini, G., Silvestri, M., Trombelli, L., Zucchelli, G., & Pini-Prato, G. P. (2010). Root coverage esthetic score after treatment of gingival recession: an interrater agreement multicenter study. Journal of Periodontology, 81, 1752-1758. https://doi.org/10.1902/jop.2010.100278
Caton, J. G., Armitage, G., Berglundh, T., Chapple, I. L. C., Jepsen, S., Kornman, K. S., Mealey, B. L., Papapanou, P. N., Sanz, M., & Tonetti, M. S. (2018). A new classification scheme for periodontal and peri-implant diseases and conditions - Introduction and key changes from the 1999 classification. Journal of Clinical Periodontology, 45(Suppl 20), S1-S8. https://doi.org/10.1111/jcpe.12935
Costa, F. O., Guimarães, A. N., Cota, L. O., Pataro, A. L., Segundo, T. K., Cortelli, S. C., & Costa, J. E. (2009). Impact of different periodontitis case definitions on periodontal research. Journal of Oral Science, 51, 199-206. https://doi.org/10.2334/josnusd.51.199
Donner, A., & Rotondi, M. A. (2010). Sample size requirements for interval estimation of the kappa statistic for interobserver agreement studies with a binary outcome and multiple raters. International Journal of Biostatatistics, 6(1), https://doi.org/10.2202/1557-4679.1275
Fleiss, J. L. (1981). Statistical methods for rates and proportions, 2nd ed. (pp. 211-236). John Wiley & Sons.
Hamp, S. E., Nyman, S., & Lindhe, J. (1975). Periodontal treatment of multirooted teeth. Results after 5 years. Journal of Clinical Periodontology, 2, 126-135. https://doi.org/10.1111/j.1600-051x.1975.tb01734.x
Hefti, A. F., & Preshaw, P. M. (2012). Examiner alignment and assessment in clinical periodontal research. Periodontology, 2000(59), 41-60. https://doi.org/10.1111/j.1600-0757.2011.00436.x
Herrera, D., Retamal-Valdes, B., Alonso, B., & Feres, M. (2018). Acute periodontal lesions (periodontal abscesses and necrotizing periodontal diseases) and endo-periodontal lesions. Journal of Clinical Periodontology, 45(Suppl 20), S78-S94. https://doi.org/10.1111/jcpe.12941
Isaia, F., Gyurko, R., Roomian, T. C., & Hawley, C. E. (2018). The root coverage esthetic score: Intra-examiner reliability among dental students and dental faculty. Journal of Periodontology, 89, 833-839. https://doi.org/10.1002/JPER.17-0556
Karanicolas, P. J., Bhandari, M., Kreder, H., Moroni, A., Richardson, M., Walter, S. D., Norman, G. R., & Guyatt, G. H., on Behalf of the Collaboration for Outcome Assessment in Surgical Trials (COAST) Musculoskeletal Group (2009). Evaluating agreement: Conducting a reliability study. Journal of Bone and Joint Surgery, 91, 99-106. https://doi.org/10.2106/JBJS.H.01624
Koran, L. M. (1975). The reliability of clinical methods, data, and judgments (first of two parts). The New England Journal of Medicine, 293, 642-646. https://doi.org/10.1056/NEJM197509252931307
Kornaman, K. S., & Papapanou, P. N. (2020). Clinical application of the new classification of periodontal diseases: Ground rules, clarifications and "gray zones". Journal of Periodontology, 91, 352-360. https://doi.org/10.1002/JPER.19-0557
Kottner, J., Audigé, L., Brorson, S., Donner, A., Gajeweski, B. J., Hróbjartsson, A., Robersts, C., Shoukri, M., & Streiner, D. L. (2011). Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Journal of Clinical Epidemiology, 64(1), 96-106. https://doi.org/10.1016/j.jclinepi.2010.03.002
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174. https://doi.org/10.2307/2529310
Lang, N., Bartold, P. M., Cullinan, M., Jeffcoat, M., Mombelli, A., Murakami, S., Page, R., Papapanou, P., Tonetti, M., & Dyke, T. V. (1999). Consensus report: aggressive periodontitis. Annales of Periodontology, 4, 53. https://doi.org/10.1902/annals.1999.4.1.53
McHugh, M. L. (2012). Interrater reliability: the kappa statistic. Biochemia Medica, 22, 276-282. https://doi.org/10.11613/BM.2012.031
Miller, S. C. (1950). Textbook of Periodontia, 3rd ed. Blakiston Co.
O’Leary, T. J., Drake, R. B., & Naylor, J. E. (1972). The plaque control record. Journal of Periodontology, 43, 38. https://doi.org/10.1902/jop.1972.43.1.38
Rotundo, R., Nieri, M., Bonaccini, D., Mori, M., Lamberti, E., Massironi, D., Giachetti, L., Franchi, L., Venezia, P., Cavalcanti, R., Bondi, E., Farneti, M., Pinchi, V., & Buti, J. (2015). The Smile Esthetic Index (SEI): A method to measure the esthetics of the smile. An intra-rater and inter-rater agreement study. European Journal of Oral Implantology, 8, 397-403.
Sanz, M., Herrera, D., Kebschull, M., Chapple, I., Jepsen, S., Beglundh, T., Sculean, A., Tonetti, M. S., Merete Aass, A., Aimetti, M., Kuru, B. E., Belibasakis, G., Blanco, J., Bol-van den Hil, E., Bostanci, N., Bozic, D., Bouchard, P., Buduneli, N., Cairo, F., … Wennström, J. (2020). Treatment of stage I-III periodontitis -The EFP S3 level clinical practice guideline. Journal of Clinical Periodontology, 47, 4-60. https://doi.org/10.1111/jcpe.13290
Sanz, M., Papapanou, P. N., Tonetti, M. S., Greenwell, H., & Kornman, K. S. (2020). Guest Editorial: Clarifications on the use of the new classification of periodontitis. Journal of Clinical Periodontology, 47, 658-659. https://doi.org/10.1111/jcpe.13286
Sim, J., & Wright, C. C. (2005). The kappa statistic in reliability studies: Use, interpretation, and sample size requirements. Physical Therapy, 85, 257-268. https://doi.org/10.1093/ptj/85.3.257
Streiner, D. L., & Norman, G. R. (2003). Health measurement scales: a practical guide to their development and use, 3rd ed. Oxford University Press.
Tonetti, M. S., Greenwell, H., & Kornman, K. S. (2018). Staging and grading of periodontitis: Framework and proposal of a new classification and case definition. Journal of Clinical Periodontology, 45(Suppl 20), S149-S161. https://doi.org/10.1111/jcpe.12945
Tonetti, M. S., & Sanz, M. (2019). Implementation of the new classification of periodontal diseases: Decision-making algorithms for clinical practice and education. Journal of Clinical Periodontology, 46, 398-405. https://doi.org/10.1111/jcpe.13104