Assessing speech at three years of age in the cleft palate population: a scoping review of assessment practices.
age 3 years
cleft lip and palate
cleft palate
preschool
speech analysis
speech assessment
Journal
International journal of language & communication disorders
ISSN: 1460-6984
Titre abrégé: Int J Lang Commun Disord
Pays: United States
ID NLM: 9803709
Informations de publication
Date de publication:
03 2020
03 2020
Historique:
received:
29
04
2019
revised:
11
10
2019
accepted:
21
11
2019
pubmed:
23
2
2020
medline:
15
12
2020
entrez:
21
2
2020
Statut:
ppublish
Résumé
There is no consensus in the UK regarding the types of speech samples or parameters of speech that should be assessed at 3 years of age in children with cleft palate ± cleft lip (CP±L), despite cleft units routinely assessing speech at this age. The standardization of assessment practices would facilitate comparisons of outcomes across UK cleft units; earlier identification of speech impairments-which could support more timely treatments; and more reliable recording of therapy impacts and surgical interventions. To explore assessment practices used to assess speech in 3-year-old children with CP±L, including speech parameters, methods of assessment and the nature of the speech sample used. A broad examination of the literature was undertaken through the use of a scoping review conducted in accordance with Joanna Briggs Institute guidelines. Search terms were generated from a preliminary search and then used in the main search (Medline, CINAHL, Embase, AMED and PsycINFO). A combination of approaches (medical, linguistic, developmental and functional) is required to assess CP±L speech at age 3. A developmental approach is recommended at this age, considering the complexity of speech profiles at age 3, in which typically developing speech processes may occur alongside cleft speech characteristics. A combined measure for both nasal emission and turbulence, and an overall measure for velopharyngeal function for speech, show potential for assessment at this age. Categorical ordinal scales are frequently used; the use of continuous scales has yet to be fully explored at age 3. Although single-word assessments, including a subset of words developed for cross-linguistic comparisons, are frequently used, more than one type of speech sample may be needed to assess speech at this age validly. The lack of consensus regarding speech samples highlights a need for further research into the types of speech samples 3-year-olds can complete; the impact of incomplete speech samples on outcome measures (particularly relevant at this age when children may be less able to complete a full sample); the impact of different speech samples on the validity of assessments; and the reliability of listener judgements. Whilst a medical model and linguistic approaches are often central in assessments of age-3 cleft speech, this review highlights the importance of developmental and functional approaches to assessment. Cross-linguistic single-word assessments show potential, and would facilitate the comparison of UK speech outcomes with other countries. Further research should explore the impact of different speech samples and rating scales on assessment validity and listener reliability.
Sections du résumé
BACKGROUND
There is no consensus in the UK regarding the types of speech samples or parameters of speech that should be assessed at 3 years of age in children with cleft palate ± cleft lip (CP±L), despite cleft units routinely assessing speech at this age. The standardization of assessment practices would facilitate comparisons of outcomes across UK cleft units; earlier identification of speech impairments-which could support more timely treatments; and more reliable recording of therapy impacts and surgical interventions.
AIMS
To explore assessment practices used to assess speech in 3-year-old children with CP±L, including speech parameters, methods of assessment and the nature of the speech sample used.
METHODS & PROCEDURES
A broad examination of the literature was undertaken through the use of a scoping review conducted in accordance with Joanna Briggs Institute guidelines. Search terms were generated from a preliminary search and then used in the main search (Medline, CINAHL, Embase, AMED and PsycINFO).
MAIN CONTRIBUTION
A combination of approaches (medical, linguistic, developmental and functional) is required to assess CP±L speech at age 3. A developmental approach is recommended at this age, considering the complexity of speech profiles at age 3, in which typically developing speech processes may occur alongside cleft speech characteristics. A combined measure for both nasal emission and turbulence, and an overall measure for velopharyngeal function for speech, show potential for assessment at this age. Categorical ordinal scales are frequently used; the use of continuous scales has yet to be fully explored at age 3. Although single-word assessments, including a subset of words developed for cross-linguistic comparisons, are frequently used, more than one type of speech sample may be needed to assess speech at this age validly. The lack of consensus regarding speech samples highlights a need for further research into the types of speech samples 3-year-olds can complete; the impact of incomplete speech samples on outcome measures (particularly relevant at this age when children may be less able to complete a full sample); the impact of different speech samples on the validity of assessments; and the reliability of listener judgements.
CONCLUSIONS & IMPLICATIONS
Whilst a medical model and linguistic approaches are often central in assessments of age-3 cleft speech, this review highlights the importance of developmental and functional approaches to assessment. Cross-linguistic single-word assessments show potential, and would facilitate the comparison of UK speech outcomes with other countries. Further research should explore the impact of different speech samples and rating scales on assessment validity and listener reliability.
Identifiants
pubmed: 32077212
doi: 10.1111/1460-6984.12517
doi:
Types de publication
Journal Article
Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
165-187Informations de copyright
© 2020 Royal College of Speech and Language Therapists.
Références
Arksey, H. and O'malley, L., 2005, Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19-32.
Armstrong, S. and Ainley, M., 1992, South Tyneside Assessment of Phonology (STAP) (Notuhumberland: Stass Publications).
Baylis, A., Chapman, K. and Whitehill, T. L., 2015, Validity and reliability of visual analogue scaling for assessment of hypernasality and audible nasal emission in children with repaired cleft palate. Cleft Palate-Craniofacial Journal, 52(6), 660-670.
Boucher, J. and Lewis, V., 1997, Preschool Language Scale-3 (UK) (London: Psychological Corporation).
Britton, L., Albery, L., Bowden, M., Harding-Bell, A., Phippen, G. and Sell, D., 2014, A cross-sectional cohort study of speech in five-year-olds with cleft palate ± lip to support development of national audit standards: benchmarking speech standards in the United Kingdom. Cleft Palate-Craniofacial Journal, 51(4), 431-451.
Cavalheiro, M. G., Lamônica, D. A. C., De Vasconsellos H., Simone R. and Maximino, L. P., 2019, Child development skills and language in toddlers with cleft lip and palate. International Journal of Pediatric otorhinolaryngology, 116, 18-21.
Chacon, A., Parkin, M., Broome, K. and Purcell, A., 2017, Australian children with cleft palate achieve age-appropriate speech by 5 years-of-age. International Journal of Pediatric Otorhinolaryngology, 103, 93-102.
Chapman, K. L., 2004, Is presurgery and early postsurgery performance related to speech and language outcomes at 3 years of age for children with cleft palate? Clinical Linguistics and Phonetics, 18(4-5), 235-257.
Chapman, K. L., Baylis, A., Trost-Cardamone, J., Cordero, K. N., Dixon, A., Dobbelsteyn, C., Thurmes, A., Wilson, K., Harding-Bell, A. and Sweeney, T., 2016, The Americleft Speech Project: a training and reliability study. Cleft Palate-Craniofacial Journal, 53(1), 93-108.
Chapman, K. L., Hardin-Jones, M. A., Goldstein, J. A., Halter, K. A., Havlik, R. J. and Schulte, J., 2008, Timing of palatal surgery and speech outcome. Cleft Palate-Craniofacial Journal, 45(3), 297-308.
Chapman, K. L., Hardin-Jones, M. and Halter, K. A., 2003, The relationship between early speech and later speech and language performance for children with cleft lip and palate. Clinical Linguistics and Phonetics, 17(3), 173-197.
Chapman, K. L. and Willadsen, E., 2011, The development of speech in children with cleft palate. In S. Howard and A. Lohmander (eds), Cleft Palate Speech: Assessment and Intervention (Chichester: Wiley-Blackwell), pp. 23-42.
Clear Resources, 2006, CLEAR Phonology Screening Assessment (Spilsby: CLEAR Resources).
Cleft Palate International Speech Issues (CLISPI), n.d., Speech Material to be Collected at Different Ages (available at: https://www.clispi.org/en/node/17) (accessed on 11 August 2018).
Cleft Registry and Audit Network (CRANE), 2019, Annual Report on Cleft Lip and/or Palate 2019 (available at: https://crane-database.org.uk/?!.iD=3l) (accessed on 1 October 2019).
Dayashankara, R. J., Singh, S., Suma, G. N., Gokkula, K., Kumar, V. and Sursh, B. S., 2011, Comparative study of 2 palatoplasty techniques to assess speech and fistula in primary cleft palate patients. Journal of Dentistry for Children, 78(1), 13-18.
Dodd, B., Zhu, H., Crosbie, S., Holm, A. and Ozanne, A., 2002, Diagnostic Evaluation of Articulation and Phonology (DEAP) (London: Psychology Corporation).
Dosman, C. F., Andrews, D. and Goulden, K. J., 2012, Evidence-based milestone ages as a framework for developmental surveillance. Paediatrics and Child Health, 17(10), 561-568.
Dudas, J. R., Deleyiannis, F. W., Ford, M. D., Jiang, S. and Losee, J. E., 2006, Diagnosis and treatment of velopharyngeal insufficiency: Clinical utility of speech evaluation and videofluoroscopy. Annals of Plastic Surgery, 56(5), 511-517.
El Ezzi, O., Herzog, G., Broome, M., Trichet-Zbinden, C., Hohlfeld, J., Cherpillod, J. and De Buys Roessingh, A. S., 2015, Grommets and speech at three and six years in children born with total cleft or cleft palate. International Journal of Pediatric Otorhinolaryngology, 79(12), 2243-2247.
Frederickson, M. S., Chapman, K. L. and Hardin-Jones, M., 2006, Conversational skills of children with cleft lip and palate: a replication and extension. Cleft Palate-Craniofacial Journal, 43(2), 179-188.
Frey, J. R., Kaiser, A. P. and Scherer, N. J., 2018, The influences of child intelligibility and rate on caregiver responses to toddlers with and without cleft palate. Cleft Palate-Craniofacial Journal, 55(2), 276-286.
Goldman, R. and Fristoe, M., 1986, Goldman-Fristoe Test of Articulation (Circle Pines Minnesota: American Guidance Service).
Grunwell, P. and Harding, A., 1995, PACS TOYS (Windsor: NFER-Nelson).
Grunwell, P. and Sell, D., 2001, Speech and cleft palate/velopharyngeal anomalies. In A. C. H. Watson, D. A. Sell and P. Grunwell (eds), Management of Cleft Lip and Palate (London: Whurr), pp. 68-86.
Gugsch, C., Dannhauer, K. and Fuchs, M., 2008, Evaluation of the progress of therapy in patients with cleft lip, jaw and palate, using voice analysis-a pilot study. Journal of Orofacial Orthopedics, 69(4), 257-267.
Gunther, E., Wisser, J. R., Cohen, M. A. and Brown, A. S., 1998, Palatoplasty: Furlow's double reversing Z-plasty versus intravelar veloplasty. Cleft Palate-Craniofacial Journal, 35(6), 546-549.
Hamming, K. K., Finkelstein, M. and Sidman, J. D., 2009, Hoarseness in children with cleft palate. Otolaryngology-Head and Neck Surgery, 140(6), 902-906.
Harding, A. and Grunwell, P., 1995, Active versus passive cleft-type speech characteristics: implications for surgery and therapy. International Journal of Language and Communication Disorders, 30(S1), 242-247.
Hattee, C., Farrow, K., Harland, K., Sommerlad, B. and Walsh, M., 2001, Are we ready to predict speech development from babble in cleft lip and palate children? International Journal of Language and Communication Disorders, 36(S1), 115-120.
Henningsson, G., Kuehn, D. P., Sell, D., Sweeney, T., Trost-Cardamone, J. E. and Whitehill, T. L., 2008, Universal parameters for reporting speech outcomes in individuals with cleft palate. Cleft Palate-Craniofacial Journal, 45(1), 1-17.
Heydari, S., Torabi Nezhad, F., Agha Rasouli, Z. and Hoseyni, F., 2011, Development of speech intelligibility measurement test for 3 to 5 years old normal children. Bimonthly Audiology-Tehran University of Medical Sciences, 20(1), 47-53.
Hodge, M. and Gotzke, C. L., 2007, Preliminary results of an intelligibility measure for English-speaking children with cleft palate. Cleft Palate-Craniofacial Journal, 44(2), 163-174.
Howard, S., 2011, Phonetic transcription for speech related to cleft palate. In S. Howard S. and A. Lohmander (eds), Cleft Palate Speech: Assessment and Intervention (Chichester: Wiley-Blackwell), pp. 127-144.
Hutters, B., Bau, A. and Brøndsted, K., 2001, A longitudinal group study of speech development in Danish children born with and without cleft lip and palate. International Journal of Language and Communication Disorders, 36(4), 447-470.
Hutters, B. and Brøndsted, K., 1987, Strategies in cleft palate speech-with special reference to Danish. Cleft Palate Journal, 24(2), 126-136.
International Consortium for Health Outcome Measurement (ICHOM), 2017, Cleft Lip and Palate Data Collection version 3.0.6. (available: http://www.ichom.org/medical-conditions/cleft-lip-palate/) (accessed on 10 June 2018).
John, A., Sell, D., Sweeney, T., Harding-Bell, A. and Williams, A., 2006, The cleft audit protocol for speech-augmented: A validated and reliable measure for auditing cleft speech. Cleft Palate-Craniofacial Journal, 43(3), 272-288.
Khalil, H., Peters, M., Godfrey, C. M., Mcinerney, P., Soares, C. B. and Parker, D., 2016, An evidence-based approach to scoping reviews. Worldviews on Evidence-Based Nursing, 13(2), 118-123.
Klintö, K., Olsson, M., Flynn, T., Svensson, H. and Lohmander, A., 2014a, Phonology in Swedish-speaking 3-year-olds born with cleft lip and palate and the relationship with consonant production at 18 months. International Journal of Language and Communication Disorders, 49(2), 240-254.
Klintö, K., Salameh, E. and Lohmander, A., 2015, Verbal competence in narrative retelling in 5 year olds with unilateral cleft lip and palate. International Journal of Language and Communication Disorders, 50(1), 119-128.
Klintö, K., Salameh, E. and Lohmander, A., 2016, Phonology in Swedish-speaking 5-year-olds born with unilateral cleft lip and palate and the relationship with consonant production at 3 years of age. International Journal of Speech-Language Pathology, 18(2), 147-156.
Klintö, K., Salameh, E., Svensson, H. and Lohmander, A., 2011, The impact of speech material on speech judgement in children with and without cleft palate. International Journal of Language and Communication Disorders, 46(3), 348-360.
Klintö, K., Svensson, H., Elander, A. and Lohmander, A., 2014b, Speech and phonology in Swedish-speaking 3-year-olds with unilateral complete cleft lip and palate following different methods for primary palatal surgery. Cleft Palate-Craniofacial Journal, 51(3), 274-282.
Konst, E. M., Rietveld, T., Peters, H. F. and Prahl-Andersen, B., 2003, Phonological development of toddlers with unilateral cleft lip and palate who were treated with and without infant orthopedics: a randomized clinical trial. Cleft Palate-Craniofacial Journal, 40(1), 32-39.
Larsson, A., Schölin, J., Mark, H., Jönsson, R. and Persson, C., 2017, Speech production in 3 year old internationally adopted children with unilateral cleft lip and palate. International Journal of Language and Communication Disorders, 52(5), 626-636.
Lohmander, A., Borell, E., Henningsson, G., Havstam, C., Lundeborg, I. and Persson, C., 2005, SVANTE Svenskt artikulations- och nasalitets-test, manual [In Swedish], 2nd ed. (Lund: Studentlitteratur).
Lohmander, A., Friede, H., Elander, A., Persson, C. and Lilja, J., 2006, Speech development in patients with unilateral cleft lip and palate treated with different delays in closure of the hard palate after early velar repair: a longitudinal perspective. Scandinavian Journal of Plastic and Reconstructive Surgery and Hand Surgery, 40(5), 267-274.
Lohmander, A., Lundeborg, I. and Persson, C., 2017a, SVANTE-The Swedish Articulation and Nasality Test-Normative data and a minimum standard set for cross-linguistic comparison. Clinical Linguistics and Phonetics, 31(2), 137-154.
Lohmander, A. and Persson, C., 2008, A longitudinal study of speech production in Swedish children with unilateral cleft lip and palate and two-stage palatal repair. Cleft Palate-Craniofacial Journal, 45(1), 32-41.
Lohmander, A., Persson, C., Willadsen, E., Lundeborg, I., Alaluusua, S., Aukner, R., Bau, A., Boers, M., Bowden, M. and Davies, J., 2017b, Scandcleft randomised trials of primary surgery for unilateral cleft lip and palate: 4. Speech outcomes in 5-year-olds-velopharyngeal competency and hypernasality. Journal of Plastic Surgery and Hand Surgery, 51(1), 27-37.
Lohmander, A., Willadsen, E., Persson, C., Henningsson, G., Bowden, M. and Hutters, B., 2009, Methodology for speech assessment in the Scandcleft project-an international randomized clinical trial on palatal surgery: experiences from a pilot study. Cleft Palate-Craniofacial Journal, 46(4), 347-362.
Lohmander-Agerskov, A., 1998, Speech outcome after cleft palate surgery with the Gothenburg regimen including delayed hard palate closure. Scandinavian Journal of Plastic and Reconstructive Surgery and Hand Surgery, 32(1), 63-80.
Lohmander-Agerskov, A., Söderpalm, E., Friede, H. and Lilja, J., 1998, A comparison of babbling and speech at pre-speech level, 3, and 5 years of age in children with cleft lip and palate treated with delayed hard palate closure. Folia Phoniatrica et Logopaedica, 50(6), 320-334.
Mcleod, S. and Baker, E., 2017, Children's Speech: An Evidence-Based Approach to Assessment and Intervention (Boston, MA: Pearson).
Mcleod, S., Harrison, L. J. and Mccormack, J., 2012, The intelligibility in context scale: Validity and reliability of a subjective rating measure. Journal of Speech, Language, and Hearing Research, 55(2), 648-656.
Mcwilliams, B. and Philips, B. J., 1979, Velopharyngeal Incompetence: Audio Seminars in Speech Pathology (Philadelphia, PA: W.B. Saunders).
Morris, H. and Ozanne, A., 2003, Phonetic, phonological, and language skills of children with a cleft palate. Cleft Palate-Craniofacial Journal, 40(5), 460-470.
Munn, Z., Peters, M. D., Stern, C., Tufanaru, C., Mcarthur, A. and Aromataris, E., 2018, Systematic review or scoping review? guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 18(1), 143.
Pereira, V. J., Sell, D. and Tuomainen, J., 2013, Effect of maxillary osteotomy on speech in cleft lip and palate: Perceptual outcomes of velopharyngeal function. International Journal of Language and Communication Disorders, 48(6), 640-650.
Persson, C., Lohmander, A. and Elander, A., 2006, Speech in children with an isolated cleft palate: a longitudinal perspective. Cleft Palate-Craniofacial Journal, 43(3), 295-309.
Peters, M. D., Godfrey, C. M., Khalil, H., Mcinerney, P., Parker, D. and Soares, C. B., 2015, Guidance for conducting systematic scoping reviews. International Journal of Evidence-Based Healthcare, 13(3), 141-146.
Prathanee, B., Lorwatanapongsa, P., Anantapong, D. and Buakanok, N., 2011, Thai speech parameters for patients with cleft palate in a universal reporting system. Asia Pacific Journal of Speech, Language and Hearing, 14(1), 31-49.
Pulkkinen, J., Haapanen, M., Paaso, M., Laitinen, J. and Ranta, R., 2001, Velopharyngeal function from the age of three to eight years in cleft palate patients. Folia Phoniatrica et Logopaedica, 53(2), 93-98.
Raud Westberg, L., Höglund Santamarta, L., Karlsson, J., Nyberg, J., Neovius, E. and Lohmander, A., 2017, Speech outcome in young children born with unilateral cleft lip and palate treated with one- or two-stage palatal repair and the impact of early intervention. Logopedics Phoniatrics Vocology, 44(2), 58-66.
Renfrew, C. E., 2011, Action Picture Test (Milton Keynes: Speechmark).
Safaiean, A., Jalilevand, N., Ebrahimipour, M., Asleshirin, E. and Hiradfar, M., 2017, Speech intelligibility after repair of cleft lip and palate. Medical Journal of The Islamic Republic of Iran, 31(1), 500-504.
Sell, D., 2005, Issues in perceptual speech analysis in cleft palate and related disorders: a review. International Journal of Language and Communication Disorders, 40(2), 103-121.
Sell, D., Harding, A. and Grunwell, P., 1999, GOS.SP.ASS’98: an assessment for speech disorders associated with cleft palate and/or velopharyngeal dysfunction (revised). International Journal of Language and Communication Disorders, 34(1), 17-33.
Sell, D., John, A., Harding-Bell, A., Sweeney, T., Hegarty, F. and Freeman, J., 2009, Cleft Audit Protocol for Speech (CAPS-A): a comprehensive training package for speech analysis. International Journal of Language and Communication Disorders, 44(4), 529-548.
Sell, D. and Pereira, V., 2015, Speech: perceptual and functional outcomes. In J. Losee. and R. E. Kirschner (eds), Comprehensive Cleft Care (London: McGraw Hill), pp. 689-714.
Shriberg, L. D. and Kwiatkowski, J., 1982, Phonological disorders III: A procedure for assessing severity of involvement. Journal of Speech and Hearing Disorders, 47(3), 256-270.
Shriberg, L. D., Austin, D., Lewis, B. A., Mcsweeny, J. L. and Wilson, D. L., 1997, The percentage of consonants correct (PCC) metric: Extensions and reliability data. Journal of Speech, Language, and Hearing Research, 40(4), 708-722.
Stevens, N. and Isles, D., 2011, Phonological Screening Assessment (PSA) (London: Taylor & Francis).
Swanson, J. W., Mitchell, B. T., Cohen, M., Solot, C., Jackson, O., Low, D., Bartlett, S. P. and Taylor, J. A., 2017, The effect of Furlow palatoplasty timing on speech outcomes in submucous cleft palate. Annals of Plastic Surgery, 79(2), 156-161.
Sweeney, T., 2011, Nasality-assessment and intervention. In S. Howard and A. Lohmander (eds), Cleft Palate Speech: Assessment and Intervention (Chichester: Wiley-Blackwell), pp. 199-220.
Tillman, K. K., Hakelius, M., Höijer, J., Ramklint, M., Ekselius, L., Nowinski, D. and Papadopoulos, F. C., 2018, Increased risk for neurodevelopmental disorders in children with orofacial clefts. Journal of the American Academy of Child and Adolescent Psychiatry, 57(11), 876-883.
Tricco, A. C., Lillie, E., Zarin, W., O'brien, K., Colquhoun, H., Kastner, M. and Wilson, K., 2016, A scoping review on the conduct and reporting of scoping reviews. BMC Medical Research Methodology, 16(1), 15.
Whitehill, T. L., 2002, Assessing intelligibility in speakers with cleft palate: a critical review of the literature. Cleft Palate-Craniofacial Journal, 39(1), 50-58.
Whitehill, T. L., Gotzke, C. and Hodge, M., 2011, Speech intelligibility. In S. Howard and A. Lohmander (eds), Cleft Palate Speech: Assessment and Intervention (Chichester: Wiley-Blackwell), pp. 293-304.
Willadsen, E., 2012, Influence of timing of hard palate repair in a two-stage procedure on early speech development in Danish children with cleft palate. Cleft Palate-Craniofacial Journal, 49(5), 574-595.
Willadsen, E., Boers, M., Schöps, A., Kislingmøller, M., Nielsen, J. B., Jørgensen, L. D., Andersen, M., Bolund, S. and Andersen, H. S., 2018, Influence of timing of delayed hard palate closure on articulation skills in 3-year-old Danish children with unilateral cleft lip and palate. International Journal of Language and Communication Disorders, 53(1), 130-143.
Willadsen, E., Lohmander, A., Persson, C., Lundeborg, I., Alaluusua, S., Aukner, R., Bau, A., Boers, M., Bowden, M. and Davies, J., 2017, Scandcleft randomised trials of primary surgery for unilateral cleft lip and palate: 5. Speech outcomes in 5-year-olds-consonant proficiency and errors. Journal of Plastic Surgery and Hand Surgery, 51(1), 38-51.
Willadsen, E. and Poulsen, M., 2012, A restricted test of single-word intelligibility in 3-year-old children with and without cleft palate. Cleft Palate-Craniofacial Journal, 49(3), 6-16.
World Health Organization (WHO), 2007, International Classification of Functioning, Disability and Health. Children and Youth Version (Geneva: WHO).
Wren, Y., 2013, A survey of the assessment procedures at 24 and 36 months in UK cleft centres. The Cleft Collective Speech and Language Study (unpublished survey).
Yamashita, R. P., Borg, E., Granqvist, S. and Lohmander, A., 2018, Reliability of hypernasality rating: comparison of 3 different methods for perceptual assessment. Cleft Palate-Craniofacial Journal, 55(8), 1-12.
Zanzi, M., Cherpillod, J. and Hohlfeld, J., 2002, Phonetic and ontological results after early palate closure in 18 consecutive children presenting with cleft lip and palate. International Journal of Pediatric Otorhinolaryngology, 66(2), 131-137.