{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T20:51:55Z","timestamp":1787950315999,"version":"build-2784847793"},"reference-count":57,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2024,6,8]],"date-time":"2024-06-08T00:00:00Z","timestamp":1717804800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Intl J Lang &amp; Comm Disor"],"published-print":{"date-parts":[[2024,9]]},"abstract":"Abstract<\/jats:title>Background<\/jats:title>Speech and language therapists (SLTs) regularly use phonetic transcription to record and analyse typical and disordered speech. Phonetic transcription is highly demanding of auditory perceptual skills so researchers are sceptical about its accuracy and reliability. The literature describes how phonetic transcription is prone to auditory illusions and biases, such as a preference to transcribe speech sounds from the transcriber's own language. Few empirical research studies have calculated agreement amongst transcribers where a range of agreement scores have been reported (51%\u201397%). There is a consensus that agreement rates decrease as phonetic detail increases. Vowels and consonants are characterised by different perceptual features within the International Phonetic Alphabet (IPA) so they may differ in agreement rates, and thus far there is contradictory evidence as to whether vowels or consonants are more agreed upon. Transcription agreement studies to date have most commonly recruited phoneticians rather than SLTs so further research is warranted to determine transcription agreement amongst SLTs and its impact on clinical practice.<\/jats:p><\/jats:sec>Aims<\/jats:title>The study's primary aim was to calculate agreement scores from a group of English\u2010speaking SLTs who transcribed disordered speech samples in an ecologically valid setting. The study also sought to contribute to the pre\u2010existing contradictory evidence base regarding whether vowels or consonants may be more agreed upon by comparing their agreement scores. The researcher aimed to comment on SLTs\u2019 use of diacritics and non\u2010native speech symbols (symbols not included in the English phonetic inventory) in terms of their frequency and agreement of use. By analysing transcriptions, the study aimed to discuss the impact transcription variability has on speech sound error patterns and thus its impact on clinical decision\u2010making such as diagnosis, choice of intervention and therapy targets.<\/jats:p><\/jats:sec>Methods<\/jats:title>Twelve paediatric SLTs were recruited via a convenience sample at two National Health Service trusts, two of whom were specialists in Speech Sound Disorders (SSDs). Participants transcribed 16 words from a video of a boy with disordered speech completing the Diagnostic Evaluation of Articulation and Phonology (DEAP, Dodd et\u00a0al., 2006) from a telehealth appointment. The use of diacritics and non\u2010English IPA symbols were manually analysed. A classic agreement score was calculated for each target word using a Python script, and then for vowels and consonants in isolation. Datasets were manually analysed to determine whether differences in transcription resulted in the identification of different speech sound error patterns. The researcher considered the implications this had within clinical practice.<\/jats:p><\/jats:sec>Results<\/jats:title>The average classic agreement score was 56.3%. Consonants were more agreed upon than vowels with agreement scores of 62.8% and 48.6%, respectively. Nine participants (75%) used diacritics (most commonly length marks) and eight participants (67%) transcribed non\u2010native IPA symbols at least once in their datasets, but generally with low frequencies and agreements amongst their use. Transcriptions captured the occurrence of typical and atypical error patterns but only three error patterns, out of the 20 identified, were present in all 12 participants\u2019 transcriptions.<\/jats:p><\/jats:sec>Conclusions<\/jats:title>The agreement score of 56.3% questions the accuracy and reliability of transcription amongst SLTs which is an essential skill of the profession. The findings highlight SLTs should be more cautious of interpreting vowels than consonants given lower agreement rates. The frequency of use of non\u2010native symbols and diacritics was relatively low which could reflect a low accuracy of their use or reduced confidence in transcribing these. The study discussed how variations in transcriptions can impact phonological and phonetic analysis, which in turn can influence clinical decision\u2010making such as diagnosing SSDs, selecting further diagnostic assessments and choosing therapy targets and interventions. The Royal College of Speech and Language Therapists\u2010endorsed transcription guidelines (Child Speech Disorder Research Network, 2017) could be revised to convey realistic expectations of SLTs\u2019 transcription skills, or SLTs should be offered more training to improve transcription skills to meet current expectations. Other suggestions to improve transcription accuracy are discussed such as via instrumental methods, yet these come with their own limitations such as practicality, costs and need for specialist training.<\/jats:p><\/jats:sec>WHAT THIS PAPER ADDS<\/jats:title>What is already known on this subject<\/jats:title>\nPhonetic transcription is highly demanding of human perceptual skills, and researchers are sceptical about its reliability. There are few empirical research studies calculating agreement amongst transcribers, and a range of agreement scores have been reported (51%\u221297%) dependent on the research conditions. Research mostly involves experienced transcribers (e.g., phoneticians) rather than speech and language therapists (SLTs), a profession expected to regularly use phonetic transcription to record and analyse typical and disordered speech.<\/jats:p><\/jats:list-item><\/jats:list><\/jats:p><\/jats:sec>What this study adds to existing knowledge<\/jats:title>\nA range of transcription agreement scores have been reported in previous studies, mainly comparing pairs or small groups of specialist transcribers rather than SLTs. This study provides an agreement score of 56.3% when a group of 12 SLTs transcribed a disordered speech sample in an ecologically valid setting (where speech samples were taken from a real\u2010life speech sound assessment over a telehealth appointment using the Diagnostic Evaluation of Articulation and Phonology). The study found consonants are more agreed upon than vowels, adding to the contradictory evidence base. Unlike other studies, the researcher analysed transcriptions to identify error patterns to examine the impact that transcription variation has on clinical decision\u2010making.<\/jats:p><\/jats:list-item><\/jats:list><\/jats:p><\/jats:sec>What are the potential or actual clinical implications of this work?<\/jats:title>\nThe researcher questions whether SLTs are meeting the expectations of \u2018accurate transcription\u2019 as listed by the Royal College of Speech and Language Therapists (RCSLT) endorsed transcription guidelines (Child Speech Disorder Research Network, 2017) given the relatively low agreement score of 56.3%. The study also questions the reliability of the use of diacritics and non\u2010English International Phonetic Alphabet (IPA) symbols and whether SLTs should be expected to use these due to perceptual limitations. Twenty phonological processes emerged from the datasets, only three of which were agreed upon across all 12 participants. The researcher therefore discusses how transcription variations could result in different diagnoses, therapy targets and interventions choices. The paper suggests more training is required to enhance transcription accuracy, and also considers the appropriateness of utilising instrumental methods whilst recognising its limitations such as feasibility, costs and specialist training needs.<\/jats:p><\/jats:list-item><\/jats:list><\/jats:p><\/jats:sec><\/jats:sec>","DOI":"10.1111\/1460-6984.13043","type":"journal-article","created":{"date-parts":[[2024,6,8]],"date-time":"2024-06-08T10:47:52Z","timestamp":1717843672000},"page":"1981-1995","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["The agreement of phonetic transcriptions between paediatric speech and language therapists transcribing a disordered speech sample"],"prefix":"10.1111","volume":"59","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8691-0897","authenticated-orcid":false,"given":"Laura Jane","family":"Mallaband","sequence":"first","affiliation":[{"name":"School of Health Sciences Birmingham City University Birmingham UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,6,8]]},"reference":[{"key":"e_1_2_8_2_1","unstructured":"American Speech\u2010Language\u2010Hearing Association. (2023)Childhood Apraxia of Speech. [online] Available from:https:\/\/www.asha.org\/practice\u2010portal\/clinical\u2010topics\/childhood\u2010apraxia\u2010of\u2010speech\/#collapse_2[Accessed 24 November 2023]."},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.3109\/13682828509012268"},{"key":"e_1_2_8_4_1","doi-asserted-by":"crossref","unstructured":"Awan S.N. Shaikh M.A. Awan J.A. Abdalla I. Lim K.O.&Misono S.(2023)Smartphone recordings are comparable to \u201cgold standard\u201d recordings for acoustic measurements of voice.Journal of voice.","DOI":"10.1016\/j.jvoice.2023.01.031"},{"key":"e_1_2_8_5_1","first-page":"14","article-title":"Phonological analysis summary and management plan","volume":"6","author":"Baker E.","year":"2004","journal-title":"Acquiring Knowledge in Speech, Language and Hearing"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/14015430902913535"},{"key":"e_1_2_8_7_1","unstructured":"Bates S..&Titterington J.andMembers Of Uk & Ireland's Child Speech Disorder Research Network. (2019)Good Practice Guidelines for the Analysis of Child Speech. [online] Available from:https:\/\/cpb\u2010eu\u2010w2.wpmucdn.com\/sites.marjon.ac.uk\/dist\/a\/2098\/files\/2019\/06\/Guidelines\u2010for\u2010Analysis\u2010of\u2010Child\u2010Speech\u2010Data\u2010RCSLT\u2010v7\u2010FINAL\u2010150419\u20101.pdf[Accessed 15 November 2022]."},{"key":"e_1_2_8_8_1","unstructured":"Bird S. Loper E.&Klein E.(2009)Natural Language Processing with Python (O'Reilly Media Inc)."},{"key":"e_1_2_8_9_1","unstructured":"Bloch B.&Trager G.L.(1942)Outline of linguistic analysis (Special Publications of the Linguistic Society of America)."},{"key":"e_1_2_8_10_1","unstructured":"Bowen C.(2015)Five levels of speech function with examples of difficulties that might occur at each level. Available fromhttps:\/\/www.speech\u2010language\u2010therapy.com\/images\/umbrella2015.pngon[Accessed 16 May 2023]."},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699208708985007"},{"key":"e_1_2_8_12_1","unstructured":"Child Speech Disorder Research Network. (2017)Good Practice Guidelines for transcription of Children's Speech Samples in Clinical Practice and Research. [online] Available from:https:\/\/www.rcslt.org\/wp\u2010content\/uploads\/media\/docs\/clinical\u2010guidance\/bsltru\u2010good\u2010practice\u2010guidelines\u2010transcription.pdf[Accessed 16 February 2022]."},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780429320903-29"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699209608985167"},{"key":"e_1_2_8_15_1","volume-title":"Differential diagnosis and treatment of children with speech disorder","author":"Dodd B.","year":"2013"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40474-014-0017-3"},{"key":"e_1_2_8_17_1","unstructured":"Dodd B. Zhu H. Crosbie S. Holm A.&Ozanne A.(2006)Diagnostic Evaluation of Articulation and Phonology (DEAP). [online] Available from:https:\/\/www.researchgate.net\/publication\/43509881_Diagnostic_Evaluation_of_Articulation_and_Phonology_DEAP[Accessed 18 October 2023]."},{"key":"e_1_2_8_18_1","unstructured":"Ebrahimi P.(2020)On Phonetics and Phonology: A Broad\u2010Termed Comparison and Contrast between Broad and Narrow Transcription. [Online] Available from:https:\/\/files.eric.ed.gov\/fulltext\/ED510914.pdf[Accessed 20 April 2024]."},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699200410001663362"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1597\/1545-1569_2001_038_0059_roltoc_2.0.co_2"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0025100302001020"},{"key":"e_1_2_8_22_1","volume-title":"Clinical phonology","author":"Grunwell P.","year":"1987"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.3726\/978-3-653-04390-7"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3002.171"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.3109\/13682829609031326"},{"key":"e_1_2_8_26_1","unstructured":"Health and Care Professions Council. (2014)Standards of Proficiency\u2014Speech and Language Therapists. [online] Available from:https:\/\/www.hcpc\u2010uk.org\/globalassets\/resources\/standards\/standards\u2010of\u2010proficiency\u2014speech\u2010and\u2010language\u2010therapists.pdf?v=637018072470000000[Accessed 16 February 2022]."},{"key":"e_1_2_8_27_1","first-page":"381","article-title":"Clinical Phonetic Transcription","author":"Heselwood B.","year":"2009","journal-title":"The handbook of clinical linguistics"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699200210135893"},{"key":"e_1_2_8_29_1","unstructured":"International Association of Communication Sciences and Disorders. (2021)Frequently Asked Questions by Speech\u2010Language Therapists on Cleft Palate +\/\u2010 Lip Evidence\u2010Based Answers 2. [online] Available from:https:\/\/www.iaslt.ie\/media\/e4hddmob\/faq_mar2021_finalmar2021.pdf[Accessed 15 April 2024]."},{"key":"e_1_2_8_30_1","unstructured":"International Phonetic Association. (2015a)Full IPA Chart. [online] Available from:https:\/\/www.internationalphoneticassociation.org\/content\/ipa\u2010chart[Accessed 15 April 2024]."},{"key":"e_1_2_8_31_1","unstructured":"International Phonetic Association. (2015b)extIPA Symbols for Disordered Speech. [online] Available from:https:\/\/www.internationalphoneticassociation.org\/content\/ipa\u2010char[Accessed 15 April 2024]."},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360.0503.07"},{"key":"e_1_2_8_33_1","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12381"},{"key":"e_1_2_8_34_1","volume-title":"STAR teaching: a speech therapy animation and imaging resource","author":"Lawson E.","year":"2023"},{"key":"e_1_2_8_35_1","volume-title":"Seeing speech: an articulatory resource for the study of Phonetics","author":"Lawson E.","year":"2018"},{"key":"e_1_2_8_36_1","first-page":"1","article-title":"EPG research and therapy: further developments","author":"Lee A.","year":"2022","journal-title":"Clinical Linguistics & Phonetics"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.399706"},{"key":"e_1_2_8_38_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699200903532524"},{"key":"e_1_2_8_39_1","first-page":"11","article-title":"The Glottal Stop in SED","volume":"3","author":"Payne K.","year":"2013","journal-title":"The Journal of the Centre for English Traditional Heritage"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2004.09.001"},{"key":"e_1_2_8_41_1","unstructured":"Pullum G.K.&Ladusaw W.A.(1986)Phonetic Guide.Chicago:University of Chicago Press."},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0305000900012034"},{"key":"e_1_2_8_43_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699200701547869"},{"key":"e_1_2_8_44_1","volume-title":"Phonetics: Transcription, production, acoustics, and perception","author":"Reetz H.","year":"2020"},{"key":"e_1_2_8_45_1","unstructured":"Royal College of Speech and Language Therapists. (2011)RCSLT Policy Statement. Developmental Verbal Dyspraxia. [online] Available from:https:\/\/www.ndp3.org\/documents\/rcslt2011dvdPolicyStatement.pdf[Accessed 24 October 2022]."},{"key":"e_1_2_8_46_1","unstructured":"Royal College of Speech and Language Therapists. (2023a)Speech Sound Disorders\u2014Guidance. [online] Available from:https:\/\/www.rcslt.org\/members\/clinical\u2010guidance\/speech\u2010sound\u2010disorders\/speech\u2010sound\u2010disorders\u2010guidance\/#section\u20105[Accessed 14 May 2023]."},{"key":"e_1_2_8_47_1","unstructured":"Royal College of Speech and Language Therapists. (2023b)Speech and Language Therapy. [online] Available from:https:\/\/www.rcslt.org\/speech\u2010and\u2010language\u2010therapy\/#:~:text=Speech%20and%20language%20therapists%20(SLTs in%20a%20variety%20of%20settings)[Accessed 14 May 2023]."},{"key":"e_1_2_8_48_1","doi-asserted-by":"publisher","DOI":"10.1159\/000502324"},{"key":"e_1_2_8_49_1","doi-asserted-by":"publisher","DOI":"10.1080\/13682820400016522"},{"key":"e_1_2_8_50_1","first-page":"372","volume-title":"Clinical Phonetics","author":"Shriberg L.D.","year":"2002"},{"key":"e_1_2_8_51_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699209108986113"},{"key":"e_1_2_8_52_1","doi-asserted-by":"publisher","DOI":"10.1097\/00011363-200121040-00004"},{"key":"e_1_2_8_53_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699206.2021.1966101"},{"key":"e_1_2_8_54_1","unstructured":"Taylor O.(2018)Speech and language screening for children with medical complexity: A comparison of telepractice and in\u2010person methods. [online] Available from:https:\/\/franklinsusanibar.com\/wp\u2010content\/uploads\/2020\/09\/2017\u2010Taylor\u2010Speech\u2010and\u2010language\u2010screening\u2010for\u2010children\u2010with\u2010medical\u2010complexity.pdf[Accessed 15 November 2022]."},{"key":"e_1_2_8_55_1","doi-asserted-by":"publisher","DOI":"10.1258\/135763306779380048"},{"key":"e_1_2_8_56_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511611759"},{"key":"e_1_2_8_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12740"},{"key":"e_1_2_8_58_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360.0904.282"}],"container-title":["International Journal of Language & Communication Disorders"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/1460-6984.13043","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T10:07:07Z","timestamp":1732097227000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1460-6984.13043"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,8]]},"references-count":57,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,9]]}},"alternative-id":["10.1111\/1460-6984.13043"],"URL":"https:\/\/doi.org\/10.1111\/1460-6984.13043","archive":["Portico"],"relation":{},"ISSN":["1368-2822","1460-6984"],"issn-type":[{"value":"1368-2822","type":"print"},{"value":"1460-6984","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,8]]},"assertion":[{"value":"2023-06-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-02","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}