{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T04:17:35Z","timestamp":1777522655559,"version":"3.51.4"},"reference-count":43,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2015,6,9]],"date-time":"2015-06-09T00:00:00Z","timestamp":1433808000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"},{"start":{"date-parts":[[2015,6,22]],"date-time":"2015-06-22T00:00:00Z","timestamp":1434931200000},"content-version":"vor","delay-in-days":13,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100003406","name":"Tekes","doi-asserted-by":"publisher","award":["40255\/11"],"award-info":[{"award-number":["40255\/11"]}],"id":[{"id":"10.13039\/501100003406","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["setac.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2015,6,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>\u2003<\/jats:title><jats:p>The incidence of morphological deformities of chironomid larvae as an indicator of sediment toxicity has been studied for decades. However, standards for deformity analysis are lacking. The authors evaluated whether 25 experts diagnosed larval deformities in a similar manner. Based on high-quality digital images, the experts rated 211 menta of Chironomus spp. larvae as normal or deformed. The larvae were from a site with polluted sediments or from a reference site. The authors revealed this to a random half of the experts, and the rest conducted the assessment blind. The authors quantified the interrater agreement by kappa coefficient, tested whether open and blind assessments differed in deformity incidence and in differentiation between the sites, and identified those deformity types rated most consistently or inconsistently. The total deformity incidence varied greatly, from 10.9% to 66.4% among experts. Kappa coefficient across rater pairs averaged 0.52, indicating insufficient agreement. The deformity types rated most consistently were those missing teeth or with extra teeth. The open and blind assessments did not differ, but differentiation between sites was clearest for raters who counted primarily absolute deformities such as missing and extra teeth and excluded apparent mechanical aberrations or deviations in tooth size or symmetry. The highly differing criteria in deformity assignment have likely led to inconsistent results in midge larval deformity studies and indicate an urgent need for standardization of the analysis. Environ Toxicol Chem 2015;34:1891\u20131898. \u00a9 2015 SETAC<\/jats:p><\/jats:sec>","DOI":"10.1002\/etc.3010","type":"journal-article","created":{"date-parts":[[2015,6,10]],"date-time":"2015-06-10T13:56:26Z","timestamp":1433944586000},"page":"1891-1898","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Inconsistency in the analysis of morphological deformities in chironomidae (Insecta: Diptera) larvae"],"prefix":"10.1093","volume":"34","author":[{"given":"Johanna","family":"Salmelin","sequence":"first","affiliation":[{"name":"Department of Biological and Environmental ScienceUniversity of Jyv\u00e4skyla\u00e4 Jyv\u00e4skyl\u00e4 Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kari-Matti","family":"Vuori","sequence":"additional","affiliation":[{"name":"South Karelia InstituteLappeenranta University of Technology Lappeenranta Finland"},{"name":"Laboratory Centre\/Ecotoxicology and Risk AssessmentFinnish Environment Institute Jyv\u00e4skyl\u00e4 Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Heikki","family":"H\u00e4m\u00e4l\u00e4inen","sequence":"additional","affiliation":[{"name":"Department of Biological and Environmental ScienceUniversity of Jyv\u00e4skyla\u00e4 Jyv\u00e4skyl\u00e4 Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2015,6,9]]},"reference":[{"key":"2025010316044364900_etc3010-bib-0001","first-page":"1","volume-title":"Biological Indicators of Aquatic Ecosystem Stress","author":"Adams","year":"2002"},{"key":"2025010316044364900_etc3010-bib-0002","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1002\/etc.5620150733","article-title":"Validation of a short-term toxicity test endpoint by comparison with longer-term effects on larval red abalone Haliotis rufescens","volume":"15","author":"Conroy","year":"1996","journal-title":"Environ Toxicol Chem"},{"key":"2025010316044364900_etc3010-bib-0003","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1002\/etc.5620180317","article-title":"Sensitivity of fish embryos to weathered crude oil: Part I. Low-level exposure during incubations causes malformations, genetic damage, and mortality in larval Pacific herring (Clupea pallasii)","volume":"18","author":"Carls","year":"1999","journal-title":"Environ Toxicol Chem"},{"key":"2025010316044364900_etc3010-bib-0004","volume-title":"Chironomidae of the Holarctic Region: Keys and Diagnosis","author":"Wiederholm","year":"1983"},{"key":"2025010316044364900_etc3010-bib-0005","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1111\/j.1365-2427.1987.tb01073.x","article-title":"Seasonal variation in diet of Chironomus plumosus (L.) and C. anthracinus Zett. (Diptera: Chironomidae) in mesotrophic Lake Erken","volume":"17","author":"Johnson","year":"1987","journal-title":"Freshw Biol"},{"key":"2025010316044364900_etc3010-bib-0006","first-page":"281","volume-title":"Toxic Contaminants and Ecosystem Health: A Great Lakes Focus","author":"Warwick","year":"1988"},{"key":"2025010316044364900_etc3010-bib-0007","first-page":"265","article-title":"Elaborating chironomid deformities as bioindicators of toxic sediment stress: The potential application of mixture toxicity concepts","volume":"32","author":"Vermeulen","year":"1995","journal-title":"Ann Zool Fennici"},{"key":"2025010316044364900_etc3010-bib-0008","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1139\/f88-136","article-title":"Morphological deformities in Chironomus, Cryptochironomus, and Procladius larvae (Diptera: Chironomidae) from two differentially stressed sites in Tobin Lake, Saskatchewan","volume":"45","author":"Warwick","year":"1988","journal-title":"Can J Fish Aquat Sci"},{"key":"2025010316044364900_etc3010-bib-0009","doi-asserted-by":"crossref","first-page":"1237","DOI":"10.4039\/Ent1031237-9","article-title":"Notes on general morphology and terminology of the Chironomidae (Diptera)","volume":"103","author":"S\u00e6ther","year":"1971","journal-title":"Can Entomol"},{"key":"2025010316044364900_etc3010-bib-0010","doi-asserted-by":"crossref","first-page":"363","DOI":"10.4039\/Ent103363-3","article-title":"The occurrence of characteristic deformities in the chironomid larvae of several Canadian lakes","volume":"103","author":"Hamilton","year":"1971","journal-title":"Can Entomol"},{"key":"2025010316044364900_etc3010-bib-0011","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1023\/A:1025528605002","article-title":"Chironomid responses to long-term metal contamination: A paleolimnological study in two bays of Lake Imandra, Kola Peninsula, northern Russia","volume":"30","author":"Ilyashuk","year":"2003","journal-title":"J Paleolimnol"},{"key":"2025010316044364900_etc3010-bib-0012","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1007\/s00244-005-0308-0","article-title":"Morphologic and growth responses in Chironomus tentans to arsenic exposure","volume":"51","author":"Martinez","year":"2006","journal-title":"Arch Environ Contam Toxicol"},{"key":"2025010316044364900_etc3010-bib-0013","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.envpol.2012.03.029","article-title":"Induction of mouthpart deformities in chironomid larvae exposed to contaminated sediments","volume":"166","author":"Di Veroli","year":"2012","journal-title":"Environ Pollut"},{"key":"2025010316044364900_etc3010-bib-0014","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0269-7491(00)00068-3","article-title":"Induction of mouthpart deformities in Chironomus riparius larvae exposed to 4-n-nonylphenol","volume":"111","author":"Meregalli","year":"2001","journal-title":"Environ Pollut"},{"key":"2025010316044364900_etc3010-bib-0015","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1139\/f95-199","article-title":"Spatial and taxonomic variation in incidence of mouthpart deformities in midge larvae (Diptera: Chironomidae: Chironomini)","volume":"53","author":"Hudson","year":"1996","journal-title":"Can J Aquat Sci"},{"key":"2025010316044364900_etc3010-bib-0016","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1002\/tox.21893","article-title":"Transcriptional responses, metabolic activity and mouthpart deformities in natural populations of Chironomus riparius larvae exposed to environmental pollutants","volume":"30","author":"Planell\u00f3","year":"2015","journal-title":"Environ Toxicol"},{"key":"2025010316044364900_etc3010-bib-0017","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1007\/s11368-010-0195-5","article-title":"Can mouth part deformities of Chironomus riparius serve as indicators for water and sediment pollution? A laboratory approach","volume":"10","author":"Langer-Jaesrich","year":"2010","journal-title":"J Soil Sediment"},{"key":"2025010316044364900_etc3010-bib-0018","doi-asserted-by":"crossref","first-page":"2558","DOI":"10.1002\/etc.2336","article-title":"Biochemical and morphological responses in Chironomus riparius (Diptera: Chironomidae) larvae exposed to lead-spiked sediment","volume":"32","author":"Arambourou","year":"2013","journal-title":"Environ Toxicol Chem"},{"key":"2025010316044364900_etc3010-bib-0019","first-page":"275","article-title":"Some observations of buccal deformities in chironomid larvae (Diptera: Chironomidae) from the Ci\u00e9naga Grande de Santa Marta, Colombia","volume":"26","author":"Nazarova","year":"2004","journal-title":"Caldasia"},{"key":"2025010316044364900_etc3010-bib-0020","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1016\/j.chemosphere.2007.09.029","article-title":"Exposure of Chironomus riparius larvae to uranium: Effects on survival, development time, growth, and mouthpart deformities","volume":"71","author":"Dias","year":"2008","journal-title":"Chemosphere"},{"key":"2025010316044364900_etc3010-bib-0021","doi-asserted-by":"crossref","first-page":"135","DOI":"10.2989\/AJAS.2008.33.2.4.501","article-title":"Mouthpart deformities in Chironomidae (Diptera) as indicators of heavy metal pollution in northern Lake Victoria, Uganda","volume":"33","author":"Ochieng","year":"2008","journal-title":"African Journal of Aquatic Science"},{"key":"2025010316044364900_etc3010-bib-0022","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1603\/EN09109","article-title":"Morphological deformities in Chironomus spp. (Diptera: Chironomidae) larvae as a tool for impact assessment of antropogenic and environmental stresses on three rivers in the Jury River System, Penang, Malaysia","volume":"39","author":"Al-Shami","year":"2010","journal-title":"Environ Entomol"},{"key":"2025010316044364900_etc3010-bib-0023","doi-asserted-by":"crossref","first-page":"995","DOI":"10.1590\/S1519-69842010000500011","article-title":"Diversity of larvae of littoral Chironomidae (Diptera: Insecta) and their role as bioindicators in urban reservoirs of different trophic levels","volume":"70","author":"Morais","year":"2010","journal-title":"Brazilian Journal of Biology"},{"key":"2025010316044364900_etc3010-bib-0024","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.agee.2013.05.020","article-title":"Removal of intensive agriculture from the landscape improves aquatic ecosystem health","volume":"176","author":"Gagliardi","year":"2013","journal-title":"Agricult Ecosys Environ"},{"key":"2025010316044364900_etc3010-bib-0025","first-page":"44","article-title":"Deformities of Chironomus sp. larvae (Diptera: Chironomidae) as indicator of pollution stress in rice fields of Hooghly District, West Bengal","volume":"2","author":"Saha","year":"2013","journal-title":"Journal of Today's Biological Sciences"},{"key":"2025010316044364900_etc3010-bib-0026","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/S0380-1330(92)71312-4","article-title":"Evidence of teratogens in sediments of the Niagara River watershed as reflected by chironomid (Diptera, Chironomidae) deformities","volume":"18","author":"Dickman","year":"1992","journal-title":"J Great Lakes Res"},{"key":"2025010316044364900_etc3010-bib-0027","first-page":"63","volume-title":"Chironomids: From Genes to Ecosystems","author":"Janssens de Bisthoven","year":"1995"},{"key":"2025010316044364900_etc3010-bib-0028","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1037\/0033-2909.104.3.405","article-title":"Validity inferences from interobserver agreement","volume":"104","author":"Uebersax","year":"1988","journal-title":"Psychol Bull"},{"key":"2025010316044364900_etc3010-bib-0029","first-page":"411","article-title":"Reliability in content analysis: Some common misconceptions and recommendations","volume":"30","author":"Krippendorff","year":"2004","journal-title":"Hum Commun Res"},{"key":"2025010316044364900_etc3010-bib-0030","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1007\/s00401-012-1002-8","article-title":"Consensus classification of human prion disease histotypes allows reliable identification of molecular subtypes: An inter-rater study among surveillance centres in Europe and USA","volume":"124","author":"Parchi","year":"2012","journal-title":"Acta Neuropathol"},{"key":"2025010316044364900_etc3010-bib-0031","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/s002449900287","article-title":"Biomarker responses in whitefish (Coregonus lavaretus L. s.l.) experimentally exposed in a large lake receiving effluents from pulp and paper industry","volume":"34","author":"Soimasuo","year":"1988","journal-title":"Arch Environ Contam Toxicol"},{"key":"2025010316044364900_etc3010-bib-0032","first-page":"179","article-title":"Critical appraisal of the indexes of chironomid larval deformities and their use in bioindication","volume":"36","author":"H\u00e4m\u00e4l\u00e4inen","year":"1999","journal-title":"Ann Zool Fennici"},{"key":"2025010316044364900_etc3010-bib-0033","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ Psychol Meas."},{"key":"2025010316044364900_etc3010-bib-0034","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1037\/h0031643","article-title":"Measures of response agreement for qualitative data: Some generalizations and alternatives","volume":"76","author":"Light","year":"1971","journal-title":"Psychol Bull"},{"key":"2025010316044364900_etc3010-bib-0035","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"2025010316044364900_etc3010-bib-0036","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.pec.2011.01.004","article-title":"When coders are reliable: The application of three measures to assess inter-rater reliability\/agreement with doctor-patient communication data coded with the VR-CoDES","volume":"82","author":"Fletcher","year":"2011","journal-title":"Patient Educ Couns"},{"key":"2025010316044364900_etc3010-bib-0037","author":"Fleiss","year":"2003"},{"key":"2025010316044364900_etc3010-bib-0038","first-page":"89","volume-title":"Chironomids: From Genes to Ecosystems","author":"Madden","year":"1995"},{"key":"2025010316044364900_etc3010-bib-0039","volume-title":"Practical Statistics for Medical Research","author":"Altman","year":"1991"},{"key":"2025010316044364900_etc3010-bib-0040","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1177\/0962280210394168","article-title":"Assessing and quantifying inter-rater variation for dichotomous ratings using a Rasch model","volume":"21","author":"Petersen","year":"2010","journal-title":"Stat Methods Med Res"},{"key":"2025010316044364900_etc3010-bib-0041","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.2307\/1130165","article-title":"Overt versus covert assessment of observer reliability","volume":"55","author":"Weinrott","year":"1984","journal-title":"Child Dev"},{"key":"2025010316044364900_etc3010-bib-0042","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1289\/ehp.1206389","article-title":"Instruments for assessing risk of bias and other methodological criteria of published animal studies: A systematic review","volume":"121","author":"Krauth","year":"2013","journal-title":"Environ Health Perspect"},{"key":"2025010316044364900_etc3010-bib-0043","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0197-2456(95)00134-4","article-title":"Assessing the quality of reports of randomized clinical trials: Is blinding necessary?","volume":"17","author":"Jadad","year":"1996","journal-title":"Control Clin Trials"}],"container-title":["Environmental Toxicology and Chemistry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fetc.3010","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/etc.3010","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/etc.3010","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/etc\/article-pdf\/34\/8\/1891\/60111454\/etc3010.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/etc\/article-pdf\/34\/8\/1891\/60111454\/etc3010.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,28]],"date-time":"2025-05-28T12:43:08Z","timestamp":1748436188000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/etc\/article\/34\/8\/1891\/7761834"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,6,9]]},"references-count":43,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2015,6,9]]},"published-print":{"date-parts":[[2015,6,9]]}},"URL":"https:\/\/doi.org\/10.1002\/etc.3010","relation":{},"ISSN":["0730-7268","1552-8618"],"issn-type":[{"value":"0730-7268","type":"print"},{"value":"1552-8618","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2015,8,1]]},"published":{"date-parts":[[2015,6,9]]},"assertion":[{"value":"2014-10-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-04-03","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-06-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}