{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T22:35:44Z","timestamp":1767911744756,"version":"3.49.0"},"reference-count":28,"publisher":"BMJ","issue":"9","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Occup Environ Med"],"published-print":{"date-parts":[[2007,9]]},"abstract":"<jats:p><jats:bold>Objectives:<\/jats:bold>To evaluate the reliability of an expert team assessing exposure to carcinogens in the offshore petroleum industry and to study how the information provided influenced the agreement among raters.<\/jats:p><jats:p><jats:bold>Methods:<\/jats:bold>Eight experts individually assessed the likelihood of exposure for combinations of 17 carcinogens, 27 job categories and four time periods (1970\u20131979, 1980\u20131989, 1990\u20131999 and 2000\u20132005). Each rater assessed 1836 combinations based on summary documents on carcinogenic agents, which included descriptions of sources of exposure and products, descriptions of work processes carried out within the different job categories, and monitoring data. Inter-rater agreement was calculated using Cohen\u2019s kappa index and single and average score intraclass correlation coefficients (ICC) (ICC<jats:sub>(2,1)<\/jats:sub>and ICC<jats:sub>(2,8)<\/jats:sub>, respectively). Differences in inter-rater agreement for time periods, raters, International Agency for Research on Cancer groups and the amount of information provided were consequently studied.<\/jats:p><jats:p><jats:bold>Results:<\/jats:bold>Overall, 18% of the combinations were denoted as possible exposure, and 14% scored probable exposure. Stratified by the 17 carcinogenic agents, the probable exposure prevalence ranged from 3.8% for refractory ceramic fibres to 30% for crude oil. Overall mean kappa was 0.42 (ICC<jats:sub>(2,1)<\/jats:sub>\u200a=\u200a0.62 and ICC<jats:sub>(2,8)<\/jats:sub>\u200a=\u200a0.93). Providing limited quantitative measurement data was associated with less agreement than for equally well described carcinogens without sampling data.<\/jats:p><jats:p><jats:bold>Conclusion:<\/jats:bold>The overall \u03ba and single-score ICC indicate that the raters agree on exposure estimates well above the chance level. The levels of inter-rater agreement were higher than in other comparable studies. The average score ICC indicates reliable mean estimates and implies that sufficient raters were involved. The raters seemed to have enough documentation on which to base their estimates, but provision of limited monitoring data leads to more incongruence among raters. Having real exposure data, with the inherent variability of such data, apparently makes estimating exposure in a rigid semiquantitative manner more difficult.<\/jats:p>","DOI":"10.1136\/oem.2006.030528","type":"journal-article","created":{"date-parts":[[2007,1,17]],"date-time":"2007-01-17T03:09:29Z","timestamp":1169003369000},"page":"582-588","source":"Crossref","is-referenced-by-count":19,"title":["Inter-rater agreement in the assessment of exposure to carcinogens in the offshore petroleum industry"],"prefix":"10.1136","volume":"64","author":[{"given":"Kjersti","family":"Steinsv\u00e5g","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Magne","family":"Br\u00e5tveit","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bente E","family":"Moen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hans","family":"Kromhout","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"239","published-online":{"date-parts":[[2007,1,16]]},"reference":[{"key":"2024052223290039000_64.9.582.1","doi-asserted-by":"crossref","unstructured":"Teschke K. Exposure surrogates: job-exposure matrices, self-reports, and expert evaluations. In Nieuwenhuijsen MJ, ed. Exposure assessment in occupational and environmental epidemiology. Oxford: Oxford University Press, 2003:118\u201332.","DOI":"10.1093\/acprof:oso\/9780198528616.003.0008"},{"key":"2024052223290039000_64.9.582.2","doi-asserted-by":"publisher","DOI":"10.1136\/oem.59.9.575"},{"key":"2024052223290039000_64.9.582.3","first-page":"424","volume":"5","year":"1989","journal-title":"Scand J Work Environ Health"},{"key":"2024052223290039000_64.9.582.4","doi-asserted-by":"publisher","DOI":"10.1080\/08828032.1989.10389920"},{"key":"2024052223290039000_64.9.582.5","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"2024052223290039000_64.9.582.6","unstructured":"Altman D G. Practical statistics for medical research. New York: Chapman & Hall\/CRC, 1991."},{"key":"2024052223290039000_64.9.582.7","first-page":"667","volume":"43","year":"1986","journal-title":"Br J Ind Med"},{"key":"2024052223290039000_64.9.582.8","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/26.3.635"},{"key":"2024052223290039000_64.9.582.9","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-0274(199703)31:3<280::AID-AJIM3>3.0.CO;2-1"},{"key":"2024052223290039000_64.9.582.10","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/27.2.269"},{"key":"2024052223290039000_64.9.582.11","doi-asserted-by":"publisher","DOI":"10.1093\/annhyg\/46.5.465"},{"key":"2024052223290039000_64.9.582.12","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.86.2.420"},{"key":"2024052223290039000_64.9.582.13","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.1.1.30"},{"key":"2024052223290039000_64.9.582.14","doi-asserted-by":"publisher","DOI":"10.1080\/15298669391354801"},{"key":"2024052223290039000_64.9.582.15","doi-asserted-by":"publisher","DOI":"10.5271\/sjweh.163"},{"key":"2024052223290039000_64.9.582.16","doi-asserted-by":"publisher","DOI":"10.5271\/sjweh.509"},{"key":"2024052223290039000_64.9.582.17","doi-asserted-by":"publisher","DOI":"10.1136\/oem.51.7.461"},{"key":"2024052223290039000_64.9.582.18","first-page":"199","volume":"3","year":"1996","journal-title":"Occup Hyg"},{"key":"2024052223290039000_64.9.582.19","doi-asserted-by":"publisher","DOI":"10.1080\/1047322X.1991.10387862"},{"key":"2024052223290039000_64.9.582.20","unstructured":"Strand L \u00c5, Andersen A. Kartlegging av kreftrisiko og \u00e5rsaksspesifikk d\u00f8delighet blant ansatte i norsk offshorevirksomhet. Innsamling av bakgrunnsdata og etablering av kohort [Survey of cancer risk and cause-specific mortality of Norwegian offshore oil industry workers. Collection of background data and establishment of a cohort]. Oslo: Cancer Registry of Norway, 2001."},{"key":"2024052223290039000_64.9.582.21","doi-asserted-by":"publisher","DOI":"10.1093\/annhyg\/mei049"},{"key":"#cr-split#-2024052223290039000_64.9.582.22.1","doi-asserted-by":"crossref","unstructured":"Steinsv\u00e5g K, Br\u00e5tveit M, Moen B E. Exposure to carcinogens for defined job categories in Norway's offshore petroleum industry, 1970-2005. Occup Environ Med. 2006","DOI":"10.1136\/oem.2006.028225"},{"key":"#cr-split#-2024052223290039000_64.9.582.22.2","unstructured":"doi: 10, 1136\/oem. 2006. 028225."},{"key":"2024052223290039000_64.9.582.23","unstructured":"Fleiss J L. Statistical methods for rates and proportions New York: Wiley, 1981:212\u201336."},{"key":"2024052223290039000_64.9.582.24","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-0274(199611)30:5<616::AID-AJIM10>3.0.CO;2-6"},{"key":"2024052223290039000_64.9.582.25","doi-asserted-by":"publisher","DOI":"10.1093\/annhyg\/37.3.253"},{"key":"2024052223290039000_64.9.582.26","doi-asserted-by":"publisher","DOI":"10.1191\/0962280205sm413oa"},{"key":"2024052223290039000_64.9.582.27","doi-asserted-by":"publisher","DOI":"10.1177\/001316447303300309"}],"container-title":["Occupational and Environmental Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/oem.2006.030528","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T07:51:04Z","timestamp":1716450664000},"score":1,"resource":{"primary":{"URL":"https:\/\/oem.bmj.com\/lookup\/doi\/10.1136\/oem.2006.030528"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,1,16]]},"references-count":28,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2007,8,17]]},"published-print":{"date-parts":[[2007,9]]}},"alternative-id":["10.1136\/oem.2006.030528"],"URL":"https:\/\/doi.org\/10.1136\/oem.2006.030528","relation":{},"ISSN":["1351-0711","1470-7926"],"issn-type":[{"value":"1351-0711","type":"print"},{"value":"1470-7926","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,1,16]]}}}