{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T00:05:29Z","timestamp":1777507529413,"version":"3.51.4"},"reference-count":16,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003491","name":"Herlev Hospital","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003491","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["European J Hybrid Imaging"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Use of <jats:sup>11<\/jats:sup>C-Choline PET\/CT is gaining ground in detecting hyperfunctioning parathyroid glands in primary hyperparathyroidism. The purpose of this study was to evaluate the robustness of <jats:sup>11<\/jats:sup>C-Choline PET\/CT by assessing intra- and inter-observer agreement to determine whether the method was reader sensitive and therefore should only be performed at highly specialised sites with a high number of cases.<\/jats:p>\n                <jats:p>PET\/CT images of 40 patients diagnosed with primary hyperparathyroidism were anonymised and evaluated three times by three readers: an expert reader and two non-experts (non-experts were experienced in PET\/CT imaging, but not in <jats:sup>11<\/jats:sup>C-Choline PET\/CT in the setting of primary hyperparathyroidism). Number of hyperfunctioning parathyroid glands, location relative to the thyroid gland and confidence of each assessment (low, moderate or high) were noted, and intra- and inter-observer agreement calculated using Fleiss\u2019 kappa method. Sensitivities and specificities of the non-experts were calculated using the expert reader as gold standard.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Intra-observer agreement was \u2018good\u2019 to \u2018near perfect\u2019 for all readers. Inter-observer agreement was good between non-experts and the expert, with kappa values \u2265 0.74. Sensitivities between non-experts and the expert were high, &gt; 81%, when assessing which side and 75% when assessing thyroid quadrant. All specificities were &gt; 94%. Reader certainties were \u2018high\u2019 in &gt; 80% of cases for the expert and &gt; 70% and &gt; 65%, respectively for the two non-experts.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p><jats:sup>11<\/jats:sup>C-Choline PET\/CT is not reader sensitive for the localisation of hyperfunctioning parathyroid glands and may therefore be safely implemented at sites that have a moderate number of cases. Access to a cyclotron laboratory is, however, a necessity for the production of <jats:sup>11<\/jats:sup>C-Choline.<\/jats:p>\n                <jats:p>The study was conducted in accordance with the Helsinki 2 declaration and The International Council for Harmonisation Guideline for Good Clinical Practice (ICH_GCP) clinical trial, approved by the Research Ethics Committee of the Capital Region of Denmark (Journal-nr.:H-18012490, date of approval: 18 June 2018) and the Danish Medicines Agency (EudraCT no. 2018-000726-63, date of approval: 6 June 2018). The GCP unit in Eastern Denmark has carried out regular monitoring of the trial according to GCP (ID: 2018-1050).<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s41824-021-00108-z","type":"journal-article","created":{"date-parts":[[2021,7,5]],"date-time":"2021-07-05T23:04:01Z","timestamp":1625526241000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Locating hyperfunctioning parathyroid glands using 11C-Choline PET\/CT: an inter- and intra-observer variation study"],"prefix":"10.1186","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2680-0121","authenticated-orcid":false,"given":"Julie Wulf","family":"Christensen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1846-4498","authenticated-orcid":false,"given":"Lars Thorbj\u00f8rn","family":"Jensen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3390-5637","authenticated-orcid":false,"given":"Susanne Bonnichsen","family":"S\u00f8ndergaard","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9156-4255","authenticated-orcid":false,"given":"Rikke","family":"Broholm","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3786-4737","authenticated-orcid":false,"given":"Christian","family":"Haarmark","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2191-1861","authenticated-orcid":false,"given":"Martin","family":"Krakauer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2301-2878","authenticated-orcid":false,"given":"Finn Noe","family":"Bennedb\u00e6k","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bo","family":"Zerahn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Waldemar","family":"Trolle","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christoffer Holst","family":"Hahn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bent","family":"Kristensen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,7,6]]},"reference":[{"issue":"5","key":"108_CR1","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1080\/10543406.2016.1273941","volume":"27","author":"SI Bangdiwala","year":"2017","unstructured":"Bangdiwala SI (2017) Graphical aids for visualizing and interpreting patterns in departures from agreement in ordinal categorical observer agreement data. J Biopharm Stat 27(5):773\u2013783. https:\/\/doi.org\/10.1080\/10543406.2016.1273941","journal-title":"J Biopharm Stat"},{"issue":"4","key":"108_CR2","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1016\/j.bjoms.2019.03.007","volume":"57","author":"F Borumandi","year":"2019","unstructured":"Borumandi F, Daultrey H, Laji K, Bosman D, Ashford N, Alam P (2019) Detectability and surgical outcomes in parathyroid surgery \u2013 a single-centre experience. Br J Oral Maxillofac Surg 57(4):330\u2013335. https:\/\/doi.org\/10.1016\/j.bjoms.2019.03.007","journal-title":"Br J Oral Maxillofac Surg"},{"issue":"4","key":"108_CR3","doi-asserted-by":"publisher","first-page":"538","DOI":"10.4158\/EP11330.OR","volume":"18","author":"C Dalar","year":"2012","unstructured":"Dalar C, Ozdogan O, Durak M, Ko\u00e7dor MA, Bekis R, Cayvarli H et al (2012) Interobserver and intraobserver agreement in parathyroid scintigraphy: how can parathyroid scintigraphy be made more reliable? Endocr Pract 18(4):538\u2013548. https:\/\/doi.org\/10.4158\/EP11330.OR","journal-title":"Endocr Pract"},{"key":"108_CR4","unstructured":"Danish Endocrine Society: Primary hyperparathyroidism. Available from: https:\/\/endocrinology.dk\/nbv\/calcium-og-knoglemetabolisme\/primaer-hyperparathyreoidisme\/. Accessed 10 Jan 2021. Cited 2020 Nov 27."},{"key":"108_CR5","volume-title":"Irr: Various coefficients of interrater reliability and agreement. R package version 0.84.1","author":"M Gamer","year":"2019","unstructured":"Gamer M, Lemon J, Singh IFP (2019) Irr: Various coefficients of interrater reliability and agreement. R package version 0.84.1"},{"issue":"3","key":"108_CR6","doi-asserted-by":"publisher","first-page":"910","DOI":"10.1148\/radiol.12120509","volume":"265","author":"TSS Genders","year":"2012","unstructured":"Genders TSS, Spronk S, Stijnen T, Steyerberg EW, Lesaffre E, Hunink MGM (2012) Methods for calculating sensitivity and specificity of clustered data: a tutorial. Radiology. 265(3):910\u2013916. https:\/\/doi.org\/10.1148\/radiol.12120509","journal-title":"Radiology."},{"key":"108_CR7","volume-title":"clust.bin.pair: statistical methods for analyzing clustered matched pair data. R Package Version 0.1.2","author":"D Gopstein","year":"2018","unstructured":"Gopstein D. clust.bin.pair: statistical methods for analyzing clustered matched pair data. R Package Version 0.1.2. 2018. Available from: https:\/\/cran.r-project.org\/package=clust.bin.pair. Accessed 20 Oct 2020."},{"key":"108_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/diagnostics10110975","volume":"10","author":"A Ismail","year":"2020","unstructured":"Ismail A, Christensen JW, Krakauer M, S\u00f8ndergaard SB, Zerahn B, Nygaard B et al (2020) 11C-Choline PET\/CT vs. 99m Tc-MIBI\/123 iodide subtraction SPECT\/CT for preoperative detection of abnormal parathyroid glands in primary hyperparathyroidism: a prospective, single-centre clinical trial in 60 patients. Diagnostics. 10:1\u201310","journal-title":"Diagnostics."},{"issue":"1","key":"108_CR9","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics. 33(1):159. https:\/\/doi.org\/10.2307\/2529310","journal-title":"Biometrics."},{"issue":"7","key":"108_CR10","doi-asserted-by":"publisher","first-page":"1084","DOI":"10.2967\/jnumed.107.040428","volume":"48","author":"WC Lavely","year":"2007","unstructured":"Lavely WC, Goetze S, Friedman KP, Leal JP, Zhang Z, Garret-Mayer E, Dackiw AP, Tufano RP, Zeiger MA, Ziessman HA (2007) Comparison of SPECT\/CT, SPECT, and planar imaging with single- and dual-phase 99mTc-sestamibi parathyroid scintigraphy. J Nucl Med 48(7):1084\u20131089. https:\/\/doi.org\/10.2967\/jnumed.107.040428","journal-title":"J Nucl Med"},{"key":"108_CR11","volume-title":"Vcd: visualizing categorical data. R package version 1.4-8","author":"D Meyer","year":"2020","unstructured":"Meyer D, Zeileis A, Hornik K (2020) Vcd: visualizing categorical data. R package version 1.4-8"},{"issue":"1","key":"108_CR12","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1186\/s13550-019-0534-5","volume":"9","author":"ME Noltes","year":"2019","unstructured":"Noltes ME, Kruijff S, Noordzij W, Telenga ED, V\u00e1llez Garc\u00eda D, Trofimiuk-M\u00fcldner M, Opali\u0144ska M, Hubalewska-Dydejczyk A, Luurtsema G, Dierckx RAJO, el Moumni M, Boellaard R, Brouwers AH (2019 Dec 31) Optimization of parathyroid 11C-choline PET protocol for localization of parathyroid adenomas in patients with primary hyperparathyroidism. EJNMMI Res 9(1):73. https:\/\/doi.org\/10.1186\/s13550-019-0534-5","journal-title":"EJNMMI Res"},{"key":"108_CR13","doi-asserted-by":"publisher","first-page":"1495","DOI":"10.1002\/(SICI)1097-0258(19980715)17:13<1495::AID-SIM863>3.0.CO;2-I","volume":"17","author":"NA Obuchowski","year":"1998","unstructured":"Obuchowski NA (1998) On the comparison of correlated proportions for clustered data. Stat Med 17:1495\u20131507","journal-title":"Stat Med"},{"key":"108_CR14","volume-title":"clubSandwich: cluster-robust (sandwich) variance estimators with small-sample corrections. R Package Version 0.4.1","author":"J Pustejovsky","year":"2020","unstructured":"Pustejovsky J. clubSandwich: cluster-robust (sandwich) variance estimators with small-sample corrections. R Package Version 0.4.1. 2020. Available from: https:\/\/cran.r-project.org\/package=clubSandwich. Accessed 20 Oct 2020."},{"issue":"1","key":"108_CR15","doi-asserted-by":"publisher","first-page":"84","DOI":"10.17925\/EE.2014.10.01.84","volume":"10","author":"L Rolighed","year":"2014","unstructured":"Rolighed L, Rejnmark L, Christiansen P (2014) Bone involvement in primary hyperparathyroidism and changes after parathyroidectomy. Eur Endocrinol 10(1):84\u201387. https:\/\/doi.org\/10.17925\/EE.2014.10.01.84","journal-title":"Eur Endocrinol"},{"key":"108_CR16","doi-asserted-by":"publisher","unstructured":"Tunninen V, Varjo P, Schildt J, Ahonen A, Kauppinen T, Lisinen I et al (2013) Comparison of five parathyroid scintigraphic protocols. Int J Mol Imaging 2013:1\u201312. https:\/\/doi.org\/10.1155\/2013\/921260","DOI":"10.1155\/2013\/921260"}],"container-title":["European Journal of Hybrid Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41824-021-00108-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s41824-021-00108-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41824-021-00108-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,5]],"date-time":"2021-07-05T23:05:34Z","timestamp":1625526334000},"score":1,"resource":{"primary":{"URL":"https:\/\/ejhi.springeropen.com\/articles\/10.1186\/s41824-021-00108-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,6]]},"references-count":16,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["108"],"URL":"https:\/\/doi.org\/10.1186\/s41824-021-00108-z","relation":{},"ISSN":["2510-3636"],"issn-type":[{"value":"2510-3636","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,6]]},"assertion":[{"value":"26 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Research Ethics Committee of the Capital Region of Denmark (Journal-no.: H-18012490, date of approval: 18 June 2018) and the Danish Medicines Agency (EudraCT no. 2018-000726-63, date of approval: 6 June 2018). All patients received oral and written information and signed a written consent.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"13"}}