{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T13:24:57Z","timestamp":1740144297218,"version":"3.37.3"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2024,6,8]],"date-time":"2024-06-08T00:00:00Z","timestamp":1717804800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,8]],"date-time":"2024-06-08T00:00:00Z","timestamp":1717804800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"i3 initiative Hamburg University of Technology"},{"name":"Interdisciplinary Graduate School University Medical Center Hamburg-Eppendorf"},{"name":"Zentrales Innovationsprogramm Mittelstand, Arbeitsgemeinschaft industrieller Forschungsvereinigungen","award":["K5208101KS0"],"award-info":[{"award-number":["K5208101KS0"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Paranasal anomalies, frequently identified in routine radiological screenings, exhibit diverse morphological characteristics. Due to the diversity of anomalies, supervised learning methods require large labelled dataset exhibiting diverse anomaly morphology. Self-supervised learning (SSL) can be used to learn representations from unlabelled data. However, there are no SSL methods designed for the downstream task of classifying paranasal anomalies in the maxillary sinus (MS).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Our approach uses a 3D convolutional autoencoder (CAE) trained in an unsupervised anomaly detection (UAD) framework. Initially, we train the 3D CAE to reduce reconstruction errors when reconstructing normal maxillary sinus (MS) image. Then, this CAE is applied to an unlabelled dataset to generate coarse anomaly locations by creating residual MS images. Following this, a 3D convolutional neural network (CNN) reconstructs these residual images, which forms our SSL task. Lastly, we fine-tune the encoder part of the 3D CNN on a labelled dataset of normal and anomalous MS images.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The proposed SSL technique exhibits superior performance compared to existing generic self-supervised methods, especially in scenarios with limited annotated data. When trained on just 10% of the annotated dataset, our method achieves an area under the precision-recall curve (AUPRC) of 0.79 for the downstream classification task. This performance surpasses other methods, with BYOL attaining an AUPRC of 0.75, SimSiam at 0.74, SimCLR at 0.73 and masked autoencoding using SparK at 0.75.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>A self-supervised learning approach that inherently focuses on localizing paranasal anomalies proves to be advantageous, particularly when the subsequent task involves differentiating normal from anomalous maxillary sinuses. Access our code at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/mtec-tuhh\/self-supervised-paranasal-anomaly\">https:\/\/github.com\/mtec-tuhh\/self-supervised-paranasal-anomaly<\/jats:ext-link>.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03172-5","type":"journal-article","created":{"date-parts":[[2024,6,8]],"date-time":"2024-06-08T09:02:07Z","timestamp":1717837327000},"page":"1713-1721","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Self-supervised learning for classifying paranasal anomalies in the maxillary sinus"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8552-2227","authenticated-orcid":false,"given":"Debayan","family":"Bhattacharya","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Finn","family":"Behrendt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin Tobias","family":"Becker","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lennart","family":"Maack","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dirk","family":"Beyersdorff","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elina","family":"Petersen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marvin","family":"Petersen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bastian","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dennis","family":"Eggert","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Betz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna Sophie","family":"Hoffmann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"Schlaefer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,6,8]]},"reference":[{"key":"3172_CR1","unstructured":"Marieb EN (1991) Essentials of Human Anatomy & Physiology. Third edition. Redwood City, Calif., Benjamin\/Cummings Pub. Co., 1991. https:\/\/search.library.wisc.edu\/catalog\/9910059601802121"},{"issue":"4","key":"3172_CR2","first-page":"379","volume":"18","author":"M Bal","year":"2014","unstructured":"Bal M, Berkiten G, Uyan\u0131k E (2014) Mucous retention cysts of the paranasal sinuses. Hippokratia 18(4):379","journal-title":"Hippokratia"},{"issue":"2","key":"3172_CR3","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1007\/s12070-015-0827-6","volume":"68","author":"H Varshney","year":"2015","unstructured":"Varshney H, Varshney J, Biswas S, Ghosh SK (2015) Importance of CT scan of paranasal sinuses in the evaluation of the anatomical findings in patients suffering from sinonasal polyposis. Indian J Otolaryngol Head Neck Surg 68(2):167\u2013172","journal-title":"Indian J Otolaryngol Head Neck Surg"},{"issue":"1","key":"3172_CR4","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/S0011-8532(22)00232-4","volume":"38","author":"ML Van Dis","year":"1994","unstructured":"Van Dis ML, Miles DA (1994) Disorders of the maxillary sinus. Dent Clin North Am 38(1):155\u2013166","journal-title":"Dent Clin North Am"},{"issue":"1","key":"3172_CR5","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1186\/1472-6815-14-13","volume":"14","author":"AG Hansen","year":"2014","unstructured":"Hansen AG, Helvik A-S, Nordg\u00e5rd S, Bugten V, Stovner LJ, H\u00e5berg AK, G\u00e5rseth M, Eggesb\u00f8 HB (2014) Incidental findings in MRI of the paranasal sinuses in adults: a population-based study (HUNT MRI). BMC Ear Nose Throat Disord 14(1):13. https:\/\/doi.org\/10.1186\/1472-6815-14-13","journal-title":"BMC Ear Nose Throat Disord"},{"issue":"1","key":"3172_CR6","first-page":"33","volume":"38","author":"B Tarp","year":"2000","unstructured":"Tarp B, Fiirgaard B, Christensen T, Jensen JJ, Black FT (2000) The prevalence and significance of incidental paranasal sinus abnormalities on MRI. Rhinology 38(1):33\u201338","journal-title":"Rhinology"},{"key":"3172_CR7","doi-asserted-by":"crossref","unstructured":"Brierley J, Gospodarowicz MK, Wittekind C (eds) (2017) TNM classification of malignant tumours. Eighth edn. John Wiley & Sons Inc, Chichester West Sussex UK and Hoboken NJ","DOI":"10.1002\/9780471420194.tnmc26.pub3"},{"issue":"6164","key":"3172_CR8","doi-asserted-by":"publisher","first-page":"1321","DOI":"10.1126\/science.1248764","volume":"342","author":"A Gutmann","year":"2013","unstructured":"Gutmann A (2013) Ethics. The bioethics commission on incidental findings. Science 342(6164):1321\u20131323. https:\/\/doi.org\/10.1126\/science.1248764","journal-title":"Science"},{"issue":"1","key":"3172_CR9","first-page":"12727","volume":"13","author":"A-M Papadopoulou","year":"2021","unstructured":"Papadopoulou A-M, Chrysikos D, Samolis A, Tsakotos G, Troupis T (2021) Anatomical variations of the nasal cavities and paranasal sinuses: a systematic review. Cureus 13(1):12727","journal-title":"Cureus"},{"key":"3172_CR10","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics11020250","author":"Y Jeon","year":"2021","unstructured":"Jeon Y, Lee K, Sunwoo L, Choi D, Oh DY, Lee KJ, Kim Y, Kim J-W, Cho SJ, Baik SH, Yoo R-E, Bae YJ, Choi BS, Jung C, Kim JH (2021) Deep learning for diagnosis of paranasal sinusitis using multi-view radiographs. Diagnostics. https:\/\/doi.org\/10.3390\/diagnostics11020250","journal-title":"Diagnostics"},{"issue":"1","key":"3172_CR11","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1097\/RLI.0000000000000503","volume":"54","author":"Y Kim","year":"2019","unstructured":"Kim Y, Lee KJ, Sunwoo L, Choi D, Nam C-M, Cho J, Kim J, Bae YJ, Yoo R-E, Choi BS, Jung C, Kim JH (2019) Deep learning in diagnosis of maxillary sinusitis using conventional radiography. Investig Radiol 54(1):7\u201315. https:\/\/doi.org\/10.1097\/RLI.0000000000000503","journal-title":"Investig Radiol"},{"key":"3172_CR12","doi-asserted-by":"publisher","DOI":"10.1002\/alr.22958","author":"GS Liu","year":"2022","unstructured":"Liu GS, Yang A, Kim D, Hojel A, Voevodsky D, Wang J, Tong CCL, Ungerer H, Palmer JN, Kohanski MA, Nayak JV, Hwang PH, Adappa ND, Patel ZM (2022) Deep learning classification of inverted papilloma malignant transformation using 3d convolutional neural networks and magnetic resonance imaging. Int Forum Allergy Rhinol. https:\/\/doi.org\/10.1002\/alr.22958","journal-title":"Int Forum Allergy Rhinol"},{"issue":"2","key":"3172_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0263125","volume":"17","author":"K-S Kim","year":"2022","unstructured":"Kim K-S, Kim BK, Chung MJ, Cho HB, Cho BH, Jung YG (2022) Detection of maxillary sinus fungal ball via 3-D CNN-based artificial intelligence: Fully automated system and clinical validation. PLoS ONE 17(2):1\u201319. https:\/\/doi.org\/10.1371\/journal.pone.0263125","journal-title":"PLoS ONE"},{"key":"3172_CR14","first-page":"429","volume-title":"Medical image computing and computer assisted intervention-MICCAI 2022","author":"D Bhattacharya","year":"2022","unstructured":"Bhattacharya D, Becker BT, Behrendt F, Bengs M, Beyersdorff D, Eggert D, Petersen E, Jansen F, Petersen M, Cheng B, Betz C, Schlaefer A, Hoffmann AS (2022) Supervised contrastive learning to classify paranasal anomalies in the maxillary sinus. In: Wang L, Dou Q, Fletcher PT, Speidel S, Li S (eds) Medical image computing and computer assisted intervention-MICCAI 2022. Springer, Cham, pp 429\u2013438"},{"issue":"2","key":"3172_CR15","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1007\/s11548-023-02990-3","volume":"19","author":"D Bhattacharya","year":"2023","unstructured":"Bhattacharya D, Behrendt F, Becker BT, Beyersdorff D, Petersen E, Petersen M, Cheng B, Eggert D, Betz C, Hoffmann AS, Schlaefer A (2023) Multiple instance ensembling for paranasal anomaly classification in the maxillary sinus. Int J Comput Assist Radiol Surg 19(2):223\u2013231","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3172_CR16","doi-asserted-by":"publisher","DOI":"10.1145\/3439950","author":"G Pang","year":"2021","unstructured":"Pang G, Shen C, Cao L, Hengel AVD (2021) Deep learning for anomaly detection: a review. ACM Comput Surv. https:\/\/doi.org\/10.1145\/3439950","journal-title":"ACM Comput Surv"},{"key":"3172_CR17","doi-asserted-by":"publisher","unstructured":"Pihlgren G, Sandin F, Liwicki M (2021) Pretraining image encoders without reconstruction via feature prediction loss. In: 2020 25th international conference on pattern recognition (ICPR), pp 4105\u20134111. IEEE Computer Society, Los Alamitos, CA, USA. https:\/\/doi.org\/10.1109\/ICPR48806.2021.9412239","DOI":"10.1109\/ICPR48806.2021.9412239"},{"issue":"6","key":"3172_CR18","doi-asserted-by":"publisher","first-page":"4587","DOI":"10.1007\/s00521-022-07892-0","volume":"35","author":"Y Xie","year":"2023","unstructured":"Xie Y, Thuerey N (2023) Reviving autoencoder pretraining. Neural Comput Appl 35(6):4587\u20134619. https:\/\/doi.org\/10.1007\/s00521-022-07892-0","journal-title":"Neural Comput Appl"},{"key":"3172_CR19","first-page":"3371","volume":"11","author":"P Vincent","year":"2010","unstructured":"Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol P-A (2010) Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371\u20133408","journal-title":"J Mach Learn Res"},{"key":"3172_CR20","unstructured":"Grill J-B, Strub F, Altch\u00e9 F, Tallec C, Richemond P, Buchatskaya E, Doersch C, Avila\u00a0Pires B, Guo Z, Gheshlaghi\u00a0Azar M, Piot B, kavukcuoglu k, Munos R, Valko M (2020) Bootstrap your own latent-a new approach to self-supervised learning. In: Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H (eds.) Advances in neural information processing systems, vol. 33, pp 21271\u201321284. Curran Associates, Inc., . https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2020\/file\/f3ada80d5c4ee70142b17b8192b2958e-Paper.pdf"},{"key":"3172_CR21","doi-asserted-by":"publisher","unstructured":"Chen X, He K (2021) Exploring simple siamese representation learning. In: 2021 IEEE\/CVF Conference on computer vision and pattern recognition (CVPR), pp 15745\u201315753 . https:\/\/doi.org\/10.1109\/CVPR46437.2021.01549","DOI":"10.1109\/CVPR46437.2021.01549"},{"key":"3172_CR22","doi-asserted-by":"publisher","unstructured":"Huang S-C, Pareek A, Jensen M, Lungren MP, Yeung S, Chaudhari AS (2023) Self-supervised learning for medical image classification: a systematic review and implementation guidelines. NPJ Digit Med 6(1):74. https:\/\/doi.org\/10.1038\/s41746-023-00811-0","DOI":"10.1038\/s41746-023-00811-0"},{"key":"3172_CR23","unstructured":"Tian K, Jiang Y, qishuai diao, Lin C, Wang L, Yuan Z (2023) Designing BERT for convolutional networks: sparse and hierarchical masked modeling. In: The eleventh international conference on learning representations. https:\/\/openreview.net\/forum?id=NRxydtWup1S"},{"key":"3172_CR24","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2020.101952","volume":"69","author":"C Baur","year":"2021","unstructured":"Baur C, Denner S, Wiestler B, Navab N, Albarqouni S (2021) Autoencoders for unsupervised anomaly segmentation in brain MR images: a comparative study. Med Image Anal 69:101952","journal-title":"Med Image Anal"},{"key":"3172_CR25","doi-asserted-by":"publisher","unstructured":"Behrendt F, Bengs M, Rogge F, Kr\u00fcger J, Opfer R, Schlaefer A (2022) Unsupervised anomaly detection in 3D brain MRI using deep learning with impured training data. In: 2022 IEEE 19th international symposium on biomedical imaging (ISBI), pp 1\u20134 . https:\/\/doi.org\/10.1109\/ISBI52829.2022.9761443","DOI":"10.1109\/ISBI52829.2022.9761443"},{"key":"3172_CR26","doi-asserted-by":"publisher","unstructured":"Bhattacharya D, Behrendt F, Becker BT, Beyersdorff D, Petersen E, Petersen M, Cheng B, Eggert D, Betz C, Hoffmann AS, Schlaefer A (2022) Unsupervised anomaly detection of paranasal anomalies in the maxillary sinus. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.2211.01371. https:\/\/arxiv.org\/abs\/2211.01371","DOI":"10.48550\/ARXIV.2211.01371"},{"issue":"2","key":"3172_CR27","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1007\/s10654-019-00577-4","volume":"35","author":"A Jagodzinski","year":"2019","unstructured":"Jagodzinski A (2019) Rationale and design of the Hamburg city health study. Eur J Epidemiol 35(2):169\u2013181","journal-title":"Eur J Epidemiol"},{"key":"3172_CR28","doi-asserted-by":"publisher","unstructured":"Tran D, Wang H, Torresani L, Ray J, LeCun Y, Paluri M (2018) A closer look at spatiotemporal convolutions for action recognition. In: 2018 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 6450\u20136459. IEEE Computer Society, Los Alamitos, CA, USA. https:\/\/doi.org\/10.1109\/CVPR.2018.00675","DOI":"10.1109\/CVPR.2018.00675"},{"key":"3172_CR29","doi-asserted-by":"publisher","unstructured":"Deng J, Dong W, Socher R, Li L.-J, Li K, Fei-Fei L (2009) ImageNet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, pp 248\u2013255. https:\/\/doi.org\/10.1109\/CVPR.2009.5206848","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"3172_CR30","unstructured":"Ginsburg B, Gitman I, You Y (2018) Large batch training of convolutional networks with layer-wise adaptive rate scaling. https:\/\/openreview.net\/forum?id=rJ4uaX2aW"},{"key":"3172_CR31","unstructured":"Loshchilov I, Hutter F (2019) Decoupled weight decay regularization. In: International conference on learning representations. https:\/\/openreview.net\/forum?id=Bkg6RiCqY7"},{"key":"3172_CR32","unstructured":"Ozbulak U, Lee HJ, Boga B, Anzaku ET, Park H-M, Messem AV, Neve WD, Vankerschaver J (2023) Know your self-supervised learning: a survey on image-based generative and discriminative training. Transactions on Machine Learning Research. Survey Certification"},{"key":"3172_CR33","unstructured":"Chen T, Kornblith S, Norouzi M, Hinton G (2020) A simple framework for contrastive learning of visual representations. In: Proceedings of the 37th international conference on machine learning. ICML. JMLR.org"},{"key":"3172_CR34","doi-asserted-by":"publisher","unstructured":"Raina R, Battle A, Lee H, Packer B, Ng AY (2007) Self-taught learning: transfer learning from unlabeled data. In: Proceedings of the 24th international conference on machine learning. ICML \u201907, pp. 759\u2013766. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/1273496.1273592","DOI":"10.1145\/1273496.1273592"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03172-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03172-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03172-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,31]],"date-time":"2024-08-31T18:10:08Z","timestamp":1725127808000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03172-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,8]]},"references-count":34,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["3172"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03172-5","relation":{},"ISSN":["1861-6429"],"issn-type":[{"type":"electronic","value":"1861-6429"}],"subject":[],"published":{"date-parts":[[2024,6,8]]},"assertion":[{"value":"6 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 May 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 June 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The study protocol received approval from the local ethics committee (Landes\u00e4rztekammer Hamburg, PV5131) and was approved by the Data Protection Commissioners for the University Medical Center of the University Hamburg-Eppendorf and the Free and Hanseatic City of Hamburg. It is registered on ClinicalTrial.gov (NCT03934957) and adheres to Good Clinical Practice, Good Epidemiological Practice, and ethical principles outlined in the Declaration of Helsinki.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}