{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T14:32:12Z","timestamp":1784039532472,"version":"3.55.0"},"reference-count":39,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2024,12,26]],"date-time":"2024-12-26T00:00:00Z","timestamp":1735171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/page\/copyright"},{"start":{"date-parts":[[2024,12,26]],"date-time":"2024-12-26T00:00:00Z","timestamp":1735171200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Innovation Capability Improvement of Hebei Province","award":["22567629H"],"award-info":[{"award-number":["22567629H"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Biomed. Phys. Eng. Express"],"published-print":{"date-parts":[[2025,1,31]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Malignant thyroid nodules are closely linked to cancer, making the precise classification of thyroid nodules into benign and malignant categories highly significant. However, the subtle differences in contour between benign and malignant thyroid nodules, combined with the texture features obscured by the inherent noise in ultrasound images, often result in low classification accuracy in most models. To address this, we propose a Bidirectional Interaction Directional Variance Attention Model based on Increased-Transformer, named IFormer-DVNet. This paper proposes the Increased-Transformer, which enables global feature modeling of feature maps extracted by the Convolutional Feature Extraction Module (CFEM). This design maximally alleviates noise interference in ultrasound images. The Bidirectional Interaction Directional Variance Attention module (BIDVA) dynamically calculates attention weights using the variance of input tensors along both vertical and horizontal directions. This allows the model to focus more effectively on regions with rich information in the image. The vertical and horizontal features are interactively combined to enhance the model\u2019s representational capability. During the model training process, we designed a Multi-Dimensional Loss function (MD Loss) to stretch the boundary distance between different classes and reduce the distance between samples of the same class. Additionally, the MD Loss function helps mitigate issues related to class imbalance in the dataset. We evaluated our network model using the public TNCD dataset and a private dataset. The results show that our network achieved an accuracy of 76.55% on the TNCD dataset and 93.02% on the private dataset. Compared to other state-of-the-art classification networks, our model outperformed them across all evaluation metrics.<\/jats:p>","DOI":"10.1088\/2057-1976\/ad9f68","type":"journal-article","created":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T22:49:06Z","timestamp":1734389346000},"page":"015048","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Bidirectional interaction directional variance attention model based on increased-transformer for thyroid nodule classification"],"prefix":"10.1088","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9291-8235","authenticated-orcid":false,"given":"Ming","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-1681-5339","authenticated-orcid":true,"given":"Jianing","family":"Yao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1919-2113","authenticated-orcid":false,"given":"Jianli","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1295-0332","authenticated-orcid":false,"given":"Zhenzhen","family":"Wan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-3223-5891","authenticated-orcid":true,"given":"Xiong","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2024,12,26]]},"reference":[{"key":"bpexad9f68bib1","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1109\/ICAIS50930.2021.9396035","article-title":"Thyroid nodule detection using artificial neural network","author":"Kesarkar","year":"2021"},{"key":"bpexad9f68bib2","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102443","article-title":"Thyroid nodule segmentation and classification in ultrasound images through intra-and inter-task consistent learning","volume":"79","author":"Kang","year":"2022","journal-title":"Med. Image Anal."},{"key":"bpexad9f68bib3","doi-asserted-by":"publisher","first-page":"580","DOI":"10.1089\/thy.2020.0233","article-title":"Patients\u2019 reaction to diagnosis with thyroid cancer or an indeterminate thyroid nodule","volume":"31","author":"Pitt","year":"2021","journal-title":"Thyroid"},{"key":"bpexad9f68bib4","author":"Dosovitskiy","year":"2020"},{"key":"bpexad9f68bib5","doi-asserted-by":"publisher","first-page":"10012","DOI":"10.48550\/arXiv.2010.11929","article-title":"Swin transformer: Hierarchical vision transformer using shifted windows","author":"Liu","year":"2021"},{"key":"bpexad9f68bib6","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2024.111323","article-title":"An efficient medical image classification network based on multi-branch CNN, token grouping Transformer and mixer MLP","volume":"153","author":"Liu","year":"2024","journal-title":"Appl. Soft Comput."},{"key":"bpexad9f68bib7","author":"Mehta","year":"2021"},{"key":"bpexad9f68bib8","first-page":"4690","article-title":"Arcface: additive angular margin loss for deep face recognition","author":"Deng","year":"2019"},{"key":"bpexad9f68bib9","first-page":"2980","article-title":"Focal loss for dense object detection","author":"Lin","year":"2017"},{"key":"bpexad9f68bib10","article-title":"Learning imbalanced datasets with label-distribution-aware margin loss","volume":"32","author":"Cao","year":"2019","journal-title":"Advances in neural information processing systems"},{"key":"bpexad9f68bib11","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1002\/wics.101","article-title":"Principal component analysis","volume":"2","author":"Abdi","year":"2010","journal-title":"Wiley interdisciplinary reviews: computational statistics"},{"key":"bpexad9f68bib12","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Machine learning"},{"key":"bpexad9f68bib13","doi-asserted-by":"publisher","author":"Breiman","year":"2017","DOI":"10.1201\/9781315139470"},{"key":"bpexad9f68bib14","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: a gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann. Stat."},{"key":"bpexad9f68bib15","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1111\/j.2517-6161.1958.tb00292.x","article-title":"The regression analysis of binary sequences","volume":"20","author":"Cox","year":"1958","journal-title":"Journal of the Royal Statistical Society Series B: Statistical Methodology"},{"key":"bpexad9f68bib16","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A decision-theoretic generalization of on-line learning and an application to boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J. Comput. Syst. Sci."},{"key":"bpexad9f68bib17","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1023\/A:1007692713085","article-title":"Text classification from labeled and unlabeled documents using EM","volume":"39","author":"Nigam","year":"2000","journal-title":"Mach. Learn."},{"key":"bpexad9f68bib18","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"bpexad9f68bib19","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"bpexad9f68bib20","first-page":"1","volume":"18","author":"Murphy","year":"2006"},{"key":"bpexad9f68bib21","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2022.106444","article-title":"Classification for thyroid nodule using ViT with contrastive learning in ultrasound images","volume":"152","author":"Sun","year":"2023","journal-title":"Comput. Biol. Med."},{"key":"bpexad9f68bib22","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2023.107758","article-title":"DM-CNN: dynamic multi-scale convolutional neural network with uncertainty quantification for medical image classification","volume":"168","author":"Han","year":"2024","journal-title":"Comput. Biol. Med."},{"key":"bpexad9f68bib23","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2023.105534","article-title":"HiFuse: hierarchical multi-scale feature fusion network for medical image classification","volume":"87","author":"Huo","year":"2024","journal-title":"Biomed. Signal Process. Control"},{"key":"bpexad9f68bib24","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102535","article-title":"Adversarial multimodal fusion with attention mechanism for skin lesion classification using clinical and dermoscopic images","volume":"81","author":"Wang","year":"2022","journal-title":"Med. Image Anal."},{"key":"bpexad9f68bib25","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1007\/978-3-031-16440-8_24","article-title":"Less is more: adaptive curriculum learning for thyroid nodule diagnosis","author":"Gong","year":"2022"},{"key":"bpexad9f68bib26","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1016\/S0734-189X(87)80186-X","article-title":"Adaptive histogram equalization and its variations","volume":"39","author":"Pizer","year":"1987","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"bpexad9f68bib27","first-page":"1","article-title":"Going deeper with convolutions","author":"Szegedy","year":"2015"},{"key":"bpexad9f68bib28","first-page":"770","article-title":"Deep residual learning for image recognition","author":"He","year":"2016"},{"key":"bpexad9f68bib29","first-page":"1492","article-title":"Aggregated residual transformations for deep neural networks","author":"Xie","year":"2017"},{"key":"bpexad9f68bib30","first-page":"4700","article-title":"Densely connected convolutional networks","author":"Huang","year":"2017"},{"key":"bpexad9f68bib31","first-page":"4510","article-title":"Mobilenetv2: Inverted residuals and linear bottlenecks","author":"Sandler","year":"2018"},{"key":"bpexad9f68bib32","first-page":"116","article-title":"Shufflenet v2: Practical guidelines for efficient cnn architecture design","author":"Ma","year":"2018"},{"key":"bpexad9f68bib33","first-page":"10096","article-title":"Efficientnetv2: Smaller models and faster training, International conference on machine learning","volume":"139","author":"Tan","year":"2021","journal-title":"PMLR"},{"key":"bpexad9f68bib34","first-page":"11976","article-title":"A convnet for the 2020s","author":"Liu","year":"2022"},{"key":"bpexad9f68bib35","first-page":"10428","article-title":"Designing network design spaces","author":"Radosavovic","year":"2020"},{"key":"bpexad9f68bib36","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2023.102832","article-title":"DLGNet: a dual-branch lesion-aware network with the supervised gaussian mixture model for colon lesions classification in colonoscopy images","volume":"87","author":"Wang","year":"2023","journal-title":"Med. Image Anal."},{"key":"bpexad9f68bib37","first-page":"2286","article-title":"Convit: improving vision transformers with soft convolutional inductive biases, International conference on machine learning","volume":"139","author":"d\u2019Ascoli","year":"2021","journal-title":"PMLR"},{"key":"bpexad9f68bib38","first-page":"1580","article-title":"Ghostnet: More features from cheap operations","author":"Han","year":"2020"},{"key":"bpexad9f68bib39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00371-024-03508-x","article-title":"ParaLkResNet: an efficient multi-scale image classification network","author":"Yu","year":"2024","journal-title":"The Visual Computer"}],"container-title":["Biomedical Physics &amp; Engineering Express"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad9f68","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad9f68\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad9f68","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad9f68\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad9f68\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad9f68\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad9f68\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad9f68\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,26]],"date-time":"2024-12-26T15:42:47Z","timestamp":1735227767000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad9f68"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,26]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12,26]]},"published-print":{"date-parts":[[2025,1,31]]}},"URL":"https:\/\/doi.org\/10.1088\/2057-1976\/ad9f68","relation":{},"ISSN":["2057-1976"],"issn-type":[{"value":"2057-1976","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,26]]},"assertion":[{"value":"Bidirectional interaction directional variance attention model based on increased-transformer for thyroid nodule classification","name":"article_title","label":"Article Title"},{"value":"Biomedical Physics & Engineering Express","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.","name":"copyright_information","label":"Copyright Information"},{"value":"2024-09-20","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-12-16","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-12-26","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}