{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T15:10:59Z","timestamp":1784214659777,"version":"3.55.0"},"reference-count":39,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,4,17]],"date-time":"2020-04-17T00:00:00Z","timestamp":1587081600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61773104"],"award-info":[{"award-number":["61773104"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Key R&amp;D Program of China","award":["2017YFB0306400"],"award-info":[{"award-number":["2017YFB0306400"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Automatic segmentation of metallographic image is very important for the implementation of an automatic metallographic analysis system. In this paper, a novel instance segmentation framework of a metallographic image was implemented, which can assign each pixel to a physical instance of a microstructure. In this framework, we used the Mask R-CNN as the basic network to complete the learning and recognition of the latent feature of an aluminum alloy microstructure. Meanwhile, we implemented five different loss functions based on this framework and compared the influence of these loss functions on metallographic image segmentation performance. We carried out several experiments to verify the effectiveness of the proposed framework. In these experiments, we compared and analyzed six different evaluation metrics and provided constructive suggestions for the performance evaluation of metallographic image segmentation method. A large number of experimental results have shown that the proposed method can achieve the instance segmentation of an aluminum alloy metallographic image and the segmentation results are satisfactory.<\/jats:p>","DOI":"10.3390\/sym12040639","type":"journal-article","created":{"date-parts":[[2020,4,21]],"date-time":"2020-04-21T05:48:52Z","timestamp":1587448132000},"page":"639","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Microstructure Instance Segmentation from Aluminum Alloy Metallographic Image Using Different Loss Functions"],"prefix":"10.3390","volume":"12","author":[{"given":"Dali","family":"Chen","sequence":"first","affiliation":[{"name":"State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang 110819, China"},{"name":"College of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dinghao","family":"Guo","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang 110819, China"},{"name":"College of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shixin","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang 110819, China"},{"name":"College of Information Science and Engineering, Northeastern University, Shenyang 110819, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fang","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Materials Science and Engineering, Northeastern University, Shenyang 110819, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/S0921-5093(99)00674-7","article-title":"Recent development in aluminium alloys for aerospace applications","volume":"280","author":"Heinz","year":"2000","journal-title":"Mater. Sci. Eng. A"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"818","DOI":"10.1016\/j.actamat.2012.10.044","article-title":"Superior light metals by texture engineering: Optimized aluminum and magnesium alloys for automotive applications","volume":"61","author":"Hirsch","year":"2013","journal-title":"Acta Mater."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1038\/nature23894","article-title":"3D printing of high-strength aluminium alloys","volume":"549","author":"Martin","year":"2017","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1016\/j.jmst.2018.09.004","article-title":"A review of selective laser melting of aluminum alloys: Processing, microstructure, property and developing trends","volume":"35","author":"Zhang","year":"2019","journal-title":"J. Mater. Sci. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1007\/BF02648419","article-title":"Porosity formation in AI-9 Wt pct Si-3 Wt pct Cu alloy systems: Metallographic observations","volume":"27","author":"Roy","year":"1996","journal-title":"Metall. Mater. Trans. A"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/S1044-5803(97)80024-1","article-title":"Microstructural evolution during solidification of austenitic stainless steel weld metals: A color metallographic and electron microprobe analysis study","volume":"38","author":"Rajasekhar","year":"1997","journal-title":"Mater. Charact."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/S1044-5803(97)00154-X","article-title":"Metallographic methods for revealing the multiphase microstructure of TRIP-assisted steels","volume":"40","author":"Girault","year":"1998","journal-title":"Mater. Charact."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/S1359-6454(00)00335-9","article-title":"A metallographic and quantitative analysis of the influence of stacking fault energy on shock-hardening in Cu and Cu\u2013Al alloys","volume":"49","author":"Rohatgi","year":"2001","journal-title":"Acta Mater."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3864","DOI":"10.3390\/ma8073864","article-title":"New analysis method application in metallographic images through the construction of mosaics via speeded up robust features and scale invariant feature transform","volume":"8","author":"Moreira","year":"2015","journal-title":"Materials"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1007\/s11106-015-9705-8","article-title":"Metallographic analysis and microstructural image processing of sandblasting nozzles produced by powder metallurgy methods","volume":"54","author":"Povstyanoi","year":"2015","journal-title":"Powder Metall. Metal Ceram."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1016\/j.commatsci.2016.05.034","article-title":"Image driven machine learning methods for microstructure recognition","volume":"123","author":"Chowdhury","year":"2016","journal-title":"Comput. Mater. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1016\/j.matdes.2017.12.049","article-title":"New methods for automatic quantification of microstructural features using digital image processing","volume":"141","author":"Campbell","year":"2018","journal-title":"Mater. Design"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"025001","DOI":"10.1088\/2051-672X\/aab73b","article-title":"Algorithm based on regional separation for automatic grain boundary extraction using improved mean shift method","volume":"6","author":"Zhenying","year":"2018","journal-title":"Surf. Topogr. Metrol. Prop."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1051\/metal:2001203","article-title":"Evaluating creep in metals by grain boundary extraction using directional wavelets and mathematical morphology","volume":"98","author":"Journaux","year":"2001","journal-title":"Revue de M\u00e9tall. Int. J. Metall."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"276","DOI":"10.4028\/www.scientific.net\/AMM.152-154.276","article-title":"Metallographical Image Segmentation and Compression","volume":"Volume 152","author":"Sun","year":"2012","journal-title":"Applied Mechanics and Materials"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Simmons, J., Przybyla, C., Bricker, S., Kim, D.W., and Comer, M. (2014, January 27\u201330). Physics of MRF regularization for segmentation of materials microstructure images. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025989"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Cheng, H.C., Cardone, A., and Varshney, A. (2017, January 17\u201320). Interactive exploration of microstructural features in gigapixel microscopy images. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296298"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chen, L., Han, Y., Cui, B., Guan, Y., and Luo, Y. (2015, January 24\u201326). Two-dimensional fuzzy clustering algorithm (2DFCM) for metallographic image segmentation based on spatial information. Proceedings of the 2015 2nd International Conference on Information Science and Control Engineering, Shanghai, China.","DOI":"10.1109\/ICISCE.2015.121"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1016\/j.ndteint.2009.05.002","article-title":"Evaluation of multilayer perceptron and self-organizing map neural network topologies applied on microstructure segmentation from metallographic images","volume":"42","author":"Cortez","year":"2009","journal-title":"NDT E Int."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2078","DOI":"10.1038\/s41598-018-20438-6","article-title":"Pattern recognition with machine learning on optical microscopy images of typical metallurgical microstructures","volume":"8","author":"Bulgarevich","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1016\/j.eswa.2012.07.062","article-title":"Computer techniques towards the automatic characterization of graphite particles in metallographic images of industrial materials","volume":"40","author":"Papa","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1002\/jemt.20870","article-title":"Automatic evaluation of nickel alloy secondary phases from SEM images","volume":"74","author":"Silva","year":"2011","journal-title":"Microsc. Res. Tech."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.commatsci.2015.08.011","article-title":"A computer vision approach for automated analysis and classification of microstructural image data","volume":"110","author":"DeCost","year":"2015","journal-title":"Comput. Mater. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.commatsci.2018.03.004","article-title":"Advanced microstructure classification by data mining methods","volume":"148","author":"Gola","year":"2018","journal-title":"Comput. Mater. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_26","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1126\/science.aat2663","article-title":"Inverse molecular design using machine learning: Generative models for matter engineering","volume":"361","year":"2018","journal-title":"Science"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2128","DOI":"10.1038\/s41598-018-20037-5","article-title":"Advanced steel microstructural classification by deep learning methods","volume":"8","author":"Azimi","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ma, B., Ban, X., Huang, H., Chen, Y., Liu, W., and Zhi, Y. (2018). Deep learning-based image segmentation for al-la alloy microscopic images. Symmetry, 10.","DOI":"10.3390\/sym10040107"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.media.2016.11.004","article-title":"DCAN: Deep contour-aware networks for object instance segmentation from histology images","volume":"36","author":"Chen","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.media.2019.05.004","article-title":"Attentive neural cell instance segmentation","volume":"55","author":"Yi","year":"2019","journal-title":"Med. Image Anal."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"De Bel, T., Hermsen, M., Litjens, G., and van der Laak, J. (2018). Structure Instance Segmentation in Renal Tissue: A Case Study on Tubular Immune Cell Detection. Computational Pathology and Ophthalmic Medical Image Analysis, Springer.","DOI":"10.1007\/978-3-030-00949-6_14"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Guerrero-Pena, F.A., Fernandez, P.D.M., Ren, T.I., Yui, M., Rothenberg, E., and Cunha, A. (2018, January 7\u201310). Multiclass weighted loss for instance segmentation of cluttered cells. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451187"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"6699","DOI":"10.1109\/TGRS.2018.2841808","article-title":"Vehicle instance segmentation from aerial image and video using a multitask learning residual fully convolutional network","volume":"56","author":"Mou","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Milletari, F., Navab, N., and Ahmadi, S.A. (2016, January 25\u201328). V-net: Fully convolutional neural networks for volumetric medical image segmentation. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.","DOI":"10.1109\/3DV.2016.79"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Rahman, M.A., and Wang, Y. (2016, January 12\u201314). Optimizing intersection-over-union in deep neural networks for image segmentation. Proceedings of the International Symposium on Visual Computing, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-50835-1_22"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Salehi, S.S.M., Erdogmus, D., and Gholipour, A. (2017, January 10). Tversky loss function for image segmentation using 3D fully convolutional deep networks. Proceedings of the International Workshop on Machine Learning in Medical Imaging, Quebec, QC, Canada.","DOI":"10.1007\/978-3-319-67389-9_44"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Brosch, T., Yoo, Y., Tang, L.Y., Li, D.K., Traboulsee, A., and Tam, R. (2015, January 5\u20139). Deep convolutional encoder networks for multiple sclerosis lesion segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_1"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/4\/639\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:08:55Z","timestamp":1760364535000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/4\/639"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,17]]},"references-count":39,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["sym12040639"],"URL":"https:\/\/doi.org\/10.3390\/sym12040639","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,17]]}}}