{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T20:43:33Z","timestamp":1760647413037,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,3,18]],"date-time":"2021-03-18T00:00:00Z","timestamp":1616025600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["109-2221-E-009-035-"],"award-info":[{"award-number":["109-2221-E-009-035-"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, an artificial neural network is applied for enhancing the resolution of images from an optical microscope based on a network trained with the images acquired from a scanning electron microscope. The resolution of microscopic images is important in various fields, especially for microfluidics because the measurements, such as the dimension of channels and cells, largely rely on visual information. The proposed method is experimentally validated with microfluidic structure. The images of structural edges from the optical microscope are blurred due to optical effects while the images from the scanning electron microscope are sharp and clear. Intensity profiles perpendicular to the edges and the corresponding edge positions determined by the scanning electron microscope images are plugged in a neural network as the input features and the output target, respectively. According to the results, the blurry edges of the microstructure in optical images can be successfully enhanced. The average error between the predicted channel position and ground truth is around 328 nanometers. The effects of the feature length are discussed. The proposed method is expected to significantly contribute to microfluidic applications, such as on-chip cell evaluation.<\/jats:p>","DOI":"10.3390\/s21062139","type":"journal-article","created":{"date-parts":[[2021,3,18]],"date-time":"2021-03-18T22:19:36Z","timestamp":1616105976000},"page":"2139","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Neural Network for Enhancing Microscopic Resolution Based on Images from Scanning Electron Microscope"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8840-3984","authenticated-orcid":false,"given":"Chia-Hung Dylan","family":"Tsai","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chia-Hao","family":"Yeh","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1242\/jcs.75.1.279","article-title":"Interference reflection microscopy in cell biology: Methodology and applications","volume":"75","author":"Verschueren","year":"1985","journal-title":"J. Cell Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1038\/nmeth0411-279","article-title":"DAOSTORM: An algorithm for high-density super-resolution microscopy","volume":"8","author":"Holden","year":"2011","journal-title":"Nat. Methods"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1109\/TBME.2013.2296624","article-title":"A New Dimensionless Index for Evaluating Cell Stiffness-Based Deformability in Microchannel","volume":"61","author":"Tsai","year":"2014","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Horade, M., Tsai, C.-H.D., Ito, H., and Kaneko, M. (2017). Red Blood Cell Responses during a Long-Standing Load in a Microfluidic Constriction. Micromachines, 8.","DOI":"10.3390\/mi8040100"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"45050","DOI":"10.1039\/C4RA08276A","article-title":"Geometrical alignment for improving cell evaluation in a microchannel with application on multiple myeloma red blood cells","volume":"4","author":"Tsai","year":"2014","journal-title":"RSC Adv."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tsai, C.-H.D., Tanaka, J., Kaneko, M., Horade, M., Ito, H., Taniguchi, T., Ohtani, T., and Sakata, Y. (2016). An On-Chip RBC Deformability Checker Significantly Improves Velocity-Deformation Correlation. Micromachines, 7.","DOI":"10.3390\/mi7100176"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Abbe, E. (1873). Contributions to the theory of the microscope and microscopic detection (Traduction from German) Beitr\u00e4ge zur Theorie des Mikroskops und der mikroskopischen Wahrnehmung. Arch. Mikroskopische Anat., 413\u2013468.","DOI":"10.1007\/BF02956173"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s00216-004-2896-3","article-title":"New dimension in nano-imaging: Breaking through the diffraction limit with scanning near-field optical microscopy","volume":"381","author":"Rasmussen","year":"2005","journal-title":"Anal. Bioanal. Chem."},{"key":"ref_9","first-page":"30","article-title":"Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy","volume":"108","author":"Rivenson","year":"2019","journal-title":"Proc. IEEE"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1364\/AO.37.001735","article-title":"High-spatial-resolution distributed strain measurement in optical fiber with Rayleigh scatter","volume":"37","author":"Froggatt","year":"1998","journal-title":"Appl. Opt."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"126014","DOI":"10.1117\/1.JBO.17.12.126014","article-title":"Effects of light scattering on optical-resolution photoacoustic microscopy","volume":"17","author":"Liu","year":"2012","journal-title":"J. Biomed. Opt."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"14313","DOI":"10.1038\/ncomms14313","article-title":"Ultrahigh-resolution imaging of water networks by atomic force microscopy","volume":"8","author":"Shiotari","year":"2017","journal-title":"Nat. Commun."},{"key":"ref_13","first-page":"40","article-title":"Microscopy: An introduction","volume":"13","year":"2000","journal-title":"III-Vs Rev."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Th\u00e9venaz, P., Blu, T., and Unser, M. (2009). Image Interpolation and Resampling. Handb. Med Image Process. Anal., 465\u2013493.","DOI":"10.1016\/B978-012373904-9.50037-4"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.1080\/713821367","article-title":"Optical Imaging with Resolution Exceeding the Rayleigh Criterion","volume":"30","author":"Walker","year":"1983","journal-title":"Opt. Acta: Int. J. Opt."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1145\/1276377.1276496","article-title":"Image upsampling via imposed edge statistics","volume":"26","author":"Fattal","year":"2007","journal-title":"ACM Trans. Graph."},{"key":"ref_17","first-page":"781","article-title":"Porous Structure Reconstruction Using Convolutional Neural Networks","volume":"50","author":"Wang","year":"2018","journal-title":"Math. Geol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image Super-Resolution Using Deep Convolutional Networks","volume":"38","author":"Dong","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","first-page":"391","article-title":"Accelerating the super-resolution convolutional neural network","volume":"Volume 9906","author":"Dong","year":"2016","journal-title":"Proceedings of the Financial Cryptography and Data Security"},{"key":"ref_20","first-page":"360","article-title":"Deep depth super-resolution: Learning depth super-resolution using deep convolutional neural network","volume":"10114","author":"Song","year":"2017","journal-title":"Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"443001","DOI":"10.1088\/0022-3727\/48\/44\/443001","article-title":"The 2015 super-resolution microscopy roadmap","volume":"48","author":"Hell","year":"2015","journal-title":"J. Phys. D Appl. Phys."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Eom, J., and Moon, S. (2018). Three-Dimensional High-Resolution Digital Inline Hologram Reconstruction with a Volumetric Deconvolution Method. Sensors, 18.","DOI":"10.3390\/s18092918"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Huang, X., Li, Y., Xu, X., Wang, R., Yao, J., Han, W., Wei, M., Chen, J., Xuan, W., and Sun, L. (2021). High-Precision Lensless Microscope on a Chip Based on In-Line Holographic Imaging. Sensors, 21.","DOI":"10.3390\/s21030720"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge Detection","volume":"PAMI-8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tsai, C.-H.D., and Lin, X.-Y. (2019). Experimental Study on Microfluidic Mixing with Different Zigzag Angles. Micromachines, 10.","DOI":"10.3390\/mi10090583"},{"key":"ref_26","first-page":"62","article-title":"A threshold selection method from gray-level histograms","volume":"C","author":"Otsu","year":"1975","journal-title":"Automatica"},{"key":"ref_27","unstructured":"Sobel, I., and Feldman, G. (2015). An isotropic 3x3 image gradient operator. Stanf. Artif. Intell. Proj., 271\u2013272."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Mor\u00e9, J. (1978). The Levenberg-Marquardt algorithm: Implementation and theory. Lecture Notes in Mathematicsl, Springer.","DOI":"10.1007\/BFb0067700"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1145\/235815.235821","article-title":"The quickhull algorithm for convex hulls","volume":"22","author":"Barber","year":"1996","journal-title":"ACM Trans. Math. Softw."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/6\/2139\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:37:51Z","timestamp":1760161071000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/6\/2139"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,18]]},"references-count":29,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["s21062139"],"URL":"https:\/\/doi.org\/10.3390\/s21062139","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,3,18]]}}}