{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T16:36:51Z","timestamp":1783701411505,"version":"3.55.0"},"reference-count":28,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2018,4,8]],"date-time":"2018-04-08T00:00:00Z","timestamp":1523145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61433010"],"award-info":[{"award-number":["61433010"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61573238"],"award-info":[{"award-number":["61573238"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The maneuvering and electrical characterization of nanotubes inside a scanning electron microscope (SEM) has historically been time-consuming and laborious for operators. Before the development of automated nanomanipulation-enabled techniques for the performance of pick-and-place and characterization of nanoobjects, these functions were still incomplete and largely operated manually. In this paper, a dual-probe nanomanipulation system vision-based feedback was demonstrated to automatically perform 3D nanomanipulation tasks, to investigate the electrical characterization of nanotubes. The XY-position of Atomic Force Microscope (AFM) cantilevers and individual carbon nanotubes (CNTs) were precisely recognized via a series of image processing operations. A coarse-to-fine positioning strategy in the Z-direction was applied through the combination of the sharpness-based depth estimation method and the contact-detection method. The use of nanorobotic magnification-regulated speed aided in improving working efficiency and reliability. Additionally, we proposed automated alignment of manipulator axes by visual tracking the movement trajectory of the end effector. The experimental results indicate the system\u2019s capability for automated measurement electrical characterization of CNTs. Furthermore, the automated nanomanipulation system has the potential to be extended to other nanomanipulation tasks.<\/jats:p>","DOI":"10.3390\/s18041137","type":"journal-article","created":{"date-parts":[[2018,4,10]],"date-time":"2018-04-10T13:06:08Z","timestamp":1523365568000},"page":"1137","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Visual Servoing-Based Nanorobotic System for Automated Electrical Characterization of Nanotubes inside SEM"],"prefix":"10.3390","volume":"18","author":[{"given":"Huiyang","family":"Ding","sequence":"first","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chaoyang","family":"Shi","sequence":"additional","affiliation":[{"name":"Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, ON M5S 3G8, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3063-4819","authenticated-orcid":false,"given":"Zhan","family":"Yang","sequence":"additional","affiliation":[{"name":"Provincial Jiangsu Key Laboratory for Advanced Robotics, Soochow University, Suzhou 215123, China; 20165229031@stu.suda.edu.cn (M.W.)"},{"name":"Collaborative Innovation Center of Suzhou Nano Science and Technology, Soochow University, Suzhou 215123, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingyu","family":"Wang","sequence":"additional","affiliation":[{"name":"Provincial Jiangsu Key Laboratory for Advanced Robotics, Soochow University, Suzhou 215123, China; 20165229031@stu.suda.edu.cn (M.W.)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yaqiong","family":"Wang","sequence":"additional","affiliation":[{"name":"Provincial Jiangsu Key Laboratory for Advanced Robotics, Soochow University, Suzhou 215123, China; 20165229031@stu.suda.edu.cn (M.W.)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tao","family":"Chen","sequence":"additional","affiliation":[{"name":"Provincial Jiangsu Key Laboratory for Advanced Robotics, Soochow University, Suzhou 215123, China; 20165229031@stu.suda.edu.cn (M.W.)"},{"name":"Collaborative Innovation Center of Suzhou Nano Science and Technology, Soochow University, Suzhou 215123, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lining","family":"Sun","sequence":"additional","affiliation":[{"name":"Provincial Jiangsu Key Laboratory for Advanced Robotics, Soochow University, Suzhou 215123, China; 20165229031@stu.suda.edu.cn (M.W.)"},{"name":"Collaborative Innovation Center of Suzhou Nano Science and Technology, Soochow University, Suzhou 215123, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fukuda","family":"Toshio","sequence":"additional","affiliation":[{"name":"Intelligent Robotics Institute, School of Mechatronic Engineering, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,4,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Todri-Sanial, A., Magnani, A., De Magistris, M., and Maffucci, A. (2016, January 18\u201320). Present and future prospects of carbon nanotube interconnects for energy efficient integrated circuits. Proceedings of the 2016 17th International Conference on Thermal, Mechanical and Multi-Physics Simulation and Experiments in Microelectronics and Microsystems (EuroSimE), Montpellier, France.","DOI":"10.1109\/EuroSimE.2016.7463379"},{"key":"ref_2","first-page":"122","article-title":"Carbon nanotube-based multi electrode arrays for neuronal interfacing: Progress and prospects","volume":"6","author":"Hanein","year":"2013","journal-title":"Front. Neural Circuits"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"22534","DOI":"10.1038\/srep22534","article-title":"Vision-based nano robotic system for high-throughput non-embedded cell cutting","volume":"6","author":"Shang","year":"2016","journal-title":"Sci. Rep."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5152","DOI":"10.1038\/srep05152","article-title":"Fully automated high-throughput chromatin immunoprecipitation for ChIP-seq: Identifying ChIP-quality p300 monoclonal antibodies","volume":"4","author":"Gasper","year":"2014","journal-title":"Sci. Rep."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.ab.2013.07.005","article-title":"An automated robotic platform for rapid profiling oligosaccharide analysis of monoclonal antibodies directly from cell culture","volume":"442","author":"Doherty","year":"2013","journal-title":"Anal. Biochem."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2031","DOI":"10.1109\/TMECH.2014.2361271","article-title":"Automated robotic manipulation of individual colloidal particles using vision-based control","volume":"20","author":"Zimmermann","year":"2015","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zimmermann, S., Tiemerding, T., Haenssler, O.C., and Fatikow, S. (2015, January 26\u201330). Automated robotic manipulation of individual sub-micro particles using a dual probe setup inside the scanning electron microscope. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139291"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1109\/TASE.2013.2244082","article-title":"Automated pick-place of silicon nanowires","volume":"10","author":"Ye","year":"2013","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1007\/s00542-007-0471-5","article-title":"Development of automated microrobot-based nanohandling stations for nanocharacterization","volume":"14","author":"Fatikow","year":"2008","journal-title":"Microsyst. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gong, Z., Chen, B.K., Liu, J., and Sun, Y. (2013, January 6\u201310). Automated nanoprobing under scanning electron microscopy. Proceedings of the 2013 IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630759"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"065204","DOI":"10.1088\/0957-4484\/18\/6\/065204","article-title":"Four-probe electrical transport measurements on individual metallic nanowires","volume":"18","author":"Walton","year":"2017","journal-title":"Nanotechnology"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"956","DOI":"10.1021\/nl0630182","article-title":"Four-point probe resistance measurements using PtIr-coated carbon nanotube tips","volume":"7","author":"Yoshimoto","year":"2007","journal-title":"Nano Lett."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Eichhorn, V., Fatikow, S., Sukas, O.S., Hansen, T.M., B\u00f8ggild, P., and Occhipinti, L.G. (2010, January 3\u20137). Novel four-point-probe design and nanorobotic dual endeffector strategy for electrical characterization of as-grown SWCNT bundles. Proceedings of the 2010 IEEE International Conference on Robotics and Automation (ICRA), Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509952"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yang, Z., Wang, Y., Yang, B., Li, G., Chen, T., Nakajima, M., and Fukuda, T. (2016). Mechatronic development and vision feedback control of a nanorobotics manipulation system inside SEM for nanodevice assembly. IEEE Sens. J., 16.","DOI":"10.3390\/s16091479"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1109\/TNANO.2010.2065236","article-title":"Automated four-point probe measurement of nanowires inside a scanning electron microscope","volume":"10","author":"Ru","year":"2011","journal-title":"IEEE Trans. Nanotechnol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Fatikow, S., Wortmann, T., Mikczinski, M., Dahmen, C., and Stolle, C. (2009, January 17\u201319). Towards automated robot-based nanohandling. Proceedings of the 2009 Chinese Control and Decision Conference, Guilin, China.","DOI":"10.1109\/CCDC.2009.5194956"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.mechatronics.2007.10.005","article-title":"Development and control of a versatile nanohandling robot cell","volume":"18","author":"Fatikow","year":"2008","journal-title":"Mechatronics"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Elfert, P., Tiemerding, T., Diederichs, C., and Fatikow, S. (2014, January 5\u20137). Advanced Methods for High-Speed Template Matching Targeting FPGAs. Proceedings of the 2014 International Symposium on Optomechatronic Technologies (ISOT), Seattle, WA, USA.","DOI":"10.1109\/ISOT.2014.17"},{"key":"ref_19","unstructured":"Diederichs, C., and Fatikow, S. (2014). FPGA-based object detection and motion tracking in micro-and nanorobotics. Nanotechnology: Concepts, Methodologies, Tools, and Applications: Concepts, Methodologies, Tools, and Applications, Information Science Reference."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"125002","DOI":"10.1088\/1361-6463\/aaaef9","article-title":"Evaluation of cracks with different hidden depths and shapes using surface magnetic field measurements based on semi-analytical modelling","volume":"51","author":"Jiang","year":"2018","journal-title":"J. Phys. D. Appl. Phys."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1080\/15599610701232630","article-title":"3-D vision feedback for nanohandling monitoring in a scanning electron microscope","volume":"1","author":"Fatikow","year":"2007","journal-title":"Int. J. Optomechatron."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1847","DOI":"10.1109\/TIM.2016.2556898","article-title":"Visual Servoing-Based Depth-Estimation Technique for Manipulation inside SEM","volume":"65","author":"Marturi","year":"2016","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Marturi, N., Demb\u00e9l\u00e9, S., and Piat, N. (2013, January 16\u201318). Depth and shape estimation from focus in scanning electron microscope for micromanipulation. Proceedings of the 2013 International Conference on Control, Automation, Robotics and Embedded Systems (CARE), Jabalpur, India.","DOI":"10.1109\/CARE.2013.6733694"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1109\/TMECH.2007.897252","article-title":"Microrobot system for automatic nanohandling inside a scanning electron microscope","volume":"12","author":"Fatikow","year":"2007","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1177\/0278364908097212","article-title":"Nanofabrication, nanoinstrumentation and nanoassembly by nanorobotic manipulation","volume":"28","author":"Fukuda","year":"2009","journal-title":"Int. J. Robot. Res."},{"key":"ref_26","first-page":"5910734","article-title":"Characterization of the Resistance and Force of a Carbon Nanotube\/Metal Side Contact by Nanomanipulation","volume":"1","author":"Ning","year":"2017","journal-title":"Scanning"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Guo, Y., Shi, Q., Yang, Z., Wang, H., Yu, N., Sun, L., and Fukuda, T. (2013, January 9\u201314). Automated pick-up of carbon nanotubes inside a scanning electron microscope. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, South Korea.","DOI":"10.1109\/IROS.2016.7759782"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1109\/TMECH.2017.2649681","article-title":"A vision-based automated manipulation system for the pick-up of carbon nanotubes","volume":"22","author":"Shi","year":"2017","journal-title":"IEEE\/ASME Trans. Mechatron."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/4\/1137\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:59:58Z","timestamp":1760194798000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/4\/1137"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,8]]},"references-count":28,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2018,4]]}},"alternative-id":["s18041137"],"URL":"https:\/\/doi.org\/10.3390\/s18041137","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,8]]}}}