{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:22:16Z","timestamp":1760149336301,"version":"build-2065373602"},"reference-count":70,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,7,26]],"date-time":"2023-07-26T00:00:00Z","timestamp":1690329600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006463","name":"Bavarian Ministry of Economic Affairs, Regional Development and Energy","doi-asserted-by":"publisher","award":["ESB036\/001"],"award-info":[{"award-number":["ESB036\/001"]}],"id":[{"id":"10.13039\/501100006463","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>The efficient computation of viewpoints while considering various system and process constraints is a common challenge that any robot vision system is confronted with when trying to execute a vision task. Although fundamental research has provided solid and sound solutions for tackling this problem, a holistic framework that poses its formal description, considers the heterogeneity of robot vision systems, and offers an integrated solution remains unaddressed. Hence, this publication outlines the generation of viewpoints as a geometrical problem and introduces a generalized theoretical framework based on Feature-Based Constrained Spaces (C-spaces) as the backbone for solving it. A C-space can be understood as the topological space that a viewpoint constraint spans, where the sensor can be positioned for acquiring a feature while fulfilling the constraint. The present study demonstrates that many viewpoint constraints can be efficiently formulated as C-spaces, providing geometric, deterministic, and closed solutions. The introduced C-spaces are characterized based on generic domain and viewpoint constraints models to ease the transferability of the present framework to different applications and robot vision systems. The effectiveness and efficiency of the concepts introduced are verified on a simulation-based scenario and validated on a real robot vision system comprising two different sensors.<\/jats:p>","DOI":"10.3390\/robotics12040108","type":"journal-article","created":{"date-parts":[[2023,7,27]],"date-time":"2023-07-27T01:27:46Z","timestamp":1690421266000},"page":"108","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Viewpoint Generation Using Feature-Based Constrained Spaces for Robot Vision Systems"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2302-5695","authenticated-orcid":false,"given":"Alejandro","family":"Maga\u00f1a","sequence":"first","affiliation":[{"name":"Institute for Machine Tools and Industrial Management, Technical University of Munich, Boltzmannstra\u00dfe 15, 85748 Garching, Germany"}]},{"given":"Jonas","family":"Dirr","sequence":"additional","affiliation":[{"name":"Institute for Machine Tools and Industrial Management, Technical University of Munich, Boltzmannstra\u00dfe 15, 85748 Garching, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4844-3842","authenticated-orcid":false,"given":"Philipp","family":"Bauer","sequence":"additional","affiliation":[{"name":"Institute for Machine Tools and Industrial Management, Technical University of Munich, Boltzmannstra\u00dfe 15, 85748 Garching, Germany"}]},{"given":"Gunther","family":"Reinhart","sequence":"additional","affiliation":[{"name":"Institute for Machine Tools and Industrial Management, Technical University of Munich, Boltzmannstra\u00dfe 15, 85748 Garching, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Siciliano, B., and Khatib, O. (2016). Springer Handbook of Robotics, Springer International Publishing.","DOI":"10.1007\/978-3-319-32552-1"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"103094","DOI":"10.1016\/j.cad.2021.103094","article-title":"Survey on the View Planning Problem for Reverse Engineering and Automated Control Applications","volume":"141","author":"Polette","year":"2021","journal-title":"Comput.-Aided Des."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1007\/s00138-021-01252-z","article-title":"Viewpoint placement for inspection planning","volume":"33","author":"Mosbach","year":"2022","journal-title":"Mach. Vis. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1343","DOI":"10.1177\/0278364911410755","article-title":"Active vision in robotic systems: A survey of recent developments","volume":"30","author":"Chen","year":"2011","journal-title":"Int. J. Robot. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1109\/70.345940","article-title":"A survey of sensor planning in computer vision","volume":"11","author":"Tarabanis","year":"1995","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"119310","DOI":"10.1109\/ACCESS.2021.3108177","article-title":"A Comprehensive Review of Coverage Path Planning in Robotics Using Classical and Heuristic Algorithms","volume":"9","author":"Tan","year":"2021","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1109\/70.345939","article-title":"The MVP sensor planning system for robotic vision tasks","volume":"11","author":"Tarabanis","year":"1995","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1145\/641865.641868","article-title":"View planning for automated three-dimensional object reconstruction and inspection","volume":"35","author":"Scott","year":"2003","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/s11263-012-0587-7","article-title":"Modeling Coverage in Camera Networks: A Survey","volume":"101","author":"Mavrinac","year":"2013","journal-title":"Int. J. Comput. Vis."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.asoc.2018.10.025","article-title":"On the optimal placement of cameras for surveillance and the underlying set cover problem","volume":"74","author":"Kritter","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_11","unstructured":"Scott, W.R. (2002). Performance-Oriented View Planning for Automated Object Reconstruction. [Ph.D. Thesis, University of Ottawa]."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1109\/34.3905","article-title":"Automatic sensor placement from vision task requirements","volume":"10","author":"Cowan","year":"1988","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","unstructured":"Cowan, C.K., and Bergman, A. (1989, January 14\u201319). Determining the camera and light source location for a visual task. Proceedings of the 1989 International Conference on Robotics and Automation, Scottsdale, AZ, USA."},{"key":"ref_14","unstructured":"Tarabanis, K., and Tsai, R.Y. (1992, January 15\u201318). Computing occlusion-free viewpoints. Proceedings of the 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Champaign, IL, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1109\/34.485556","article-title":"Computing occlusion-free viewpoints","volume":"18","author":"Tarabanis","year":"1996","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1177\/02783649922066204","article-title":"Computing Camera Viewpoints in an Active Robot Work Cell","volume":"18","author":"Abrams","year":"1999","journal-title":"Int. J. Robot. Res."},{"key":"ref_17","unstructured":"Reed, M. (1998). Solid Model Acquisition from Range Imagery. [Ph.D. Thesis, Columbia University]."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1460","DOI":"10.1109\/34.895979","article-title":"Constraint-based sensor planning for scene modeling","volume":"22","author":"Reed","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1006\/cviu.1995.1032","article-title":"IVIS: An integrated volumetric inspection system","volume":"61","author":"Tarbox","year":"1994","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1006\/cviu.1995.1007","article-title":"Planning for complete sensor coverage in inspection","volume":"61","author":"Tarbox","year":"1995","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1007\/s00138-007-0110-2","article-title":"Model-based view planning","volume":"20","author":"Scott","year":"2009","journal-title":"Mach. Vis. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"024009","DOI":"10.1088\/2051-672X\/4\/2\/024009","article-title":"View and sensor planning for multi-sensor surface inspection","volume":"4","author":"Gronle","year":"2016","journal-title":"Surf. Topogr. Metrol. Prop."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Jing, W., Polden, J., Goh, C.F., Rajaraman, M., Lin, W., and Shimada, K. (2017, January 24\u201328). Sampling-based coverage motion planning for industrial inspection application with redundant robotic system. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206411"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1007\/s00138-020-01116-y","article-title":"Feature-Driven Viewpoint Placement for Model-Based Surface Inspection","volume":"32","author":"Mosbach","year":"2021","journal-title":"Mach. Vis. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1109\/70.563641","article-title":"Model-based planning of optimal sensor placements for inspection","volume":"13","author":"Trucco","year":"1997","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1016","DOI":"10.1109\/34.799908","article-title":"A solution to the next best view problem for automated surface acquisition","volume":"21","author":"Pito","year":"1999","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","unstructured":"St\u00f6\u00dfel, D., Hanheide, M., Sagerer, G., Kr\u00fcger, L., and Ellenrieder, M. (September, January 30). Feature and viewpoint selection for industrial car assembly. Proceedings of the Joint Pattern Recognition Symposium, T\u00fcbingen, Germany."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ellenrieder, M.M., Kr\u00fcger, L., St\u00f6\u00dfel, D., and Hanheide, M. (2005, January 19\u201322). A versatile model-based visibility measure for geometric primitives. Proceedings of the Scandinavian Conference on Image Analysis, Joensuu, Finland.","DOI":"10.1007\/11499145_68"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12008-012-0160-1","article-title":"Off-line view planning for the inspection of mechanical parts","volume":"7","author":"Raffaeli","year":"2013","journal-title":"Int. J. Interact. Des. Manuf. (IJIDeM)"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.measurement.2016.07.067","article-title":"Sensor planning system for fringe projection scanning of sheet metal parts","volume":"94","author":"Brandejs","year":"2016","journal-title":"Measurement"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/S0736-5845(99)00060-5","article-title":"Automated inspection planning of free-form shape parts by laser scanning","volume":"16","author":"Lee","year":"2000","journal-title":"Robot.-Comput.-Integr. Manuf."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1115\/1.2410023","article-title":"3D Digitizing Strategy Planning Approach Based on a CAD Model","volume":"7","author":"Derigent","year":"2006","journal-title":"J. Comput. Inf. Sci. Eng."},{"key":"ref_33","unstructured":"Tekouo Moutchiho, W.B. (2012). A New Programming Approach for Robot-Based Flexible Inspection Systems. [Ph.D. Thesis, Technical University of Munich]."},{"key":"ref_34","unstructured":"Park, J., Bhat, P.C., and Kak, A.C. (2006). Workshop on Distributed Smart Cameras in conjunction with ACM SenSys, Association for Computing Machinery."},{"key":"ref_35","unstructured":"Souvaine, D.L. (2001). Proceedings of the Seventeenth Annual Symposium on Computational Geometry-SCG \u201901, Association for Computing Machinery."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1109\/TSMCB.2003.817031","article-title":"Automatic sensor placement for model-based robot vision","volume":"34","author":"Chen","year":"2004","journal-title":"IEEE Trans. Syst. Man Cybern. Part Cybern. Publ. IEEE Syst. Man Cybern. Soc."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.cviu.2006.06.005","article-title":"Automated camera layout to satisfy task-specific and floor plan-specific coverage requirements","volume":"103","author":"Erdem","year":"2006","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1109\/TMECH.2014.2318729","article-title":"Semiautomatic Model-Based View Planning for Active Triangulation 3-D Inspection Systems","volume":"20","author":"Mavrinac","year":"2015","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"101843","DOI":"10.1016\/j.rcim.2019.101843","article-title":"Coverage path planning with targetted viewpoint sampling for robotic free-form surface inspection","volume":"61","author":"Glorieux","year":"2020","journal-title":"Robot.-Comput.-Integr. Manuf."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1109\/TSMCB.2005.846907","article-title":"Vision sensor planning for 3-D model acquisition","volume":"35","author":"Chen","year":"2005","journal-title":"IEEE Trans. Syst. Man Cybern. Part Cybern. Publ. IEEE Syst. Man Cybern. Soc."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"159","DOI":"10.5772\/58759","article-title":"Volumetric Next-best-view Planning for 3D Object Reconstruction with Positioning Error","volume":"11","author":"Sucar","year":"2014","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s11554-013-0386-6","article-title":"Efficient next-best-scan planning for autonomous 3D surface reconstruction of unknown objects","volume":"10","author":"Kriegel","year":"2015","journal-title":"J.-Real-Time Image Process."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"5323","DOI":"10.1109\/LRA.2020.3007445","article-title":"Multi-Sensor Next-Best-View Planning as Matroid-Constrained Submodular Maximization","volume":"5","author":"Lauri","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Siciliano, B., and Khatib, O. (2016). Springer Handbook of Robotics, Springer International Publishing.","DOI":"10.1007\/978-3-319-32552-1"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Beyerer, J., Puente Le\u00f3n, F., and Frese, C. (2016). Machine Vision, Springer.","DOI":"10.1007\/978-3-662-47794-6"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1007\/s00138-017-0839-1","article-title":"Automatic inspection of aeronautic components","volume":"28","author":"Biagio","year":"2020","journal-title":"Mach. Vis. Appl."},{"key":"ref_47","unstructured":"Bertagnolli, F. (2006). Robotergest\u00fctzte Automatische Digitalisierung von Werkst\u00fcckgeometrien Mittels Optischer Streifenprojektion, Messtechnikund Sensorik, Shaker."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"111","DOI":"10.3722\/cadaps.2013.111-127","article-title":"Context Dependent Automatic View Planning: The Inspection of Mechanical Components","volume":"10","author":"Raffaeli","year":"2013","journal-title":"Comput. Aided Des. Appl."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1016\/0377-2217(95)00159-X","article-title":"A genetic algorithm for the set covering problem","volume":"94","author":"Beasley","year":"1996","journal-title":"Eur. J. Oper. Res."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s11263-007-0057-9","article-title":"A General Method for Sensor Planning in Multi-Sensor Systems: Extension to Random Occlusion","volume":"76","author":"Mittal","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Kaba, M.D., Uzunbas, M.G., and Lim, S.N. (2017, January 21\u201326). A Reinforcement Learning Approach to the View Planning Problem. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.541"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Cox, I.J., and Wilfong, G.T. (1990). Autonomous Robot Vehicles, Springer.","DOI":"10.1007\/978-1-4613-8997-2"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Latombe, J.C. (1991). Robot Motion Planning, Springer. The Springer International Series in Engineering and Computer Science, Robotics.","DOI":"10.1007\/978-1-4615-4022-9"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"LaValle, S.M. (2006). Planning Algorithms, Cambridge University Press.","DOI":"10.1017\/CBO9780511546877"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Ghallab, M., Nau, D.S., and Traverso, P. (2004). Automated Planning, Elsevier Science. Morgan Kaufmann and Oxford.","DOI":"10.1016\/B978-155860856-6\/50021-1"},{"key":"ref_56","unstructured":"Fr\u00fchwirth, T., and Abdennadher, S. (2011). Essentials of Constraint Programming, Springer. Cognitive Technologies."},{"key":"ref_57","unstructured":"Trimesh (2023, July 16). Trimesh Github Repository. Available online: https:\/\/github.com\/mikedh\/trimesh."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/0146-664X(82)90169-1","article-title":"Ray casting for modeling solids","volume":"18","author":"Roth","year":"1982","journal-title":"Comput. Graph. Image Process."},{"key":"ref_59","unstructured":"Glassner, A.S. (1989). An Introduction to Ray Tracing, Academic."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1109\/TIT.1983.1056714","article-title":"On the shape of a set of points in the plane","volume":"29","author":"Edelsbrunner","year":"1983","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_61","unstructured":"Kazhdan, M., Bolitho, M., and Hoppe, H. (2006, January 26\u201328). Poisson Surface Reconstruction. Proceedings of the Fourth Eurographics Symposium on Geometry Processing, Cagliari, Italy."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"109963","DOI":"10.1016\/j.measurement.2021.109963","article-title":"Registration strategy of point clouds based on region-specific projections and virtual structures for robot-based inspection systems","volume":"185","author":"Bauer","year":"2021","journal-title":"Measurement"},{"key":"ref_63","first-page":"5","article-title":"ROS: An open-source Robot Operating System","volume":"Volume 3","author":"Quigley","year":"2009","journal-title":"Proceedings of the ICRA Workshop on Open Source Software"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1016\/j.procir.2019.02.076","article-title":"Concept of a learning knowledge-based system for programming industrial robots","volume":"79","author":"Bauer","year":"2019","journal-title":"Procedia CIRP"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Maga\u00f1a, A., Gebel, S., Bauer, P., and Reinhart, G. (2020, January 8\u201311). Knowledge-Based Service-Oriented System for the Automated Programming of Robot-Based Inspection Systems. Proceedings of the 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Vienna, Austria.","DOI":"10.1109\/ETFA46521.2020.9212033"},{"key":"ref_66","first-page":"1","article-title":"Mesh arrangements for solid geometry","volume":"35","author":"Zhou","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2601097.2601199","article-title":"Embree","volume":"33","author":"Wald","year":"2014","journal-title":"ACM Trans. Graph."},{"key":"ref_68","unstructured":"Unity Technologies (2023, July 16). Unity. Available online: https:\/\/unity.com."},{"key":"ref_69","unstructured":"Bischoff, M. (2023, July 16). ROS #. Available online: https:\/\/github.com\/MartinBischoff\/ros-sharp."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Maga\u00f1a, A., Wu, H., Bauer, P., and Reinhart, G. (2020, January 8\u201311). PoseNetwork: Pipeline for the Automated Generation of Synthetic Training Data and CNN for Object Detection, Segmentation, and Orientation Estimation. Proceedings of the 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Vienna, Austria.","DOI":"10.1109\/ETFA46521.2020.9212064"}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/12\/4\/108\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:19:42Z","timestamp":1760127582000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/12\/4\/108"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,26]]},"references-count":70,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["robotics12040108"],"URL":"https:\/\/doi.org\/10.3390\/robotics12040108","relation":{},"ISSN":["2218-6581"],"issn-type":[{"type":"electronic","value":"2218-6581"}],"subject":[],"published":{"date-parts":[[2023,7,26]]}}}