{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T14:16:55Z","timestamp":1776694615289,"version":"3.51.2"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"3-4","license":[{"start":{"date-parts":[[2021,10,16]],"date-time":"2021-10-16T00:00:00Z","timestamp":1634342400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,16]],"date-time":"2021-10-16T00:00:00Z","timestamp":1634342400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Center of Competence in Research (NCCR) in Digital Fabrication","award":["#51NF40-182887"],"award-info":[{"award-number":["#51NF40-182887"]}]},{"DOI":"10.13039\/501100013348","name":"Innosuisse - Schweizerische Agentur f\u00fcr Innovationsf\u00f6rderung","doi-asserted-by":"publisher","award":["#35019.1 IP-ENG"],"award-info":[{"award-number":["#35019.1 IP-ENG"]}],"id":[{"id":"10.13039\/501100013348","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003006","name":"ETH Zurich","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003006","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Constr Robot"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper, we tackle the challenge of detection and accurate digital reconstruction of steel rebar meshes using a set of industrial depth cameras. A construction example under investigation in this paper is robotic concrete spraying, where material is sprayed onto double-curved single layered rebar meshes. Before the spraying process can start, the location and geometry of the rebar mesh needs to be accurately know. We present an automatic image-based processing approach of depth images for grid point extraction at an accuracy of a few mm. Furthermore, we propose a sequence of execution steps in a robotic setup, including the hand\u2013eye calibration, which enables the direct georeferencing of multiple data sets acquired from various poses into a common coordinate system. With the proposed approach we are able to digitally reconstruct a mesh of an unknown geometry in under 10\u00a0min with an accuracy better than 5\u00a0mm. The digitally reconstructed mesh allows for computation of material needed for its construction, enabling sustainable use of concrete in digital fabrication. The accurately reconstructed digital mesh, generated based on the proposed approach in this paper, is the input for the following spraying step, allowing for generation of accurate spray trajectories.<\/jats:p>","DOI":"10.1007\/s41693-021-00063-y","type":"journal-article","created":{"date-parts":[[2021,10,16]],"date-time":"2021-10-16T20:27:10Z","timestamp":1634416030000},"page":"191-202","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Depth-camera-based rebar detection and digital reconstruction for robotic concrete spraying"],"prefix":"10.1007","volume":"5","author":[{"given":"Valens","family":"Frangez","sequence":"first","affiliation":[]},{"given":"Ena","family":"Lloret-Fritschi","sequence":"additional","affiliation":[]},{"given":"Nizar","family":"Taha","sequence":"additional","affiliation":[]},{"given":"Fabio","family":"Gramazio","sequence":"additional","affiliation":[]},{"given":"Matthias","family":"Kohler","sequence":"additional","affiliation":[]},{"given":"Andreas","family":"Wieser","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,10,16]]},"reference":[{"key":"63_CR1","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1109\/TPAMI.2008.214","volume":"31","author":"A Albarelli","year":"2009","unstructured":"Albarelli A, Rodol\u00e0 E, Torsello A (2009) Robust camera calibration using inaccurate targets. IEEE Trans Pattern Anal Mach Intell 31:376\u2013383","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"63_CR2","unstructured":"Avetisyan R, Willert M, Ohl S, Staadt O (2014) Calibration of depth camera arrays. In: Proceedings of SIGRAD 2014, Visual Computing, June 12-13, 2014, G\u00f6teborg, Sweden, no. 106. Link\u00f6ping University Electronic Press, pp 41\u201348"},{"key":"63_CR3","unstructured":"Beaupre D (1994) Rheology of high performance shotcrete. Ph.D. dissertation. University of British Columbia"},{"issue":"11","key":"63_CR4","first-page":"120","volume":"25","author":"G Bradski","year":"2000","unstructured":"Bradski G (2000) The OpenCV library. Dr. Dobb\u2019s J Softw Tools Prof Programmer 25(11):120\u2013123","journal-title":"Dr. Dobb\u2019s J Softw Tools Prof Programmer"},{"issue":"14","key":"63_CR5","doi-asserted-by":"publisher","first-page":"4508","DOI":"10.1109\/JSEN.2017.2703829","volume":"17","author":"M Carfagni","year":"2017","unstructured":"Carfagni M, Furferi R, Governi L, Servi M, Uccheddu F, Volpe Y (2017) On the performance of the intel sr300 depth camera: metrological and critical characterization. IEEE Sens J 17(14):4508\u20134519","journal-title":"IEEE Sens J"},{"issue":"4","key":"63_CR6","doi-asserted-by":"publisher","first-page":"615","DOI":"10.3390\/rs13040615","volume":"13","author":"S Chaudhry","year":"2021","unstructured":"Chaudhry S, Salido-Monz\u00fa D, Wieser A (2021) A modeling approach for predicting the resolution capability in terrestrial laser scanning. Remote Sens 13(4):615","journal-title":"Remote Sens"},{"issue":"3","key":"63_CR7","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1117\/1.482677","volume":"8","author":"ML Comer","year":"1999","unstructured":"Comer ML, Delp EJ III (1999) Morphological operations for color image processing. J Electron Imaging 8(3):279\u2013289","journal-title":"J Electron Imaging"},{"key":"63_CR8","doi-asserted-by":"crossref","unstructured":"Deng G, Wu Y (2018) Double lane line edge detection method based on constraint conditions hough transform. In: 2018 17th International Symposium on Distributed Computing and Applications for Business Engineering and Science (DCABES). IEEE, pp 107\u2013110","DOI":"10.1109\/DCABES.2018.00037"},{"issue":"1","key":"63_CR9","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1007\/s41693-019-00020-w","volume":"3","author":"K D\u00f6rfler","year":"2019","unstructured":"D\u00f6rfler K, Hack N, Sandy T, Giftthaler M, Lussi M, Walzer AN, Buchli J, Gramazio F, Kohler M (2019) Mobile robotic fabrication beyond factory conditions: case study mesh mould wall of the dfab house. Construct Robot 3(1):53\u201367","journal-title":"Construct Robot"},{"key":"63_CR10","doi-asserted-by":"crossref","unstructured":"Frangez V, Salido-Monz\u00fa D, Wieser A (2020) Depth-camera-based in-line evaluation of surface geometry and material classification for robotic spraying. In: 37th International Symposium on Automation and Robotics in Construction (ISARC 2020)(virtual). International Association for Automation and Robotics in Construction, pp 693\u2013702","DOI":"10.22260\/ISARC2020\/0097"},{"key":"63_CR11","unstructured":"Friedli E, Wieser A (2016) Identification of stable surfaces within point clouds for areal deformation monitoring. In: Proc. of 3rd Joint International Symposium on Deformation Monitoring (JISDM)"},{"issue":"1","key":"63_CR12","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s41693-017-0003-5","volume":"1","author":"M Giftthaler","year":"2017","unstructured":"Giftthaler M, Sandy T, D\u00f6rfler K, Brooks I, Buckingham M, Rey G, Kohler M, Gramazio F, Buchli J (2017) Mobile robotic fabrication at 1: 1 scale: the in situ fabricator. Construct Robot 1(1):3\u201314","journal-title":"Construct Robot"},{"key":"63_CR13","first-page":"1","volume":"19","author":"N Hack","year":"2017","unstructured":"Hack N, Wangler T, Mata-Falc\u00f3n J, D\u00f6rfler K, Kumar N, Walzer AN, Graser K, Reiter L, Richner H, Buchli J et al (2017) Mesh mould: an on site, robotically fabricated, functional formwork. Second Conc Innov Conf (2nd CIC) 19:1\u201310","journal-title":"Second Conc Innov Conf (2nd CIC)"},{"key":"63_CR14","volume-title":"Time-of-flight cameras: principles, methods and applications","author":"M Hansard","year":"2012","unstructured":"Hansard M, Lee S, Choi O, Horaud RP (2012) Time-of-flight cameras: principles, methods and applications. Springer, Berlin"},{"issue":"7","key":"63_CR15","doi-asserted-by":"publisher","first-page":"1005","DOI":"10.1007\/s00138-016-0784-4","volume":"27","author":"R Horaud","year":"2016","unstructured":"Horaud R, Hansard M, Evangelidis G, M\u00e9nier C (2016) An overview of depth cameras and range scanners based on time-of-flight technologies. Mach Vis Appl 27(7):1005\u20131020","journal-title":"Mach Vis Appl"},{"issue":"1","key":"63_CR16","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/S0734-189X(88)80033-1","volume":"44","author":"J Illingworth","year":"1988","unstructured":"Illingworth J, Kittler J (1988) A survey of the hough transform. Comput Vis Graph Image Process 44(1):87\u2013116","journal-title":"Comput Vis Graph Image Process"},{"issue":"3","key":"63_CR17","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1007\/s41693-020-00043-8","volume":"4","author":"SE Jenny","year":"2020","unstructured":"Jenny SE, Lloret-Fritschi E, Gramazio F, Kohler M (2020) Crafting plaster through continuous mobile robotic fabrication on-site. Construct Robot 4(3):261\u2013271","journal-title":"Construct Robot"},{"key":"63_CR18","unstructured":"Kahn S, Haumann D, Willert V (2014) Hand-eye calibration with a depth camera: 2d or 3d? In: 2014 International Conference on Computer Vision Theory and Applications (VISAPP), vol 3. IEEE, pp 481\u2013489"},{"key":"63_CR19","doi-asserted-by":"crossref","unstructured":"Kamal S, Chawla SS, Goel N (2015) Detection of sudoku puzzle using image processing and solving by backtracking, simulated annealing and genetic algorithms: A comparative analysis. In: 2015 third international conference on image information processing (ICIIP). IEEE, pp 179\u2013184","DOI":"10.1109\/ICIIP.2015.7414762"},{"key":"63_CR20","doi-asserted-by":"publisher","first-page":"103077","DOI":"10.1016\/j.autcon.2020.103077","volume":"112","author":"M-K Kim","year":"2020","unstructured":"Kim M-K, Thedja JPP, Wang Q (2020) Automated dimensional quality assessment for formwork and rebar of reinforced concrete components using 3d point cloud data. Autom Construct 112:103077","journal-title":"Autom Construct"},{"key":"63_CR21","doi-asserted-by":"publisher","first-page":"106071","DOI":"10.1016\/j.cemconres.2020.106071","volume":"134","author":"E Lloret-Fritschi","year":"2020","unstructured":"Lloret-Fritschi E, Wangler T, Gebhard L, Mata-Falc\u00f3n J, Mantellato S, Scotto F, Burger J, Szabo A, Ruffray N, Reiter L et al (2020) From smart dynamic casting to a growing family of digital casting systems. Cement Concr Res 134:106071","journal-title":"Cement Concr Res"},{"issue":"4","key":"63_CR22","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1109\/MRA.2005.1577023","volume":"12","author":"E Marchand","year":"2005","unstructured":"Marchand E, Spindler F, Chaumette F (2005) Visp for visual servoing: a generic software platform with a wide class of robot control skills. IEEE Robot Automat Mag 12(4):40\u201352","journal-title":"IEEE Robot Automat Mag"},{"issue":"5","key":"63_CR23","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1111\/mice.12667","volume":"36","author":"Z Miao","year":"2021","unstructured":"Miao Z, Ji X, Okazaki T, Takahashi N (2021) Pixel-level multicategory detection of visible seismic damage of reinforced concrete components. Comput Aid Civil Infrastruct Eng 36(5):620\u2013637","journal-title":"Comput Aid Civil Infrastruct Eng"},{"key":"63_CR24","unstructured":"ABB Robotics (2021) Product specification - IRB 4600. https:\/\/new.abb.com\/products\/robotics\/industrial-robots\/irb-4600. Accessed 31 Mar 2021"},{"issue":"21","key":"63_CR25","doi-asserted-by":"publisher","first-page":"2567","DOI":"10.3390\/rs11212567","volume":"11","author":"A S\u00e1nchez-Rodr\u00edguez","year":"2019","unstructured":"S\u00e1nchez-Rodr\u00edguez A, Soil\u00e1n M, Cabaleiro M, Arias P (2019) Automated inspection of railway tunnels\u2019 power line using lidar point clouds. Remote Sens 11(21):2567","journal-title":"Remote Sens"},{"key":"63_CR26","doi-asserted-by":"crossref","unstructured":"Schuler B, Sawodny O (2019) Spray pattern analysis using wet-mix concrete for model based process control towards automated construction. In: 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE). IEEE, pp 661\u2013666","DOI":"10.1109\/COASE.2019.8842853"},{"key":"63_CR27","doi-asserted-by":"crossref","unstructured":"Studio E (2017) Robotic fabrication techniques for material of unknown geometry. In: Humanizing Digital Reality: Design Modelling Symposium Paris 2017. Springer, p 311","DOI":"10.1007\/978-981-10-6611-5_27"},{"key":"63_CR28","doi-asserted-by":"crossref","unstructured":"Taha N, Walzer AN, Ruangjun J, B\u00fcrgin T, D\u00f6rfler K, Lloret-Fritschi E, Gramazio F, Kohler M (2019) Robotic aerocrete\u2013a novel robotic spraying and surface treatment technology for the production of slender reinforced concrete elements. In: Architecture in the Age of the 4th Industrial Revolution\u2013Proceedings of the 37th eCAADe and 23rd SIGraDi Conference, vol 3. CumInCAD, pp 245\u2013254","DOI":"10.5151\/proceedings-ecaadesigradi2019_675"},{"key":"63_CR29","unstructured":"Lucid Vision Labs (2019) Time-of-flight forged ahead: design tips to boost 3D performance and cut integration time and cost, user manual, v.1.3, 18.10.2019"},{"issue":"3","key":"63_CR30","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1109\/70.34770","volume":"5","author":"RY Tsai","year":"1989","unstructured":"Tsai RY, Lenz RK et al (1989) A new technique for fully autonomous and efficient 3d robotics hand\/eye calibration. IEEE Trans Robot Autom 5(3):345\u2013358","journal-title":"IEEE Trans Robot Autom"},{"key":"63_CR31","doi-asserted-by":"crossref","unstructured":"van der Walt S, Sch\u00f6nberger JL, Nunez-Iglesias J, Boulogne F, Warner JD, Yager N, Gouillart E, Yu T (2014) scikit-image: image processing in Python. PeerJ","DOI":"10.7287\/peerj.preprints.336v1"},{"issue":"9","key":"63_CR32","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1111\/mice.12293","volume":"32","author":"Q Wang","year":"2017","unstructured":"Wang Q, Cheng JC, Sohn H (2017) Automated estimation of reinforced precast concrete rebar positions using colored laser scan data. Comput Aid Civil Infrastruct Eng 32(9):787\u2013802","journal-title":"Comput Aid Civil Infrastruct Eng"},{"issue":"11","key":"63_CR33","doi-asserted-by":"publisher","first-page":"6200","DOI":"10.1109\/JSEN.2020.2975538","volume":"20","author":"Z Wang","year":"2020","unstructured":"Wang Z, Fan J, Jing F, Deng S, Zheng M, Tan M (2020) An efficient calibration method of line structured light vision sensor in robotic eye-in-hand system. IEEE Sens J 20(11):6200\u20136208","journal-title":"IEEE Sens J"},{"key":"63_CR34","doi-asserted-by":"publisher","first-page":"67","DOI":"10.21809\/rilemtechlett.2016.16","volume":"1","author":"T Wangler","year":"2016","unstructured":"Wangler T, Lloret E, Reiter L, Hack N, Gramazio F, Kohler M, Bernhard M, Dillenburger B, Buchli J, Roussel N et al (2016) Digital concrete: opportunities and challenges. RILEM Tech Lett 1:67\u201375","journal-title":"RILEM Tech Lett"},{"key":"63_CR35","doi-asserted-by":"crossref","unstructured":"Wang Z, Zhen Z, Lin Z, Wen T, Guo C, Che H (2020) An adaptive industrial robot spraying planning and control system. In: IECON 2020 The 46th Annual Conference of the IEEE Industrial Electronics Society, IEEE, pp 4739\u20134743","DOI":"10.1109\/IECON43393.2020.9254323"},{"issue":"6","key":"63_CR36","doi-asserted-by":"publisher","first-page":"2966","DOI":"10.1109\/TIM.2019.2930710","volume":"69","author":"J Wu","year":"2019","unstructured":"Wu J, Sun Y, Wang M, Liu M (2019) Hand-eye calibration: 4-d procrustes analysis approach. IEEE Trans Instrum Measure 69(6):2966\u20132981","journal-title":"IEEE Trans Instrum Measure"},{"issue":"3","key":"63_CR37","doi-asserted-by":"publisher","first-page":"e2313","DOI":"10.1002\/stc.2313","volume":"26","author":"Y Xu","year":"2019","unstructured":"Xu Y, Wei S, Bao Y, Li H (2019) Automatic seismic damage identification of reinforced concrete columns from images by a region-based deep convolutional neural network. Struct Control Health Monit 26(3):e2313","journal-title":"Struct Control Health Monit"},{"key":"63_CR38","doi-asserted-by":"crossref","unstructured":"Yang L, Cao Q, Lin M, Zhang H, Ma Z (2018) Robotic hand-eye calibration with depth camera: A sphere model approach. In: 2018 4th International Conference on Control, Automation and Robotics (ICCAR). IEEE, pp 104\u2013110","DOI":"10.1109\/ICCAR.2018.8384652"},{"key":"63_CR39","unstructured":"Zhou Q-Y, Park J, Koltun V (2018) Open3d: A modern library for 3d data processing. arXiv preprint arXiv:1801.09847"}],"container-title":["Construction Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41693-021-00063-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41693-021-00063-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41693-021-00063-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,18]],"date-time":"2022-03-18T09:58:59Z","timestamp":1647597539000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41693-021-00063-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,16]]},"references-count":39,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["63"],"URL":"https:\/\/doi.org\/10.1007\/s41693-021-00063-y","relation":{},"ISSN":["2509-811X","2509-8780"],"issn-type":[{"value":"2509-811X","type":"print"},{"value":"2509-8780","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,16]]},"assertion":[{"value":"8 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 October 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}