{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:39:59Z","timestamp":1740123599285,"version":"3.37.3"},"reference-count":20,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T00:00:00Z","timestamp":1658448000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T00:00:00Z","timestamp":1658448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Vis"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In April 2016, a massive earthquake with a magnitude of 7.3 struck Kumamoto region, Japan, causing major devastation. One of the structures that were damaged in Kumamoto was Kumamoto Castle, a cultural asset of great significance in Japan. The stone retaining wall \u201cishigaki\u201d that formed the foundation of the castle collapsed, and the superstructure was destroyed. The number of stones is estimated to be more than 70,000, and restoration work is anticipated to take more than 20 years. Since each of the stones is an important cultural asset, the broken stone structure needed to be restored to its original state in order not to lose its cultural value forever. In addition, the fallen stones need to be returned to their original positions in the ishigakis. In similar cases, non-automatic visual verification was used. However, for Kumamoto Castle, this would have been impossible because a large number of stones were displaced as a result of the collapse. The purpose of this project is to provide support for the restoration work by matching the stones that fell down after the collapse with those before the collapse using information technology, such as computer vision and optimization technologies. Specifically, we captured photographic images of the stones before and after the collapse to match them. The technical contributions of this study are as follows: (a) To estimate the scale and surface orientation of the stones, we exploit 3D model construction from the images. (b) To solve the jigsaw-puzzle-like problem of reassembling the stone fragments, we exploit the combination of a customized iterative closest point (ICP) algorithm for shape position matching and an assignment algorithm to find the best pairs of stones before and after the collapse by using the matching degree obtained from ICP. Here, only the 2D shape of the stones before the collapse can be used due to the small number of photos available. In contrast, a detailed 3D shape can be obtained from the stones after their collapse. We matched these asymmetric data in 2D and 3D to enable a comprehensive reconstruction. (c) We developed a user-friendly graphical user interface system that was used by actual masons without special knowledge. The developed system was used to match the ishigaki of a turret, Iidamaru. As a result, we succeeded in identifying 337 stones, or approximately 90% of the 370 images. These results are expected to be useful for and were used as a blueprint during actual restoration work.<\/jats:p>","DOI":"10.1007\/s11263-022-01630-8","type":"journal-article","created":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T14:04:07Z","timestamp":1658498647000},"page":"2286-2304","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["ISHIGAKI Retrieval System Using 3D Shape Matching and Combinatorial Optimization"],"prefix":"10.1007","volume":"130","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3414-1085","authenticated-orcid":false,"given":"Gou","family":"Koutaki","sequence":"first","affiliation":[]},{"given":"Sakino","family":"Ando","sequence":"additional","affiliation":[]},{"given":"Keiichiro","family":"Shirai","sequence":"additional","affiliation":[]},{"given":"Tsuyoshi","family":"Kishigami","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,7,22]]},"reference":[{"key":"1630_CR1","doi-asserted-by":"publisher","unstructured":"Alcantarilla, P. F., Nuevo, J., & Bartoli, A. (2013). Fast explicit diffusion for accelerated features in nonlinear scale spaces. In Proceedings of British Machine Vision Conference (BMVC) (pp. 1\u201311). https:\/\/doi.org\/10.5244\/C.27.13","DOI":"10.5244\/C.27.13"},{"key":"1630_CR2","doi-asserted-by":"publisher","unstructured":"Ando, S., Koutaki, G., & Shirai, K. (2019) ISHIGAKI retrieval through combinatorial optimization. In Proceedings of Workshop on Structuring and Understanding Multimedia HeritAge Contents (SUMAC) (pp. 69\u201374). https:\/\/doi.org\/10.1145\/3347317.3357241","DOI":"10.1145\/3347317.3357241"},{"key":"1630_CR3","unstructured":"Collins, B., Williams, D., Haak, R., et\u00a0al. (1993) The Dresden Frauenkirche\u2014rebuilding the past. In Proceedings of CAA Conference (pp. 19\u201324)."},{"issue":"1","key":"1630_CR4","doi-asserted-by":"publisher","first-page":"9","DOI":"10.2307\/2312726","volume":"69","author":"D Gale","year":"1962","unstructured":"Gale, D., & Shapley, L. S. (1962). College admissions and the stability of marriage. American Mathematical Monthly, 69(1), 9\u201315. https:\/\/doi.org\/10.2307\/2312726.","journal-title":"American Mathematical Monthly"},{"issue":"3","key":"1630_CR5","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1145\/1141911.1141925","volume":"25","author":"QX Huang","year":"2006","unstructured":"Huang, Q. X., Fl\u00f6ry, S., Gelfand, N., et al. (2006). Reassembling fractured objects by geometric matching. ACM Transactions on Graphics, 25(3), 569\u2013578.","journal-title":"ACM Transactions on Graphics"},{"issue":"1","key":"1630_CR6","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/s11263-007-0039-y","volume":"75","author":"K Ikeuchi","year":"2007","unstructured":"Ikeuchi, K., Oishi, T., Takamatsu, J., et al. (2007). The great Buddha project: Digitally archiving, restoring, and analyzing cultural heritage objects. International Journal of Computer Vision (IJCV), 75(1), 189\u2013208. https:\/\/doi.org\/10.1007\/s11263-007-0039-y.","journal-title":"International Journal of Computer Vision (IJCV)"},{"key":"1630_CR7","doi-asserted-by":"crossref","unstructured":"Kawakami, R., Kamei, I., Han, C., et\u00a0al. (2020). OUR Shurijo: Shurijo castle digital reconstruction project. In International Conference on 3D Vision (3DV) (p.\u00a01).","DOI":"10.4287\/jsprs.60.118"},{"issue":"3","key":"1630_CR8","doi-asserted-by":"publisher","first-page":"515","DOI":"10.1007\/s00199-013-0769-8","volume":"55","author":"F Kojima","year":"2004","unstructured":"Kojima, F. (2004). The Boston school-choice mechanism: An axiomatic approach. Economic Theory, 55(3), 515\u2013522. https:\/\/doi.org\/10.1007\/s00199-013-0769-8.","journal-title":"Economic Theory"},{"issue":"1\u20132","key":"1630_CR9","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1002\/nav.3800020109","volume":"2","author":"HW Kuhn","year":"1955","unstructured":"Kuhn, H. W., & Yaw, B. (1955). The Hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2(1\u20132), 83\u201397. https:\/\/doi.org\/10.1002\/nav.3800020109.","journal-title":"Naval Research Logistics Quarterly"},{"issue":"2","key":"1630_CR10","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","volume":"60","author":"DG Lowe","year":"2004","unstructured":"Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (IJCV), 60(2), 91\u2013110. https:\/\/doi.org\/10.1023\/B:VISI.0000029664.99615.94.","journal-title":"International Journal of Computer Vision (IJCV)"},{"key":"1630_CR11","unstructured":"O\u2019Grady, D. (2010). Kumamoto castle Japanese castle explorer."},{"key":"1630_CR12","doi-asserted-by":"crossref","unstructured":"Papaioannou, G., Schreck, T., Andreadis, A., et\u00a0al. (2017). From reassembly to object completion: A complete systems pipeline.","DOI":"10.1145\/3009905"},{"issue":"8","key":"1630_CR13","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1016\/S0950-0618(03)00062-X","volume":"17","author":"F Pohle","year":"2003","unstructured":"Pohle, F., & Jager, W. (2003). Material properties of historical masonry of the Frauenkirche and the masonry guideline for reconstruction. Construction and Building Materials, 17(8), 651\u2013667. https:\/\/doi.org\/10.1016\/S0950-0618(03)00062-X.","journal-title":"Construction and Building Materials"},{"key":"1630_CR14","doi-asserted-by":"crossref","unstructured":"Sandron, D., & Tallon, A. (2020). Notre Dame Cathedral: Nine Centuries of History, English (1st ed.). Pennsylvania State Univ Press.","DOI":"10.1515\/9780271087726"},{"key":"1630_CR15","doi-asserted-by":"publisher","unstructured":"Take, Y., Tokunaga, S., Okajima, H., et\u00a0al. (2019). Restoration of stone wall \u201cISHIGAKI\u201d using dropposition information. In Proceedings of Annual Conference on Society Instrument Control Engineers (SICE) (pp. 976\u2013981). https:\/\/doi.org\/10.23919\/SICE.2019.8859910","DOI":"10.23919\/SICE.2019.8859910"},{"key":"1630_CR16","doi-asserted-by":"publisher","unstructured":"Take, Y., Tokunaga, S., Okajima, H., et\u00a0al. (2020). A proposal of collation method using nonlinear SVM for restoration of stone wall in Kumamoto castle. In Proceedings of Annual Conference on Society Instrument Control Engineers (SICE) (pp. 888\u2013893). https:\/\/doi.org\/10.23919\/SICE48898.2020.9240393","DOI":"10.23919\/SICE48898.2020.9240393"},{"issue":"1","key":"1630_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5334\/ah.bo","volume":"2","author":"A Tallon","year":"2014","unstructured":"Tallon, A. (2014). Divining proportions in the information age. Architectural Histories, 2(1), 1\u201314. https:\/\/doi.org\/10.5334\/ah.bo.","journal-title":"Architectural Histories"},{"key":"1630_CR18","doi-asserted-by":"crossref","unstructured":"Thuswaldner, B., Fl\u00f6ry, S., Kalasek, R., et\u00a0al. (2009). Digital anastylosis of the octagon in ephesos. Journal on Computing and Cultural Heritage, 2(1).","DOI":"10.1145\/1551676.1551677"},{"key":"1630_CR19","doi-asserted-by":"publisher","unstructured":"Yamasaki, Y., Migita, M., Koutaki, G., et\u00a0al. (2020). Examination and issues of Kumamoto castle Ishigaki region extraction focusing on stone contour features. In Proceedings of International Workshop on Frontiers Computer Vision (IW-FCV) (pp. 43\u201353). https:\/\/doi.org\/10.1007\/978-981-15-4818-5_4","DOI":"10.1007\/978-981-15-4818-5_4"},{"key":"1630_CR20","doi-asserted-by":"crossref","unstructured":"Zhang, K., Yu, W., Manhein, M., et\u00a0al. (2015). 3d fragment reassembly using integrated template guidance and fracture-region matching. In 2015 IEEE International Conference on Computer Vision (ICCV) (pp. 2138\u20132146).","DOI":"10.1109\/ICCV.2015.247"}],"container-title":["International Journal of Computer Vision"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-022-01630-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11263-022-01630-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-022-01630-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,12]],"date-time":"2022-08-12T05:11:36Z","timestamp":1660281096000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11263-022-01630-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,22]]},"references-count":20,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["1630"],"URL":"https:\/\/doi.org\/10.1007\/s11263-022-01630-8","relation":{},"ISSN":["0920-5691","1573-1405"],"issn-type":[{"type":"print","value":"0920-5691"},{"type":"electronic","value":"1573-1405"}],"subject":[],"published":{"date-parts":[[2022,7,22]]},"assertion":[{"value":"14 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 May 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}