{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:27:45Z","timestamp":1776112065555,"version":"3.50.1"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2018,12,4]],"date-time":"2018-12-04T00:00:00Z","timestamp":1543881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,12,31]]},"abstract":"<jats:p>The visual appearance of an object can be disguised by projecting virtual shading as if overwriting the material. However, conventional projection-mapping methods depend on markers on a target or a model of the target shape, which limits the types of targets and the visual quality. In this paper, we focus on the fact that the shading of a virtual material in a virtual scene is mainly characterized by surface normals of the target, and we attempt to realize markerless and modelless projection mapping for material representation. In order to deal with various targets, including static, dynamic, rigid, soft, and fluid objects, without any interference with visible light, we measure surface normals in the infrared region in real time and project material shading with a novel high-speed texturing algorithm in screen space. Our system achieved 500-fps high-speed projection mapping of a uniform material and a tileable-textured material with millisecond-order latency, and it realized dynamic and flexible material representation for unknown objects. We also demonstrated advanced applications and showed the expressive shading performance of our technique.<\/jats:p>","DOI":"10.1145\/3272127.3275045","type":"journal-article","created":{"date-parts":[[2018,11,28]],"date-time":"2018-11-28T19:16:10Z","timestamp":1543432570000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":66,"title":["MIDAS projection"],"prefix":"10.1145","volume":"37","author":[{"given":"Leo","family":"Miyashita","sequence":"first","affiliation":[{"name":"The University of Tokyo"}]},{"given":"Yoshihiro","family":"Watanabe","sequence":"additional","affiliation":[{"name":"Tokyo Institute of Technology"}]},{"given":"Masatoshi","family":"Ishikawa","sequence":"additional","affiliation":[{"name":"The University of Tokyo"}]}],"member":"320","published-online":{"date-parts":[[2018,12,4]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.27.13"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2159516.2159518"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2012.6239192"},{"key":"e_1_2_2_4_1","volume-title":"Proceedings of the International Conference on Pattern Recognition (ICPR '12)","author":"Amano Toshiyuki","year":"2012","unstructured":"Toshiyuki Amano , Kenichi Komura , Takashi Sasabuchi , Shota Nakano , and Shunya Yamashita . 2012 . Appearance Control for Human Material Perception Manipulation . In Proceedings of the International Conference on Pattern Recognition (ICPR '12) . 13--16. Toshiyuki Amano, Kenichi Komura, Takashi Sasabuchi, Shota Nakano, and Shunya Yamashita. 2012. Appearance Control for Human Material Perception Manipulation. In Proceedings of the International Conference on Pattern Recognition (ICPR '12). 13--16."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2657634"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/582828.881324"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/3128975.3129004"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508416"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/965141.563893"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2001.937514"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383654.2383668"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00121877"},{"key":"e_1_2_2_13_1","unstructured":"James J. Gibson. 1950. The Perception of the Visual World. Houghton Mifflin.  James J. Gibson. 1950. The Perception of the Visual World. Houghton Mifflin."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13387"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766953"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4408939"},{"key":"e_1_2_2_17_1","volume-title":"Robot Vision","author":"Horn Berthold K. P.","unstructured":"Berthold K. P. Horn . 1986. Robot Vision . The MIT Press . Berthold K. P. Horn. 1986. Robot Vision. The MIT Press."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00056771"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.25.030371"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.01891.x"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818466.2818485"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.02035.x"},{"key":"e_1_2_2_23_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI '81)","author":"Bruce","unstructured":"Bruce D. Lucas and Takeo Kanade. 1981. An Iterative Image Registration Technique with an Application to Stereo Vision . In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI '81) . 674--679. Bruce D. Lucas and Takeo Kanade. 1981. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI '81). 674--679."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925925"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818133"},{"key":"e_1_2_2_26_1","first-page":"836","article-title":"Image capturing device and image capturing method. (Sept. 16 2014)","volume":"8","author":"Nagamune Yasushi","year":"2014","unstructured":"Yasushi Nagamune . 2014 . Image capturing device and image capturing method. (Sept. 16 2014) . US Patent 8 , 836 ,795. Yasushi Nagamune. 2014. Image capturing device and image capturing method. (Sept. 16 2014). US Patent 8,836,795.","journal-title":"US Patent"},{"key":"e_1_2_2_27_1","volume-title":"Proceedings of the Eurographics, Poster (EG '18)","author":"Nakamura Akihiro","year":"2018","unstructured":"Akihiro Nakamura , Leo Miyashita , Yoshihiro Watanabe , and Masatoshi Ishikawa . 2018 . RIFNOM: 3D Rotaion-Invariant Features on Normal Maps . In Proceedings of the Eurographics, Poster (EG '18) . Akihiro Nakamura, Leo Miyashita, Yoshihiro Watanabe, and Masatoshi Ishikawa. 2018. RIFNOM: 3D Rotaion-Invariant Features on Normal Maps. In Proceedings of the Eurographics, Poster (EG '18)."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2592910"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380174"},{"key":"e_1_2_2_30_1","volume-title":"Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '13)","author":"Okumura Kohei","year":"2013","unstructured":"Kohei Okumura , Hiromasa Oku , and Masatoshi Ishikawa . 2013 . Active Projection AR using High-speed Optical Axis Control and Appearance Estimation Algorithm . In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '13) . 1--6. Kohei Okumura, Hiromasa Oku, and Masatoshi Ishikawa. 2013. Active Projection AR using High-speed Optical Axis Control and Appearance Estimation Algorithm. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '13). 1--6."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344987"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/647653.732300"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2450934"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.275"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/1703435.1703733"},{"key":"e_1_2_2_37_1","volume-title":"Proceedings of the Eurographics, Poster (EG '15)","author":"Sabzevari Reza","year":"2015","unstructured":"Reza Sabzevari , Eren Alak , and Davide Scaramuzza . 2015 . PHENOM: Interest Points on Photometric Normal Maps . In Proceedings of the Eurographics, Poster (EG '15) . Reza Sabzevari, Eren Alak, and Davide Scaramuzza. 2015. PHENOM: Interest Points on Photometric Normal Maps. In Proceedings of the Eurographics, Poster (EG '15)."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2014.04.011"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818111"},{"key":"e_1_2_2_40_1","volume-title":"Proceedings of the Graphics Interface (GI '01)","author":"Sloan Peter-Pike J.","year":"2001","unstructured":"Peter-Pike J. Sloan , William Martin , Amy Gooch , and Bruce Gooch . 2001 . The Lit Sphere: A Model for Capturing NPR Shading from Art . In Proceedings of the Graphics Interface (GI '01) . 143--150. Peter-Pike J. Sloan, William Martin, Amy Gooch, and Bruce Gooch. 2001. The Lit Sphere: A Model for Capturing NPR Shading from Art. In Proceedings of the Graphics Interface (GI '01). 143--150."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1162\/PRES_a_00275"},{"key":"e_1_2_2_42_1","volume-title":"Proceedings of the Eurographics Conference on Rendering Techniques (EGSR '07)","author":"Walter Bruce","unstructured":"Bruce Walter , Stephen R. Marschner , Hongsong Li , and Kenneth E. Torrance . 2007. Microfacet Models for Refraction Through Rough Surfaces . In Proceedings of the Eurographics Conference on Rendering Techniques (EGSR '07) . 195--206. Bruce Walter, Stephen R. Marschner, Hongsong Li, and Kenneth E. Torrance. 2007. Microfacet Models for Refraction Through Rough Surfaces. In Proceedings of the Eurographics Conference on Rendering Techniques (EGSR '07). 195--206."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/142920.134078"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2017.22"},{"key":"e_1_2_2_45_1","volume-title":"Proceedings of the International Display Workshops 2015 (IDW '15)","author":"Watanabe Yoshihiro","year":"2015","unstructured":"Yoshihiro Watanabe , Gaku Narita , Sho Tatsuno , and Masatoshi Ishikawa . 2015 . High-speed 8-bit Image Projector at 1,000 fps with 3 ms Delay . In Proceedings of the International Display Workshops 2015 (IDW '15) . 1064--1065. Yoshihiro Watanabe, Gaku Narita, Sho Tatsuno, and Masatoshi Ishikawa. 2015. High-speed 8-bit Image Projector at 1,000 fps with 3 ms Delay. In Proceedings of the International Display Workshops 2015 (IDW '15). 1064--1065."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383298"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.11.003050"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275045","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3272127.3275045","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:04Z","timestamp":1750207444000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275045"}},"subtitle":["markerless and modelless dynamic projection mapping for material representation"],"short-title":[],"issued":{"date-parts":[[2018,12,4]]},"references-count":47,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2018,12,31]]}},"alternative-id":["10.1145\/3272127.3275045"],"URL":"https:\/\/doi.org\/10.1145\/3272127.3275045","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,4]]},"assertion":[{"value":"2018-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}