{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T04:29:49Z","timestamp":1772252989284,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2018,9,12]],"date-time":"2018-09-12T00:00:00Z","timestamp":1536710400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>TVs and monitors are among the most widely used displays in various environments. However, they have limitations in their physical display conditions, such as a fixed size\/position and a rigid\/flat space. In this paper, we suggest a new \u201cDisplay in the Wild\u201d (DIW) concept to overcome the aforementioned problems. Our proposed DIW system allows us to display a flexibly large screen on dynamic non-planar surfaces at an arbitrary display position. To implement our DIW concept practically, we choose a projector as the hardware configuration in order to generate a screen anywhere with different sizes. However, distortion occurs when the projector displays content on a surface that is dynamic and\/or non-planar. Therefore, we propose a distortion correction method for DIW to overcome the aforementioned surface constraints. Since projectors are not capture devices, we propose using a depth camera to determine the distortions on the surfaces quickly. We also propose DIW-specific calibration and fast\/precise correction methods. Our calibration method is constructed to detect the projection surface easily and quickly, and also allows our proposed system to accommodate the intrinsic parameters such as a display resolution and field of view. We accomplish a fast undistortion process of the projector by considering only surface boundary pixels, which enables our method to run in real time. In our comprehensive experiments, the proposed DIW system generates undistorted screens such as TVs and monitors on dynamic non-planar surfaces at an arbitrary display position with Unmanned Aerial Vehicles (UAVs) in a fast and accurate manner, demonstrating its usefulness in practical DIW scenarios.<\/jats:p>","DOI":"10.3390\/s18093063","type":"journal-article","created":{"date-parts":[[2018,9,12]],"date-time":"2018-09-12T10:26:36Z","timestamp":1536747996000},"page":"3063","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Display in the Wild (DIW): An Adaptive Projection-Imaging System to Screen Geometry in Real Time"],"prefix":"10.3390","volume":"18","author":[{"given":"Byungyong","family":"Ryu","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Kyung-Hee University, Gyeonggi-do 17104, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2677-3186","authenticated-orcid":false,"given":"Sung-Ho","family":"Bae","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Kyung-Hee University, Gyeonggi-do 17104, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,9,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1016\/j.techfore.2014.02.016","article-title":"The dynamics of incremental costs of efficient television display technologies","volume":"90","author":"Desroches","year":"2015","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yamamoto, S., Tsuruse, M., Takase, K., Tsumura, N., Nakaguchi, T., and Miyake, Y. (2005, January 19\u201323). Real-time Control of Appearance on an Object Using a High-Luminance PC Projector and Graphics Hardware. Proceedings of the 13th Color and Imaging Conference Final Program and Proceedings, Darmstadt, Germany.","DOI":"10.2352\/CIC.2005.13.1.art00006"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Raskar, R., Brown, M.S., Yang, R., Chen, W.C., Welch, G., Towles, H., Scales, B., and Fuchs, H. (1999, January 24\u201329). Multi-projector displays using camera-based registration. Proceedings of the Conference on Visualization\u201999: Celebrating Ten Years, San Francisco, CA, USA.","DOI":"10.1109\/VISUAL.1999.809883"},{"key":"ref_4","unstructured":"Tardif, J.P., Roy, S., and Trudeau, M. (2003, January 6\u201310). Multi-projectors for arbitrary surfaces without explicit calibration nor reconstruction. Proceedings of the Fourth International Conference on 3-D Digital Imaging and Modeling, Banff, AB, Canada."},{"key":"ref_5","unstructured":"Brown, M.S., and Seales, W.B. (2018, September 09). Low-Cost and Easily Constructed Large Format Display System. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/summary?doi=10.1.1.108.7586."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Yuen, N.P., and Thibault, W.C. (2008, January 8\u201312). Inexpensive immersive projection. Proceedings of the 2008 IEEE Virtual Reality Conference, Reno, NE, USA.","DOI":"10.1109\/VR.2008.4480780"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Astre, B., Sarry, L., Lohou, C., and Zeghers, E. (2008, January 23\u201328). Automatic calibration of a single-projector catadioptric display system. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587788"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1002\/jsid.264","article-title":"The auto-geometric correction of multi-projector for cylindrical surface using B\u00e9zier patches","volume":"22","author":"Zhao","year":"2014","journal-title":"J. Soc. Inf. Disp."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Boroomand, A., Sekkati, H., Lamm, M., Clausi, D.A., and Wong, A. (2016, January 25\u201328). Saliency-guided projection geometric correction using a projector-camera system. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7532900"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Park, H., Lee, M.H., Seo, B.K., and Park, J.I. (2006). Undistorted projection onto dynamic surface. Advances in Image and Video Technology, Springer.","DOI":"10.1007\/11949534_58"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1109\/TCSVT.2007.903322","article-title":"Simultaneous geometric and radiometric adaptation to dynamic surfaces with a mobile projector-camera system","volume":"18","author":"Park","year":"2008","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_12","unstructured":"Yang, T.J., Tsai, Y.M., and Chen, L.G. (2011, January 11\u201315). Smart display: A mobile self-adaptive projector-camera system. Proceedings of the 2011 IEEE International Conference on Multimedia and Expo, Barcelona, Spain."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ito, K., Takahashi, T., and Aoki, T. (2011, January 28\u201328). A geometric correction method using stereo vision for projected images. Proceedings of the First Asian Conference on Pattern Recognition, Beijing, China.","DOI":"10.1109\/ACPR.2011.6166635"},{"key":"ref_14","unstructured":"Falcao, G., Hurtos, N., Massich, J., and Fofi, D. (2009). Projector-camera calibration toolbox. Erasmus Mundus Masters in Vision and Robotics, University of Girona."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sadlo, F., Weyrich, T., Peikert, R., and Gross, M. (2005, January 21\u201322). A practical structured light acquisition system for point-based geometry and texture. Proceedings of the 2005 Eurographics\/IEEE VGTC Symposium Point-Based Graphics, Stony Brook, NY, USA.","DOI":"10.1109\/PBG.2005.194069"},{"key":"ref_16","unstructured":"Liao, J., and Cai, L. (2008, January 2\u20135). A calibration method for uncoupling projector and camera of a structured light system. Proceedings of the 2008 IEEE\/ASME International Conference on Advanced Intelligent Mechatronics, Xi\u2019an, China."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Moreno, D., and Taubin, G. (2012, January 13\u201315). Simple, accurate, and robust projector-camera calibration. Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), Zurich, Switzerland.","DOI":"10.1109\/3DIMPVT.2012.77"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1007\/s12541-012-0017-3","article-title":"Projector calibration for 3D scanning using virtual target images","volume":"13","author":"Anwar","year":"2012","journal-title":"Int. J. Precis. Eng. Manuf."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Drar\u00e9ni, J., Roy, S., and Sturm, P. (2009, January 20\u201321). Geometric video projector auto-calibration. Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5204317"},{"key":"ref_20","unstructured":"Wilson, A.D., and Benko, H. (2014). Projectors and Depth Cameras for Deviceless Augmented Reality and Interaction. (US8730309B2), U.S. Patent."},{"key":"ref_21","unstructured":"Benko, H., Costa, R.J.J., and Wilson, A.D. (2016). Providing an Interactive Experience Using a 3D Depth Camera and a 3D Projector. (US9329469B2), U.S. Patent."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wilson, A.D., and Benko, H. (2010, January 3\u20136). Combining multiple depth cameras and projectors for interactions on, above and between surfaces. Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, New York, NY, USA.","DOI":"10.1145\/1866029.1866073"},{"key":"ref_23","unstructured":"Raskar, R., and Beardsley, P. (2001, January 8\u201314). A self-correcting projector. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Sukthankar, R., and Mullin, M.D. (2000). Automatic keystone correction for camera-assisted presentation interfaces. Advances in Multimodal Interfaces\u2014ICMI 2000, Springer.","DOI":"10.1007\/3-540-40063-X_79"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4123","DOI":"10.1364\/AO.43.004123","article-title":"Keystone aberration correction in overhead projectors","volume":"43","year":"2004","journal-title":"Appl. Opt."},{"key":"ref_26","unstructured":"Sukthankar, R., Stockton, R.G., and Mullin, M.D. (2001, January 7\u201314). Smarter presentations: Exploiting homography in camera-projector systems. Proceedings of the Eighth IEEE International Conference on Computer Vision, Vancouver, BC, Canada."},{"key":"ref_27","unstructured":"Harville, M., Culbertson, B., Sobel, I., Gelb, D., Fitzhugh, A., and Tanguay, D. (2006, January 17\u201322). Practical methods for geometric and photometric correction of tiled projector. Proceedings of the 2006 IEEE Computer Vision and Pattern Recognition Workshop, New York, NY, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Xie, C., Wang, Q., and Cheng, W. (2012, January 3\u20135). Simple auto-geometric correction for non-planar projection. Proceedings of the International Conference on Automatic Control and Artificial Intelligence (ACAI 2012), Xiamen, China.","DOI":"10.1049\/cp.2012.1348"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1307","DOI":"10.1109\/TVCG.2009.166","article-title":"Markerless view-independent registration of multiple distorted projectors on extruded surfaces using an uncalibrated camera","volume":"15","author":"Sajadi","year":"2009","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sajadi, B., and Majumder, A. (2010, January 20\u201326). Auto-calibration of cylindrical multi-projector systems. Proceedings of the 2010 IEEE Virtual Reality Conference (VR), Waltham, MA, USA.","DOI":"10.1109\/VR.2010.5444797"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1109\/TVCG.2011.271","article-title":"Autocalibration of multiprojector cave-like immersive environments","volume":"18","author":"Sajadi","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2440","DOI":"10.1109\/TVCG.2017.2734428","article-title":"FaceForge: Markerless Non-Rigid Face Multi-Projection Mapping","volume":"23","author":"Siegl","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Oliver Bimber, R.R. (2005). Spatial Augmented Reality: Merging Real and Virtual Worlds, AK Peters\/CRC Press.","DOI":"10.1201\/b10624"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1109\/TVCG.2016.2592910","article-title":"Dynamic Projection Mapping onto Deforming Non-Rigid Surface Using Deformable Dot Cluster Marker","volume":"23","author":"Narita","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"653","DOI":"10.1111\/cgf.13387","article-title":"Recent Advances in Projection Mapping Algorithms, Hardware and Applications","volume":"Volume 37","author":"Iwai","year":"2018","journal-title":"Computer Graphics Forum"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Setkov, A., Gouiff\u00e8s, M., and Jacquemin, C. (2013, January 6\u20137). Color invariant feature matching for image geometric correction. Proceedings of the 6th International Conference on Computer Vision\/Computer Graphics Collaboration Techniques and Applications, Berlin, Germany.","DOI":"10.1145\/2466715.2466731"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_38","unstructured":"Kuglin, C. (1975, January 23\u201325). The phase correlation image alignment method. Proceedings of the IEEE International Conference on Cybernetics and Society, San Francisco, CA, USA."},{"key":"ref_39","first-page":"1925","article-title":"High-accuracy subpixel image registration based on phase-only correlation","volume":"86","author":"Takita","year":"2003","journal-title":"IEICE Trans. Fundam. Electron. Commun. Comput. Sci."},{"key":"ref_40","first-page":"1913","article-title":"A sub-pixel correspondence search technique for computer vision applications","volume":"87","author":"Takita","year":"2004","journal-title":"IEICE Trans. Fundam. Electron. Commun. Comput. Sci."},{"key":"ref_41","unstructured":"Shibahara, T., Aoki, T., Nakajima, H., and Kobayashi, K. (October, January 16). A sub-pixel stereo correspondence technique based on 1D phase-only correlation. Proceedings of the IEEE International Conference on Image Processing, San Antonio, TX, USA."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"685","DOI":"10.5194\/isprs-archives-XLI-B3-685-2016","article-title":"Evaluation of SIFT and SURF for vision based localization","volume":"41","author":"Qu","year":"2016","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Li, T., Hu, F., and Geng, Z. (2011, January 11\u201312). Geometric calibration of a camera-projector 3D imaging system. Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, Hong Kong, China.","DOI":"10.1145\/2087756.2087783"},{"key":"ref_44","unstructured":"Bradski, G., and Kaehler, A. (2008). Learning OpenCV: Computer Vision with the OpenCV Library, O\u2019Reilly Media, Inc."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Artal, P., Benito, A., and Tabernero, J. (2006). The human eye is an example of robust optical design. J. Vis., 6.","DOI":"10.1167\/6.1.1"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Jafari, O.H., Mitzel, D., and Leibe, B. (June, January 31). Real-time RGB-D based people detection and tracking for mobile robots and head-worn cameras. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907688"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2249","DOI":"10.1109\/TMM.2018.2803526","article-title":"Robust 3D Human Detection in Complex Environments with Depth Camera","volume":"20","author":"Tian","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/0734-189X(85)90016-7","article-title":"Topological structural analysis of digitized binary images by border following","volume":"30","author":"Suzuki","year":"1985","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_49","first-page":"30","article-title":"The maximal rectangle problem","volume":"23","author":"Vandevoorde","year":"1998","journal-title":"Doctor Dobbs J."},{"key":"ref_50","first-page":"442","article-title":"Decentering distortion of lenses","volume":"32","author":"Brown","year":"1966","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1364\/OPN.20.5.000028","article-title":"Scanned laser pico-projectors: Seeing the big picture (with a small device)","volume":"20","author":"Freeman","year":"2009","journal-title":"Opt. Photonics News"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/9\/3063\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:20:09Z","timestamp":1760196009000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/9\/3063"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,12]]},"references-count":51,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2018,9]]}},"alternative-id":["s18093063"],"URL":"https:\/\/doi.org\/10.3390\/s18093063","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints201807.0490.v1","asserted-by":"object"}]},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,9,12]]}}}