{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T13:13:05Z","timestamp":1780492385466,"version":"3.54.1"},"reference-count":38,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2022,11,18]],"date-time":"2022-11-18T00:00:00Z","timestamp":1668729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["52,175,282"],"award-info":[{"award-number":["52,175,282"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the mixed reality (MR) environment, the task of target motion perception is usually undertaken by vision. This approach suffers from poor discrimination and high cognitive load when the tasks are complex. This cannot meet the needs of the air traffic control field for rapid capture and precise positioning of the dynamic targets in the air. Based on this problem, we conducted a multimodal optimization study on target motion perception judgment by controlling the hand tactile sensor to achieve the use of tactile sensation to assist vision in MR environment. This allows it to adapt to the requirements of future development-led interactive tasks under the mixed reality holographic aviation tower. Motion perception tasks are usually divided into urgency sensing for multiple targets and precise position tracking for single targets according to the number of targets and task division. Therefore, in this paper, we designed experiments to investigate the correlation between tactile intensity-velocity correspondence and target urgency, and the correlation between the PRS (position, rhythm, sequence) tactile indication scheme and position tracking. We also evaluated it through comprehensive experiment. We obtained the following conclusions: (1) high, higher, medium, lower, and low tactile intensities would bias human visual cognitive induction to fast, faster, medium, slower, and slow motion targets. Additionally, this correspondence can significantly improve the efficiency of the participants\u2019 judgment of target urgency; (2) under the PRS tactile indication scheme, position-based rhythm and sequence cues can improve the judgment effect of human tracking target dynamic position, and the effect of adding rhythm cues is better. However, when adding rhythm and sequence cues at the same time, it can cause clutter; (3) tactile assisted vision has a good improvement effect on the comprehensive perception of dynamic target movement. The above findings are useful for the study of target motion perception in MR environments and provide a theoretical basis for subsequent research on the cognitive mechanism and quantitative of tactile indication in MR environment.<\/jats:p>","DOI":"10.3390\/s22228931","type":"journal-article","created":{"date-parts":[[2022,11,18]],"date-time":"2022-11-18T06:22:28Z","timestamp":1668752548000},"page":"8931","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments"],"prefix":"10.3390","volume":"22","author":[{"given":"Wei","family":"Wang","sequence":"first","affiliation":[{"name":"Air Defense and Antimissile School, Air Force Engineering University, Xi\u2019an 710051, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ning","family":"Xu","sequence":"additional","affiliation":[{"name":"Air Defense and Antimissile School, Air Force Engineering University, Xi\u2019an 710051, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haiping","family":"Liu","sequence":"additional","affiliation":[{"name":"Air Defense and Antimissile School, Air Force Engineering University, Xi\u2019an 710051, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jue","family":"Qu","sequence":"additional","affiliation":[{"name":"Air Defense and Antimissile School, Air Force Engineering University, Xi\u2019an 710051, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sina","family":"Dang","sequence":"additional","affiliation":[{"name":"Air Defense and Antimissile School, Air Force Engineering University, Xi\u2019an 710051, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuefeng","family":"Hong","sequence":"additional","affiliation":[{"name":"Air Defense and Antimissile School, Air Force Engineering University, Xi\u2019an 710051, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.ergon.2018.05.005","article-title":"How much is too much on monitoring tasks? Visual scan patterns of single air traffic controller performing multiple remote tower operations","volume":"67","author":"Li","year":"2018","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5228","DOI":"10.3390\/s150305228","article-title":"Human Computer Interactions in Next-Generation of Aircraft Smart Navigation Management Systems: Task Analysis and Architecture under an Agent-Oriented Methodological Approach","volume":"15","year":"2015","journal-title":"Sensors"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1080\/10447318.2021.1890495","article-title":"Human-Computer Interaction on the Modern Flight Deck","volume":"37","author":"Carroll","year":"2021","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1687814017709935","DOI":"10.1177\/1687814017709935","article-title":"Information providing in a task-centric military in-vehicle adaptive human-computer interface based on operator decision-making characteristic","volume":"9","author":"Han","year":"2017","journal-title":"Adv. Mech. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.1177\/0018720818788995","article-title":"Effects of Touch, Voice, and Multimodal Input, and Task Load on Multiple-UAV Monitoring Performance During Simulated Manned-Unmanned Teaming in a Military Helicopter","volume":"60","author":"Levulis","year":"2018","journal-title":"Hum. Factors"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.rcim.2019.03.010","article-title":"A practical augmented reality-assisted maintenance system framework for adaptive user support","volume":"59","author":"Siew","year":"2019","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1007\/s12193-011-0064-6","article-title":"Eye-tracking based adaptive user interface: Implicit human-computer interaction for preference indication","volume":"5","author":"Cheng","year":"2012","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"10242","DOI":"10.1109\/TVT.2020.3004175","article-title":"Multi-Target Device-Free Wireless Sensing Based on Multiplexing Mechanisms","volume":"69","author":"Wang","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Oh, H., Yun, Y., and Myung, R. (2021). Cognitive Modeling of Task Switching in Discretionary Multitasking Based on the ACT-R Cognitive Architecture. Appl. Sci., 11.","DOI":"10.3390\/app11093967"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"47","DOI":"10.2112\/JCR-SI110-011.1","article-title":"Design and Implementation of Marine Ship Tracking System Based on Multi-Target Tracking Algorithm","volume":"110","author":"Zhang","year":"2020","journal-title":"J. Coast. Res."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Svensson, D., Sj\u00f6gren, R., Sundell, D., Sj\u00f6din, A., and Trygg, J. (2019). doepipeline: A systematic approach to optimizing multi-level and multi-step data processing workflows. BMC Bioinform., 20.","DOI":"10.1186\/s12859-019-3091-z"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2021","DOI":"10.1109\/TAES.2021.3088430","article-title":"Levy State-Space Models for Tracking and Intent Prediction of Highly Maneuverable Objects","volume":"57","author":"Gan","year":"2021","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"92106","DOI":"10.1007\/s11432-016-5520-1","article-title":"An exploratory study of multimodal interaction modeling based on neural computation","volume":"59","author":"Lu","year":"2016","journal-title":"Sci. China Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1166\/jmihi.2013.1137","article-title":"Surgical Navigation with Distance Sensation Using Force Feedback for Robotic Surgery","volume":"3","author":"Kobayashi","year":"2013","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ito, F., and Takemura, K. (2021). A Model for Estimating Tactile Sensation by Machine Learning Based on Vibration Information Obtained while Touching an Object. Sensors, 21.","DOI":"10.3390\/s21237772"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1080\/10447318.2011.555321","article-title":"Haptic Seat Interfaces for Driver Information and Warning Systems","volume":"27","author":"Chang","year":"2011","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1109\/TOH.2012.33","article-title":"Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance","volume":"5","author":"Stanley","year":"2012","journal-title":"IEEE Trans. Haptics"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"6036","DOI":"10.1038\/s41467-021-26104-2","article-title":"Dynamics of history-dependent perceptual judgment","volume":"12","author":"Hachen","year":"2021","journal-title":"Nat. Commun."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3131","DOI":"10.1152\/jn.00621.2015","article-title":"The role of vibration in tactile speed perception","volume":"114","author":"Dallmann","year":"2015","journal-title":"J. Neurophysiol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"17107","DOI":"10.1073\/pnas.1305509110","article-title":"Spatial and temporal codes mediate the tactile perception of natural textures","volume":"110","author":"Weber","year":"2013","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1007\/s10111-020-00660-x","article-title":"Appropriate operation inducement by biasing perception of velocity using tactile stimulation","volume":"23","author":"Tachiiri","year":"2021","journal-title":"Cogn. Technol. Work."},{"key":"ref_22","first-page":"700","article-title":"Combined vibration haptic coding for representing flight attitude information","volume":"31","author":"Yang","year":"2018","journal-title":"J. Sens. Technol."},{"key":"ref_23","first-page":"1261","article-title":"Research Status of Vibration Tactile Coding","volume":"43","author":"Du","year":"2021","journal-title":"J. Eng. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2221","DOI":"10.3758\/s13414-014-0696-1","article-title":"Haptic guidance of overt visual attention","volume":"76","author":"List","year":"2014","journal-title":"Atten. Percept. Psychophys."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"8307580","DOI":"10.1155\/2020\/8307580","article-title":"Spatial Information of Somatosensory Stimuli in the Brain: Multivariate Pattern Analysis of Functional Magnetic Resonance Imaging Data","volume":"2020","author":"Lee","year":"2020","journal-title":"Neural Plast."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"16864","DOI":"10.1523\/JNEUROSCI.3404-11.2011","article-title":"Multiple Reference Frames in Cortical Oscillatory Activity during Tactile Remapping for Saccades","volume":"31","author":"Buchholz","year":"2011","journal-title":"J. Neurosci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1152\/jn.00241.2014","article-title":"Tactile object localization by anticipatory whisker motion","volume":"113","author":"Voigts","year":"2015","journal-title":"J. Neurophysiol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2150014","DOI":"10.1142\/S0218001421500142","article-title":"Braille and Morse Code Based Tactile Information Coding and its Applications","volume":"35","author":"Huang","year":"2021","journal-title":"Int. J. Pattern Recognit. Artif. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1037\/xhp0000478","article-title":"Contextual Cueing of Tactile Search Is Coded in an Anatomical Reference Frame","volume":"44","author":"Assumpcao","year":"2018","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."},{"key":"ref_30","unstructured":"Du, J. (2021). Design and Application of Vibration Tactile Coding, University of Electronic Science and Technology."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1007\/s002210000607","article-title":"The effect of expectations on hitting moving targets: Influence of the preceding target\u2019s speed","volume":"137","author":"Smeets","year":"2001","journal-title":"Exp. Brain Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1109\/TEVC.2009.2036162","article-title":"Incorporating the Notion of Relative Importance of Objectives in Evolutionary Multiobjective Optimization","volume":"14","author":"Rachmawati","year":"2010","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1523\/JNEUROSCI.2732-13.2014","article-title":"Auditory and Tactile Signals Combine to Influence Vision during Binocular Rivalry","volume":"34","author":"Lunghi","year":"2014","journal-title":"J. Neurosci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1369","DOI":"10.1068\/p231369","article-title":"Modality-specific differences in the processing of spatially, temporally, and spatiotemporally distributed information","volume":"23","author":"Mahar","year":"1994","journal-title":"Perception"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"026041","DOI":"10.1088\/1741-2552\/ac6062","article-title":"Evaluation of multiple perceptual qualities of transcutaneous electrical nerve stimulation for evoked tactile sensation in forearm amputees","volume":"19","author":"Zhang","year":"2022","journal-title":"J. Neural Eng."},{"key":"ref_36","unstructured":"Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, Lawrence Erlbaum Associates."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1007\/s11336-012-9288-y","article-title":"Speed-Accuracy Response Models: Scoring Rules based on Response Time and Accuracy","volume":"77","author":"Maris","year":"2012","journal-title":"Psychometrika"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, W., Xu, N., Dang, S., Hong, X., and Qu, J. (2022). Induction Mechanism of Auditory-Assisted Vision for Target Search Localization in Mixed Reality (MR) Environments. Aerospace, 9.","DOI":"10.3390\/aerospace9070340"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/22\/8931\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:21:05Z","timestamp":1760145665000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/22\/8931"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,18]]},"references-count":38,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["s22228931"],"URL":"https:\/\/doi.org\/10.3390\/s22228931","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,18]]}}}