{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T14:22:55Z","timestamp":1776090175484,"version":"3.50.1"},"reference-count":125,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,7,18]],"date-time":"2023-07-18T00:00:00Z","timestamp":1689638400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100004807","name":"German Research Foundation","doi-asserted-by":"publisher","award":["460036893"],"award-info":[{"award-number":["460036893"]}],"id":[{"id":"10.13039\/100004807","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Data physicalisations, or physical visualisations, represent data physically, using variable properties of physical media. As an emerging area, Data physicalisation research needs conceptual foundations to support thinking about and designing new physical representations of data and evaluating them. Yet, it remains unclear at the moment (i) what encoding variables are at the designer\u2019s disposal during the creation of physicalisations, (ii) what evaluation criteria could be useful, and (iii) what methods can be used to evaluate physicalisations. This article addresses these three questions through a narrative review and a systematic review. The narrative review draws on the literature from Information Visualisation, HCI and Cartography to provide a holistic view of encoding variables for data. The systematic review looks closely into the evaluation criteria and methods that can be used to evaluate data physicalisations. Both reviews offer a conceptual framework for researchers and designers interested in designing and evaluating data physicalisations. The framework can be used as a common vocabulary to describe physicalisations and to identify design opportunities. We also proposed a seven-stage model for designing and evaluating physical data representations. The model can be used to guide the design of physicalisations and ideate along the stages identified. The evaluation criteria and methods extracted during the work can inform the assessment of existing and future data physicalisation artefacts.<\/jats:p>","DOI":"10.3390\/mti7070073","type":"journal-article","created":{"date-parts":[[2023,7,19]],"date-time":"2023-07-19T01:02:23Z","timestamp":1689728543000},"page":"73","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Encoding Variables, Evaluation Criteria, and Evaluation Methods for Data Physicalisations: A Review"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9363-8868","authenticated-orcid":false,"given":"Champika","family":"Ranasinghe","sequence":"first","affiliation":[{"name":"Data Management & Biometrics, Faculty of Electrical Engineering, Mathematics & Computer Science, University of Twente, 7500 AE Enschede, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5087-8776","authenticated-orcid":false,"given":"Auriol","family":"Degbelo","sequence":"additional","affiliation":[{"name":"Chair of Geoinformatics, Faculty of Environmental Sciences, TU Dresden, 10162 Dresden, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,18]]},"reference":[{"key":"ref_1","unstructured":"Begole, B., Kim, J., Inkpen, K., and Woo, W. (2015, January 23\u201328). Opportunities and challenges for data physicalization. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems\u2014CHI \u201915, Seoul, Republic of Korea."},{"key":"ref_2","unstructured":"van Loenhout, R., Ranasinghe, C., Degbelo, A., and Bouali, N. (May, January 30). Physicalizing Sustainable Development Goals Data: An Example with SDG 7 (Affordable and Clean Energy). Proceedings of the CHI Conference on Human Factors in Computing Systems Extended Abstracts, New Orleans, LA, USA."},{"key":"ref_3","unstructured":"Wakkary, R., Andersen, K., Odom, W., Desjardins, A., and Petersen, M.G. (2020, January 6\u201320). DayClo: An everyday table clock providing interaction with personal schedule data for self-reflection. Proceedings of the DIS\u201920: Designing Interactive Systems Conference 2020, Eindhoven, The Netherlands."},{"key":"ref_4","unstructured":"Brewster, S.A., Fitzpatrick, G., Cox, A.L., and Kostakos, V. (2019, January 4\u20139). Bookly: An interactive everyday artifact showing the time of physically accumulated reading activity. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Menheere, D., Van Hartingsveldt, E., Birkeb\u00e6k, M., Vos, S., and Lallemand, C. (July, January 28). Laina: Dynamic data physicalization for slow exercising feedback. Proceedings of the Designing Interactive Systems Conference 2021, virtual event.","DOI":"10.1145\/3461778.3462041"},{"key":"ref_6","unstructured":"Bakker, S., Hummels, C., Ullmer, B., Geurts, L., Hengeveld, B., Saakes, D., and Broekhuijsen, M. (2016, January 14\u201317). If your mind can grasp it, your hands will help. Proceedings of the TEI\u201916: Tenth International Conference on Tangible, Embedded, and Embodied Interaction, Eindhoven, The Netherlands."},{"key":"ref_7","unstructured":"Begole, B., Kim, J., Inkpen, K., and Woo, W. (2015, January 23\u201328). Evaluating the memorability of physical Visualizations. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015), Seoul, Republic of Korea."},{"key":"ref_8","unstructured":"Dragicevic, P., Jansen, Y., and Moere, A.V. (2021). Springer Handbook of Human Computer Interaction, Springer."},{"key":"ref_9","first-page":"147","article-title":"Towards a design space for multisensory data representation","volume":"29","author":"Hogan","year":"2017","journal-title":"Interact. Comput."},{"key":"ref_10","first-page":"1","article-title":"Physecology: A Conceptual Framework to Describe Data Physicalizations in their Real-World Context","volume":"29","author":"Sturdee","year":"2022","journal-title":"ACM Trans.-Comput.-Hum. Interact."},{"key":"ref_11","unstructured":"Bae, S.S., Zheng, C., West, M.E., Do, E.Y.L., Huron, S., and Szafir, D.A. (May, January 30). Making Data Tangible: A Cross-disciplinary Design Space for Data Physicalization. Proceedings of the CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sosa, R., Gerrard, V., Esparza, A., Torres, R., and Napper, R. (2018, January 24). Data objects: Design principles for data physicalisation. Proceedings of the DS 92: Proceedings of the DESIGN 2018 15th International Design Conference, Dubrovnik, Croatia.","DOI":"10.21278\/idc.2018.0125"},{"key":"ref_13","unstructured":"Storni,, C., Leahy, K., McMahon, M., Lloyd, P., and Bohemia, E. (2018, January 25\u201328). Data sensification: Beyond representation modality, toward encoding data in experience. Proceedings of the Design as a Catalyst for Change\u2014DRS International Conference 2018, Limerick, Ireland."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1109\/TVCG.2016.2598608","article-title":"Embedded data representations","volume":"23","author":"Willett","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, K., Petersen, E., Ahmad, T., Burlinson, D., Tanis, S., and Szafir, D.A. (2021, January 8\u201313). Understanding data accessibility for people with intellectual and developmental disabilities. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445743"},{"key":"ref_16","unstructured":"Roberts, J.C., and Walker, R. (2010, January 24\u201329). Using all our senses: The need for a unified theoretical approach to multi-sensory information visualization. Proceedings of the IEEE VisWeek 2010 Workshop on The Role of Theory in Information Visualization, Salt Lake City, UT, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1109\/TVCG.2015.2467951","article-title":"A psychophysical investigation of size as a physical variable","volume":"22","author":"Jansen","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_18","unstructured":"Hogan, T., Hinrichs, U., Alexander, J., Huron, S., Carpendale, S., and Hornecker, E. (2018, January 21\u201326). Toward a design language for data physicalization. Proceedings of the IEEE VIS Workshop, Estrel Hotel Berlin, Germany."},{"key":"ref_19","unstructured":"Stusak, S., Butz, A., and Tabard, A. (2018, January 21\u201326). Variables for Data Physicalization Units. Proceedings of the Toward a Design Language for Data Physicalization: Workshop at IEEE VIS, Estrel Hotel Berlin, Germany."},{"key":"ref_20","unstructured":"Oehlberg, L., and Willett, W. (2018, January 21\u201326). Encoding data through experiential material properties. Proceedings of the Toward a Design Language for Data Physicalization: Workshop at IEEE VIS, Estrel Hotel Berlin, Germany."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Moere, A.V. (2008, January 9\u201311). Beyond the tyranny of the pixel: Exploring the physicality of information visualization. Proceedings of the 2008 12th International Conference Information Visualisation, London, UK.","DOI":"10.1109\/IV.2008.84"},{"key":"ref_22","unstructured":"Nesbitt, K.V. (2001, January 1). Modeling the multi-sensory design space. Proceedings of the APVis \u201901: Proceedings of the 2001 Asia-Pacific symposium on Information Visualisation, Sydney, Australia."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MCG.2019.2923483","article-title":"An emotional response to the value of visualization","volume":"39","author":"Wang","year":"2019","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.jbusres.2019.07.039","article-title":"Literature review as a research methodology: An overview and guidelines","volume":"104","author":"Snyder","year":"2019","journal-title":"J. Bus. Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1111\/j.1471-1842.2009.00848.x","article-title":"A typology of reviews: An analysis of 14 review types and associated methodologies","volume":"26","author":"Grant","year":"2009","journal-title":"Health Inf. Libr. J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1080\/00087041.2022.2097760","article-title":"Guidelines for standardizing the design of tactile maps: A review of research and best practice","volume":"59","author":"Touya","year":"2022","journal-title":"Cartogr. J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1179\/000870410X12911298276237","article-title":"Sonic maps for hiking - use of sound in enhancing the map use experience","volume":"47","author":"Laakso","year":"2010","journal-title":"Cartogr. J."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Huang, M.L., Nguyen, Q.V., and Zhang, K. (2009). Visual Information Communication, Springer.","DOI":"10.1007\/978-1-4419-0312-9"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhao, J., and Moere, A.V. (2008, January 10\u201312). Embodiment in data sculpture: A model of the physical visualization of information. Proceedings of the 3rd International Conference on Digital Interactive Media in Entertainment and Arts, Athens, Greece.","DOI":"10.1145\/1413634.1413696"},{"key":"ref_30","unstructured":"McCormack, J., Roberts, J.C., Bach, B., Freitas, C.D.S., Itoh, T., Hurter, C., and Marriott, K. (2018). Immersive Analytics, Springer. Springer Nature Switzerland AG 2018."},{"key":"ref_31","unstructured":"Lockton, D., Lenzi, S., Hekkert, P., Oak, A., Sadaba, J., and Lloyd, P. (2022). Design Elements in Data Physicalization: A Systematic Literature Review, Design Research Society."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1224","DOI":"10.1109\/TVCG.2007.70515","article-title":"Toward a deeper understanding of the role of interaction in information visualization","volume":"13","author":"Yi","year":"2007","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_33","first-page":"59","article-title":"Interactive maps: What we know and what we need to know","volume":"6","author":"Roth","year":"2013","journal-title":"J. Spat. Inf. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1016\/0953-5438(94)90008-6","article-title":"Foundations of multimodal representations: A taxonomy of representational modalities","volume":"6","author":"Bernsen","year":"1994","journal-title":"Interact. Comput."},{"key":"ref_35","unstructured":"Konstan, J.A., Chi, E.H., and H\u00f6\u00f6k, K. (2012, January 5\u201310). Shape-changing interfaces: A review of the design space and open research questions. Proceedings of the CHI\u201912\u2014Conference on Human Factors in Computing Systems, Austin, TX, USA."},{"key":"ref_36","unstructured":"Bertin, J. (1983). Semiology of Graphics: Diagrams, Networks, Maps, The University of Wisconsin Press. Translated by William J. Berg."},{"key":"ref_37","unstructured":"MacEachren, A.M. (1995). How Maps Work: Representation, Visualization, and Design, Guilford Press."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Richardson, D., Castree, N., Goodchild, M.F., Kobayashi, A., Liu, W., and Marston, R.A. (2017). International Encyclopedia of Geography: People, the Earth, Environment and Technology, John Wiley & Sons, Ltd.","DOI":"10.1002\/9781118786352"},{"key":"ref_39","unstructured":"Wilson, J.P. (2017). Geographic Information Science & Technology Body of Knowledge, University Consortium for Geographic Information Science (UCGIS). Number Q2."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1515\/semi.1990.80.3-4.239","article-title":"Visual texture as a semiotic system","volume":"80","author":"Caivano","year":"1990","journal-title":"Semiotica"},{"key":"ref_41","unstructured":"Kraak, M.J., Roth, R.E., Ricker, B., Kagawa, A., and Sourd, G.L. (2020). Mapping for a Sustainable World, The United Nations."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1109\/TOH.2009.44","article-title":"Review of designs for haptic data visualization","volume":"3","author":"Paneels","year":"2010","journal-title":"IEEE Trans. Haptics"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Griffin, A.L. (2001). Feeling it out: The use of haptic visualization for exploratory geographic analysis. Cartogr. Perspect., 12\u201329.","DOI":"10.14714\/CP39.636"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2777","DOI":"10.1007\/s00221-015-4346-1","article-title":"Using space and time to encode vibrotactile information: Toward an estimate of the skin\u2019s achievable throughput","volume":"233","author":"Novich","year":"2015","journal-title":"Exp. Brain Res."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.displa.2007.07.003","article-title":"Tactile displays: Overview and recent advances","volume":"29","author":"Chouvardas","year":"2008","journal-title":"Displays"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/MCG.2020.3025322","article-title":"Data clothing and BigBarChart: Designing physical data reports on indoor pollutants for individuals and communities","volume":"41","author":"Perovich","year":"2021","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1109\/TVCG.2018.2865237","article-title":"Information olfactation: Harnessing scent to convey data","volume":"25","author":"Patnaik","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3402449","article-title":"SMELL SPACE: Mapping out the olfactory design space for novel interactions","volume":"27","author":"Maggioni","year":"2020","journal-title":"ACM Trans. -Comput.-Hum. Interact. (TOCHI)"},{"key":"ref_49","unstructured":"Kitamura, Y., Quigley, A., Isbister, K., Igarashi, T., Bj\u00f8rn, P., and Drucker, S.M. (2021, January 8\u201313). Data as delight: Eating data. Proceedings of the CHI\u201921: CHI Conference on Human Factors in Computing Systems, Yokohama, Japan."},{"key":"ref_50","unstructured":"Kaye, J., Druin, A., Lampe, C., Morris, D., and Hourcade, J.P. (2016, January 7\u201312). Data edibilization: Representing data with food. Proceedings of the Extended Abstracts of the 2016 CHI Conference on Human Factors in Computing Systems (CHIEA\u201916), San Jose, CA, USA."},{"key":"ref_51","unstructured":"Jones, M., Palanque, P.A., Schmidt, A., and Grossman, T. (May, January 26). Temporal, affective, and embodied characteristics of taste experiences: A framework for design. Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201914), Toronto, ON, Canada."},{"key":"ref_52","first-page":"699","article-title":"How taste works: Cells, receptors and gustatory perception","volume":"20","year":"2015","journal-title":"Cell. Mol. Biol. Lett."},{"key":"ref_53","unstructured":"Gal, D., Wheeler, S.C., and Shiv, B. (2022, May 30). Cross-Modal Influences on Gustatory Perception. 2007. Social Science Research Network (\u201cSSRN\u201d). Available online: https:\/\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id=1030197,."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1186\/2044-7248-2-21","article-title":"The taste of cutlery: How the taste of food is affected by the weight, size, shape, and colour of the cutlery used to eat it","volume":"2","author":"Harrar","year":"2013","journal-title":"Flavour"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/2044-7248-3-10","article-title":"Does the colour of the mug influence the taste of the coffee?","volume":"3","author":"Wuillemin","year":"2014","journal-title":"Flavour"},{"key":"ref_56","unstructured":"Kramer, G., Walker, B., Bonebright, T., Cook, P., Flowers, J.H., Miner, N., and Neuhoff, J. (2010). Sonification Report: Status of the Field and Research Agenda, Faculty Publications, Department of Psychology, DigitalCommons@University of Nebraska."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"MacEachren, A., and Taylor, F. (1994). Visualization in Modern Cartography, Academic Press.","DOI":"10.1016\/B978-0-08-042415-6.50008-9"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/52.368264","article-title":"Data sonification: Do you see what I hear?","volume":"12","author":"Madhyastha","year":"1995","journal-title":"IEEE Softw."},{"key":"ref_59","unstructured":"Palom\u00e4ki, H. (2006, January 19\u201324). Meanings conveyed by simple auditory rhythms. Proceedings of the 12th International Conference on Auditory Display (ICAD2006), London, UK."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"4188","DOI":"10.1038\/s41598-022-08152-w","article-title":"Rhythm perception is shared between audio and haptics","volume":"12","author":"Bernard","year":"2022","journal-title":"Sci. Rep."},{"key":"ref_61","unstructured":"Visi, F., Dothel, G., Williams, D., and Miranda, E. (2014, January 12). Unfolding | Clusters: A Music and Visual Media Model of ALS Pathophysiology. Proceedings of the SoniHED Conference: Sonification of Health and Environmental Data, York, UK."},{"key":"ref_62","unstructured":"Carpendale, S. (2003). Considering Visual Variables as a Basis for Information Visualisation, University of Calgary. Technical Report."},{"key":"ref_63","unstructured":"Ormeling, F., K\u00f6bben, B., and P\u00e9rez-G\u00f3mez, R. (September, January 30). Evaluating dynamic visual variables. Proceedings of the Seminar on Teaching Animated Cartography, Madrid, Spain."},{"key":"ref_64","first-page":"201","article-title":"Animation and the role of map design in scientific visualization","volume":"19","author":"DiBiase","year":"1992","journal-title":"Cartogr. Geogr. Inf. Syst."},{"key":"ref_65","first-page":"89","article-title":"Dynamic visualization in a developing framework for the representation of geographic data","volume":"156","author":"Blok","year":"1998","journal-title":"Bull. Com. Fr. Cartogr."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/MCG.2020.3025504","article-title":"Data badges: Making an academic profile through a DIY wearable physicalization","volume":"40","author":"Panagiotidou","year":"2020","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_67","unstructured":"Kitamura, Y., Quigley, A., Isbister, K., Igarashi, T., Bj\u00f8rn, P., and Drucker, S.M. (2021, January 8\u201313). Haptic and visual comprehension of a 2D graph layout through physicalisation. Proceedings of the CHI\u201921: CHI Conference on Human Factors in Computing Systems, Virtual Event, Yokohama, Japan."},{"key":"ref_68","unstructured":"Mival, O.H., Smyth, M., and Dalsgaard, P. (2017, January 10\u201314). The Visual and beyond: Characterizing experiences with auditory, haptic and visual data representations. Proceedings of the 2017 Conference on Designing Interactive Systems, (DIS\u201917), Edinburgh, UK."},{"key":"ref_69","unstructured":"Inakage, M., Ishii, H., Do, E.Y.L., Steimle, J., Shaer, O., Kunze, K., and Peiris, R.L. (2017, January 20\u201323). Torrent: Integrating embodiment, physicalization and musification in music-making. Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI\n2017), Yokohama, Japan."},{"key":"ref_70","unstructured":"Bernhaupt, R., Mueller, F.F., Verweij, D., Andres, J., McGrenere, J., Cockburn, A., Avellino, I., Goguey, A., Bj\u00f8n, P., and Zhao, S. (2020, January 25\u201330). Scents and sensibility: Evaluating information olfactation. Proceedings of the CHI\u201920: CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA."},{"key":"ref_71","unstructured":"Lamas, D., Sarapuu, H., L\u00e1rusd\u00f3ttir, M., Stage, J., and Ardito, C. (2020, January 25\u201329). Motiis: Fostering parents\u2019 awareness of their adolescents emotional experiences during gaming. Proceedings of the NordiCHI \u201920: Shaping Experiences, Shaping Society, Proceedings of the 11th Nordic Conference on Human-Computer Interaction, Tallinn, Estonia."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Baykal, G.E., Van Mechelen, M., and Eriksson, E. (2020, January 25\u201330). Collaborative technologies for children with special needs: A systematic literature review. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376291"},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Salminen, J., Guan, K., Jung, S.g., Chowdhury, S.A., and Jansen, B.J. (2020, January 25\u201330). A literature review of quantitative persona creation. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376502"},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Pettersson, I., Lachner, F., Frison, A.K., Riener, A., and Butz, A. (2018, January 21\u201326). A Bermuda triangle? A Review of method application and triangulation in user experience evaluation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada.","DOI":"10.1145\/3173574.3174035"},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Bargas-Avila, J.A., and Hornb\u00e6k, K. (2011, January 7\u201312). Old wine in new bottles or novel challenges: A critical analysis of empirical studies of user experience. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada.","DOI":"10.1145\/1978942.1979336"},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Koelle, M., Ananthanarayan, S., and Boll, S. (2020, January 25\u201330). Social acceptability in HCI: A survey of methods, measures, and design strategies. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376162"},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3488542","article-title":"Multi-Touch Querying on Data Physicalizations in Immersive AR","volume":"5","author":"Herman","year":"2021","journal-title":"Proc. ACM -Hum.-Comput. Interact."},{"key":"ref_78","unstructured":"Kaye, J., Druin, A., Lampe, C., Morris, D., and Hourcade, J.P. (2016, January 7\u201312). Physikit: Data engagement through physical ambient visualizations in the home. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems\u2014CHI \u201916, San Jose, CA, USA."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1126\/science.103.2684.677","article-title":"On the theory of scales of measurement","volume":"103","author":"Stevens","year":"1946","journal-title":"Science"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1111\/cgf.14330","article-title":"Data to physicalization: A survey of the physical rendering process","volume":"40","author":"Djavaherpour","year":"2021","journal-title":"Comput. Graph. Forum"},{"key":"ref_81","unstructured":"Nielsen, J. (2022, August 31). Usability 101: Introduction to Usability. NN\/g Nielsen Norman Group, 3 January 2012. Available online: https:\/\/www.nngroup.com\/articles\/usability-101-introduction-to-usability\/."},{"key":"ref_82","unstructured":"Sedlmair, M., Isenberg, P., Isenberg, T., Mahyar, N., and Lam, H. (2016, January 24). Beyond usability and performance: A review of user experience-focused evaluations in visualization. Proceedings of the Beyond Time and Errors on Novel Evaluation Methods for Visualization\u2014BELIV \u201916, Baltimore, MD, USA."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/MCG.2020.3025385","article-title":"Move&Find: The value of kinaesthetic experience in a casual data representation","volume":"40","author":"Hurtienne","year":"2020","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1109\/TVCG.2020.3030472","article-title":"Chemicals in the creek: Designing a situated data physicalization of open government data with the community","volume":"27","author":"Perovich","year":"2021","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_85","unstructured":"Wimmer, R., Kaltenbrunner, M., Murer, M., Wolf, K., and Oakley, I. (2021, January 14\u201317). Comparing understanding and memorization in physicalization and VR visualization. Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction, Salzburg, Austria."},{"key":"ref_86","unstructured":"Kitamura, Y., Quigley, A., Isbister, K., Igarashi, T., Bj\u00f8rn, P., and Drucker, S.M. (2021, January 8\u201313). ADIO: An interactive artifact physically representing the intangible digital audiobook listening experience in everyday living spaces. Proceedings of the CHI\u201921: CHI Conference on Human Factors in Computing Systems, Virtual Event, Yokohama, Japan."},{"key":"ref_87","unstructured":"Lamas, D., Sarapuu, H., L\u00e1rusd\u00f3ttir, M., Stage, J., and Ardito, C. (2020, January 25\u201329). LOOP: Exploring physicalization of activity tracking data. Proceedings of the NordiCHI \u201920: Shaping Experiences, Shaping Society, Proceedings of the 11th Nordic Conference on Human-Computer Interaction, Tallinn, Estonia."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1007\/s00146-017-0752-1","article-title":"\u201cIt\u2019s like holding a human heart\u201d: The design of Vital + Morph, a shape-changing interface for remote monitoring","volume":"33","author":"Boem","year":"2018","journal-title":"AI Soc."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Daniel, M., Rivi\u00e8re, G., and Couture, N. (2019, January 17\u201320). CairnFORM: A shape-changing ring chart notifying renewable energy availability in peripheral locations. Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction, Tempe, AZ, USA.","DOI":"10.1145\/3294109.3295634"},{"key":"ref_90","unstructured":"van den Hoven, E., Loke, L., Shaer, O., van Dijk, J., and Kun, A.L. (2020, January 9\u201312). CoDa: Collaborative data interpretation through an interactive tangible scatterplot. Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction, Sydney, Australia."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.cag.2019.09.004","article-title":"Physicalizing cardiac blood flow data via 3D printing","volume":"85","author":"Ang","year":"2019","journal-title":"Comput. Graph."},{"key":"ref_92","unstructured":"Wimmer, R., Kaltenbrunner, M., Murer, M., Wolf, K., and Oakley, I. (2021, January 14\u201317). Scaling data physicalization\u2014How does size influence experience?. Proceedings of the TEI \u201921: Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction, Online Event."},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/MCG.2018.042731653","article-title":"Weather Report: A site-specific artwork interweaving human experiences and scientific data physicalization","volume":"38","author":"Keefe","year":"2018","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_94","unstructured":"Cuya, F.G.B., Guarese, R.L.M., Johansson, C.G.C., Giambastiani, M., Iquiapaza, Y., de Jesus Oliveira, V.A., Nedel, L.P., and Maciel, A. (2021, January 18\u201321). Vibrotactile data physicalization: Exploratory insights for haptization of low-resolution images. Proceedings of the SVR\u201921: 23rd Symposium on Virtual and Augmented Reality, Virtual Event."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"2201","DOI":"10.1109\/TVCG.2014.2352953","article-title":"Activity sculptures: Exploring the impact of physical visualizations on running activity","volume":"20","author":"Stusak","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_96","unstructured":"Begole, B., Kim, J., Inkpen, K., and Woo, W. (2015, January 18\u201323). Exploring interactions with physically dynamic bar charts. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015), Seoul, Republic of Korea."},{"key":"ref_97","unstructured":"Hurst, A., Findlater, L., and Morris, M.R. (November, January 20). FluxMarker: Enhancing tactile graphics with dynamic tactile markers. Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017), Baltimore, MD, USA."},{"key":"ref_98","unstructured":"Mackay, W.E., Brewster, S.A., and B\u00f8dker, S. (May, January 27). Evaluating the efficiency of physical visualizations. Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems (CHI\u201913), Paris, France."},{"key":"ref_99","unstructured":"Bernhaupt, R., Mueller, F.F., Verweij, D., Andres, J., McGrenere, J., Cockburn, A., Avellino, I., Goguey, A., Bj\u00f8n, P., and Zhao, S. (2020, January 25\u201330). A change of perspective: How user orientation influences the perception of physicalizations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1207\/s15327051hci1904_2","article-title":"The interplay of beauty, goodness, and usability in interactive products","volume":"19","author":"Hassenzahl","year":"2004","journal-title":"Hum.-Comput. Interact."},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Law, E., Roto, V., Hassenzahl, M., Vermeeren, A., and Kort, J. (2009, January 4\u20139). Understanding, Scoping and Defining User eXperience: A Survey Approach. Proceedings of the CHI\u201909, ACM SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA.","DOI":"10.1145\/1518701.1518813"},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"262","DOI":"10.3390\/ijgi4010262","article-title":"User-centered design for interactive maps: A case study in crime analysis","volume":"4","author":"Roth","year":"2015","journal-title":"ISPRS Int. J.-Geo-Inf."},{"key":"ref_103","unstructured":"ANSI (2001). Common Industry Format for Usability Test Reports, National Institute of Standards and Technology, US Department of Commerce. Technical Report."},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"2396","DOI":"10.1109\/TVCG.2013.134","article-title":"An interaction model for visualizations beyond the desktop","volume":"19","author":"Jansen","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"490","DOI":"10.2307\/258554","article-title":"What constitutes a theoretical contribution?","volume":"14","author":"Whetten","year":"1989","journal-title":"Acad. Manag. Rev."},{"key":"ref_106","unstructured":"Weisstein, E.W. (2022, September 10). Fisher\u2019s exact test (From MathWorld\u2014A Wolfram Web Resource). Wolfram Research, Inc. Available online: https:\/\/mathworld.wolfram.com\/FishersExactTest.html."},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1126\/science.ns-15.366.92","article-title":"The method of multiple working hypotheses","volume":"15","author":"Chamberlin","year":"1890","journal-title":"Science"},{"key":"ref_108","unstructured":"Star, S.L. (1989). Distributed Artificial Intelligence (Vol. 2), Morgan Kaufmann Publishers Inc."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1177\/0162243910377624","article-title":"This is not a boundary object: Reflections on the origin of a concept","volume":"35","author":"Star","year":"2010","journal-title":"Sci. Technol. Hum. Values"},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1111\/cgf.14312","article-title":"Boundary objects in design studies: Reflections on the collaborative creation of isochrone maps","volume":"40","author":"Vuillemot","year":"2021","journal-title":"Comput. Graph. Forum"},{"key":"ref_111","first-page":"55","article-title":"The nature of design practice and implications for interaction design research","volume":"2","author":"Stolterman","year":"2008","journal-title":"Int. J. Des."},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/MCG.2021.3115417","article-title":"What students learn with personal data physicalization","volume":"41","author":"Perin","year":"2021","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_113","unstructured":"Mandryk, R.L., Hancock, M., Perry, M., and Cox, A.L. (2018, January 21\u201326). Self-reflection and personal physicalization construction. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018), Montreal, QC, Canada."},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1080\/15230406.2018.1495103","article-title":"Sonifying data uncertainty with sound dimensions","volume":"46","author":"Ballatore","year":"2019","journal-title":"Cartogr. Geogr. Inf. Sci."},{"key":"ref_115","first-page":"23","article-title":"Geospatial physicalization in geography education","volume":"120","author":"Moorman","year":"2020","journal-title":"J. Geogr."},{"key":"ref_116","unstructured":"Wakkary, R., Andersen, K., Odom, W., Desjardins, A., and Petersen, M.G. (2020, January 6\u201310). Entangling the roles of maker and interpreter in interpersonal data narratives: Explorations in yarn and sound. Proceedings of the DIS\u201920: Designing Interactive Systems Conference 2020, Eindhoven, The Netherlands."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1111\/cgf.13432","article-title":"Landscaper: A modeling system for 3D printing scale models of landscapes","volume":"37","author":"Allahverdi","year":"2018","journal-title":"Comput. Graph. Forum"},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1080\/00087041.2021.1986616","article-title":"Choriented maps: Visualizing SDG data on mobile devices","volume":"59","author":"Gorte","year":"2022","journal-title":"Cartogr. J."},{"key":"ref_119","unstructured":"Taylor, D.R.F. (1983). Graphic Communication and Design in Contemporary Cartography, John Wiley & Sons."},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1016\/j.promfg.2015.07.258","article-title":"Methodological implications of confederate use for experimentation in safety-critical domains","volume":"3","author":"Leis","year":"2015","journal-title":"Procedia Manuf."},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1080\/14640747708400622","article-title":"Memorability, word frequency and negative recognition","volume":"29","author":"Brown","year":"1977","journal-title":"Q. J. Exp. Psychol."},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"438","DOI":"10.3389\/fphar.2017.00438","article-title":"The neuroanatomical, neurophysiological and psychological basis of memory: Current models and their origins","volume":"8","author":"Camina","year":"2017","journal-title":"Front. Pharmacol."},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1016\/S0020-7373(86)80019-0","article-title":"An experiment in graphical perception","volume":"25","author":"Cleveland","year":"1986","journal-title":"Int. J.-Man-Mach. Stud."},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1007\/BF02289045","article-title":"A proposed method for absolute ratio scaling","volume":"15","author":"Comrey","year":"1950","journal-title":"Psychometrika"},{"key":"ref_125","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1037\/0096-1523.16.4.683","article-title":"Visual psychophysics of simple graphical elements","volume":"16","author":"Spence","year":"1990","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/7\/7\/73\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:14:05Z","timestamp":1760127245000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/7\/7\/73"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,18]]},"references-count":125,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["mti7070073"],"URL":"https:\/\/doi.org\/10.3390\/mti7070073","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,18]]}}}