{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T18:55:46Z","timestamp":1769021746420,"version":"3.49.0"},"reference-count":102,"publisher":"Springer Science and Business Media LLC","issue":"26","license":[{"start":{"date-parts":[[2023,3,23]],"date-time":"2023-03-23T00:00:00Z","timestamp":1679529600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,23]],"date-time":"2023-03-23T00:00:00Z","timestamp":1679529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2023,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Digital platforms are becoming critical infrastructures for supporting a variety of innovative services that enhance our everyday lives. These platforms need to offer not only rational services but also ludic or slow services that focus on human pleasure. One important aspect of creating innovative digital platforms is that their concrete requirements and potential opportunities are vague before they are designed. Thus, designing, prototyping and evaluating digital platforms iteratively is essential for refining or customizing them, as knowledge is gradually gained throughout these iterations. However, it is costly to develop prototype platforms and evaluate them with traditional methods. A better tool that can be used to reveal these platforms\u2019 potential opportunities by conceiving them in a simple and rapid way is needed. In this paper, we present our journey to develop nine digital platforms that share collective human sight and hearing with the Human-Material-Pleasure (HMP) annotation method, which is a tool that we use to describe the visually structured annotations of multiple digital platforms based on the annotated portfolio method. The most significant part of the paper presents annotated portfolios based on the HMP annotation method for the nine digital platforms that we develop and shows how these annotated portfolios play an essential role in revealing and exploring the potential opportunities of our platforms during the refinement process. We also discuss how the HMP annotation method is used in the context of exploring the potential opportunities of wearable shape-changing robotic devices; these devices have significantly different characteristics from our digital platforms, which allows for showing insights more objectively by extracting diverse insights from an alternative angle.<\/jats:p>","DOI":"10.1007\/s11042-023-15124-3","type":"journal-article","created":{"date-parts":[[2023,3,23]],"date-time":"2023-03-23T12:03:01Z","timestamp":1679572981000},"page":"39961-40008","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Designing innovative digital platforms from both human and nonhuman perspectives"],"prefix":"10.1007","volume":"82","author":[{"given":"Risa","family":"Kimura","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5116-2128","authenticated-orcid":false,"given":"Tatsuo","family":"Nakajima","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,3,23]]},"reference":[{"key":"15124_CR1","doi-asserted-by":"publisher","unstructured":"Al-Sada M, H\u00f6glund T, Khamis M, Urbani J, Nakajima T (2019) Orochi: Investigating requirements and expectations for multipurpose daily used supernumerary robotic limbs. In proceedings of the 10th augmented human international conference 2019 (AH2019). Association for Computing Machinery, New York, NY, USA, article 37. pp.1\u20139 https:\/\/doi.org\/10.1145\/3311823.3311850","DOI":"10.1145\/3311823.3311850"},{"key":"15124_CR2","doi-asserted-by":"crossref","unstructured":"Al-Sada M, Jiang K, Ranade S, Kalkattawi M, Nakajima T (2020) HapticSnakes: multi-haptic feedback wearable robots for immersive virtual reality, Virtual Reality 24. pp. 191\u2013209","DOI":"10.1007\/s10055-019-00404-x"},{"issue":"6","key":"15124_CR3","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1109\/MC.2010.170","volume":"43","author":"D Anguelov","year":"2010","unstructured":"Anguelov D, Dulong C, Filip D, Frueh C, Lafon S, Lyon R, Ogale A, Vincent L, Weaver J (2010) Google street view: capturing the world at street level. Computer 43(6):32\u201338. https:\/\/doi.org\/10.1109\/MC.2010.170","journal-title":"Computer"},{"issue":"3","key":"15124_CR4","doi-asserted-by":"publisher","first-page":"801","DOI":"10.1086\/345321","volume":"28","author":"K Barad","year":"2003","unstructured":"Barad K (2003) Posthumanist performativity: toward an understanding of how matter comes to matter. Signs J Women Cult Soc 28(3):801\u2013831","journal-title":"Signs J Women Cult Soc"},{"key":"15124_CR5","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctv12101zq","volume-title":"Meeting the university Halfway: quantum physics and the entanglement of matter and meaning","author":"K Barad","year":"2007","unstructured":"Barad K (2007) Meeting the university Halfway: quantum physics and the entanglement of matter and meaning. Duke University Press"},{"issue":"3","key":"15124_CR6","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1145\/2491500.2491502","volume":"20","author":"S Benford","year":"2013","unstructured":"Benford S, Greenhalgh C, Crabtree A, Flintham M, Walker B, Marshall J, Koleva B, Egglestone SR, Giannachi G, Adams M, andavanitj N, Farr JR (2013) Performance-Led Research in the Wild. ACM Trans Comput-Human Int 20(3) Article 14:22. https:\/\/doi.org\/10.1145\/2491500.2491502","journal-title":"ACM Trans Comput-Human Int"},{"issue":"9","key":"15124_CR7","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1145\/2500468.2500889","volume":"56","author":"S Benford","year":"2013","unstructured":"Benford S, Greenhalgh C, Giannachi G, Walker B, Marshall J, Rodden T (2013) Uncomfortable user experience. Commun ACM 56(9):66\u201373. https:\/\/doi.org\/10.1145\/2500468.2500889","journal-title":"Commun ACM"},{"key":"15124_CR8","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1162\/dmal.9780262693646.117","volume-title":"The John D. and Catherine T. MacArthur Foundation series on digital media and learning","author":"I Bogost","year":"2008","unstructured":"Bogost I (2008) The rhetoric of video games. In the ecology of games: connecting youth, games, and learning. In: Salen K (ed) The John D. and Catherine T. MacArthur Foundation series on digital media and learning. The MIT press, Cambridge, pp 117\u2013140. https:\/\/doi.org\/10.1162\/dmal.9780262693646.117"},{"key":"15124_CR9","volume-title":"What\u2019s mine is yours: the rise of collaborative consumption","author":"R Botsman","year":"2010","unstructured":"Botsman R, Rogers R (2010) What\u2019s mine is yours: the rise of collaborative consumption. Harper Business"},{"key":"15124_CR10","doi-asserted-by":"publisher","unstructured":"Bowers J (2012) The Logic of Annotated Portfolios: Communicating the Value of \u201cResearch Through Design\u201d. In: Proceedings of the Designing Interactive Systems Conference (DIS \u201812). pp 68\u201377 https:\/\/doi.org\/10.1145\/2317956.2317968","DOI":"10.1145\/2317956.2317968"},{"key":"15124_CR11","doi-asserted-by":"publisher","unstructured":"Chang W-W, Giaccardi E, Chen L-L, Liang R-H (2017) \u201cInterview with Things\u201d: A First-thing Perspective to Understand the Scooter's Everyday Socio-material Network in Taiwan. In: Proceedings of the 2017 Conference on designing interactive systems (DIS '17). Association for Computing Machinery, New York, USA, pp 1001\u20131012. https:\/\/doi.org\/10.1145\/3064663.3064717","DOI":"10.1145\/3064663.3064717"},{"key":"15124_CR12","unstructured":"Chinese Number Hand Gesture, https:\/\/www.thatsmags.com\/shanghai\/post\/17604\/if-you-didn-t-already-know-china-uses-hand-signs-to-express-numbers (Accessed September 15 2022)"},{"key":"15124_CR13","doi-asserted-by":"publisher","unstructured":"Coulton P, Lindley JG (2019) More-than human Centred design: considering other things. Des J Int J All Aspects Des 22(4). https:\/\/doi.org\/10.1080\/14606925.2019.1614320","DOI":"10.1080\/14606925.2019.1614320"},{"issue":"3","key":"15124_CR14","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1162\/074793601750357196","volume":"17","author":"N Cross","year":"2001","unstructured":"Cross N (2001) Designerly ways of knowing: design discipline versus design science. Des Issues 17(3):49\u201355","journal-title":"Des Issues"},{"key":"15124_CR15","doi-asserted-by":"publisher","unstructured":"Cruickshank L, Trivedi N (2017) Beyond human-Centred design: supporting a new materiality in the internet of things, or how to design when a toaster is one of your users. Des J Int J All Aspects Des 20(5). https:\/\/doi.org\/10.1080\/14606925.2017.1349381","DOI":"10.1080\/14606925.2017.1349381"},{"key":"15124_CR16","doi-asserted-by":"publisher","unstructured":"Cul\u00e9n AL, B\u00f8rsting J, Odom W (2019) Mediating relatedness for adolescents with ME: reducing isolation through minimal interactions with a robot avatar. In: proceedings of the 2019 on designing interactive systems conference (DIS \u201819). pp 359\u2013371 https:\/\/doi.org\/10.1145\/3322276.3322319","DOI":"10.1145\/3322276.3322319"},{"key":"15124_CR17","doi-asserted-by":"publisher","first-page":"1633","DOI":"10.1145\/3357236.3395490","volume-title":"Strategies for Annotating Portfolios: Mapping Designs for New Domains. In Proceedings of the 2020 ACM designing interactive systems conference (DIS \u201820)","author":"AL Cul\u00e9n","year":"2020","unstructured":"Cul\u00e9n AL, B\u00f8rsting J, Gaver W (2020) Strategies for Annotating Portfolios: Mapping Designs for New Domains. In Proceedings of the 2020 ACM designing interactive systems conference (DIS \u201820). Association for Computing Machinery, New York, USA, pp 1633\u20131645. https:\/\/doi.org\/10.1145\/3357236.3395490"},{"key":"15124_CR18","doi-asserted-by":"publisher","unstructured":"Dalsgaard P, Dindler C (2014) Between theory and practice: bridging concepts in HCI research. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI \u201814). pp 1635\u20131644 https:\/\/doi.org\/10.1145\/2556288.2557342","DOI":"10.1145\/2556288.2557342"},{"key":"15124_CR19","unstructured":"Desmet P (2002) Designing emotions, Dissertation Thesis, TU Delft, Faculty Industr Des Eng"},{"key":"15124_CR20","volume-title":"Speculative everything: design, fiction, and social dreaming","author":"A Dunne","year":"2013","unstructured":"Dunne A, Raby F (2013) Speculative everything: design, fiction, and social dreaming. The MIT Press"},{"key":"15124_CR21","doi-asserted-by":"crossref","unstructured":"England D, Schiphorst T, Bryan-Kinns N (2016) Curating the digital: space for art and interaction, springer","DOI":"10.1007\/978-3-319-28722-5"},{"key":"15124_CR22","volume-title":"Matchmakers: The New Economics of Multisided Platforms","author":"DS Evans","year":"2016","unstructured":"Evans DS, Schmalensee R (2016) Matchmakers: The New Economics of Multisided Platforms. Harvard Business Review Press"},{"issue":"3","key":"15124_CR23","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/s12130-007-9022-8","volume":"20","author":"D Fallman","year":"2007","unstructured":"Fallman D (2007) Why research-oriented design isn\u2019t design-oriented research: on the tensions between design and research in an implicit design discipline. Knowl Technol Policy 20(3):193\u2013200. https:\/\/doi.org\/10.1007\/s12130-007-9022-8","journal-title":"Knowl Technol Policy"},{"key":"15124_CR24","volume-title":"Against method","author":"PK Feyerabend","year":"1975","unstructured":"Feyerabend PK (1975) Against method. Verso Bookds, New York"},{"key":"15124_CR25","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1145\/3364998","volume":"27","author":"C Frauenberger","year":"2019","unstructured":"Frauenberger C (2019) Entanglement HCI the next wave? ACM Transac Comput-Human Inter 27, Vo.1, article 2:27. https:\/\/doi.org\/10.1145\/3364998","journal-title":"ACM Transac Comput-Human Inter"},{"key":"15124_CR26","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1145\/2858036.2858050","volume-title":"Proceedings of the 2016 CHI conference on human factors in computing systems (CHI '16)","author":"C Frauenberger","year":"2016","unstructured":"Frauenberger C, Makhaeva J, Spiel K (2016) Designing Smart Objects with Autistic Children: Four Design Expos\u00e8s. In: Proceedings of the 2016 CHI conference on human factors in computing systems (CHI '16). Association for Computing Machinery, New York, USA, pp 130\u2013139. https:\/\/doi.org\/10.1145\/2858036.2858050"},{"key":"15124_CR27","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7585.001.0001","volume-title":"Value sensitive design: shaping technology with moral imagination","author":"B Friedman","year":"2019","unstructured":"Friedman B, Hendry DG (2019) Value sensitive design: shaping technology with moral imagination. The MIT Press"},{"key":"15124_CR28","doi-asserted-by":"crossref","unstructured":"Fuchsberger V, Murer M, Tscheligi M (2013) Materials, materiality, and media. In: proceedings of the SIGCHI conference on human factors in computing systems. ACM. pp 2853\u20132862 http:\/\/dl.acm.org\/citation.cfm?id=2481395","DOI":"10.1145\/2470654.2481395"},{"key":"15124_CR29","doi-asserted-by":"publisher","unstructured":"Gaver W (2012) What should we expect from research through design? In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI \u201812). pp 937\u2013946 https:\/\/doi.org\/10.1145\/2207676.2208538","DOI":"10.1145\/2207676.2208538"},{"issue":"4","key":"15124_CR30","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1145\/2212877.2212889","volume":"19","author":"W Gaver","year":"2012","unstructured":"Gaver W, Bowers J (2012) Annotated portfolios. Interactions 19(4):40\u201349. https:\/\/doi.org\/10.1145\/2212877.2212889","journal-title":"Interactions"},{"issue":"1","key":"15124_CR31","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1145\/291224.291235","volume":"6","author":"B Gaver","year":"1999","unstructured":"Gaver B, Dunne T, Pacenti E (1999) Design: Cultural probes. Interactions 6(1):21\u201329. https:\/\/doi.org\/10.1145\/291224.291235","journal-title":"Interactions"},{"key":"15124_CR32","doi-asserted-by":"publisher","unstructured":"Gaver WW, Beaver J, Benford S (2003) Ambiguity as a resource for design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). Association for Computing Machinery, New York, USA. pp 233\u2013240 https:\/\/doi.org\/10.1145\/642611.642653","DOI":"10.1145\/642611.642653"},{"key":"15124_CR33","volume-title":"Chapter 43: The Encyclopedia of Human-Computer Interaction. 2nd Ed","author":"E Giaccardi","year":"2017","unstructured":"Giaccardi E, Stappers PJ (2017) Research through Design. In: Chapter 43: The Encyclopedia of Human-Computer Interaction. 2nd Ed. Interaction Design Foundation"},{"key":"15124_CR34","unstructured":"Google Glass, https:\/\/www.google.com\/glass\/ (Accessed September 15 2021)"},{"key":"15124_CR35","unstructured":"Haidt L (2014) Nonprofits Imagine a Better Sharing Economy, http:\/\/forums.techsoup.org\/cs\/community\/b\/tsblog\/archive\/2014\/05\/14\/nonprofits-imagine-a-better-sharing-economy.aspx (Accessed 2021\/1\/30)"},{"issue":"2","key":"15124_CR36","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1080\/20511787.2020.1751960","volume":"8","author":"C Hall","year":"2020","unstructured":"Hall C (2020) TAKING NOTE: annotated portfolio as a method to analyse the experience of design research practice. J Text Des Res Practice 8(2):209\u2013231. https:\/\/doi.org\/10.1080\/20511787.2020.1751960","journal-title":"J Text Des Res Practice"},{"issue":"9","key":"15124_CR37","doi-asserted-by":"publisher","first-page":"2047","DOI":"10.1002\/asi.23552","volume":"67","author":"J Hamari","year":"2015","unstructured":"Hamari J, Sj\u00f6klint M, Ukkonen A (2015) The sharing economy: why people participate in collaborative consumption. J Assoc Inf Sci Technol 67(9):2047\u20132059. https:\/\/doi.org\/10.1002\/asi.23552","journal-title":"J Assoc Inf Sci Technol"},{"issue":"2","key":"15124_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/08873260701274017","volume":"35","author":"G Hartelius","year":"2007","unstructured":"Hartelius G, Caplan M, Rardin MA (2007) Transpersonal psychology: defining the past, divining the future. Humanist Psychol 35(2):1\u201326","journal-title":"Humanist Psychol"},{"key":"15124_CR39","volume-title":"The encyclopedia of human-computer Interaction","author":"M Hassenzahl","year":"2013","unstructured":"Hassenzahl M (2013) User experience and experience design. In: The encyclopedia of human-computer Interaction. The Interaction Design Foundation"},{"key":"15124_CR40","doi-asserted-by":"publisher","unstructured":"Hauser S, Wakkary R, Odom W, Verbeek PP, Desjardins A, Lin H, Dalton M, Schilling M, De Boer G (2018) Deployments of the table-non-table: a reflection on the relation between theory and things in the practice of design research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. pp 201:1\u201313 https:\/\/doi.org\/10.1145\/3173574.3173775","DOI":"10.1145\/3173574.3173775"},{"key":"15124_CR41","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1145\/3196709.3196745","volume-title":"Proceedings of the 2018 Designing Interactive Systems Conference (DIS \u201818)","author":"S Hauser","year":"2018","unstructured":"Hauser S, Oogjes D, Wakkary R, Verbeek P-P (2018) An Annotated Portfolio on Doing Postphenomenology Through Research Products. In: Proceedings of the 2018 Designing Interactive Systems Conference (DIS \u201818). Association for Computing Machinery, New York, USA, pp 459\u2013471. https:\/\/doi.org\/10.1145\/3196709.3196745"},{"key":"15124_CR42","doi-asserted-by":"crossref","unstructured":"Hobye M, Padfield N, L\u00f6wgren N (2013) Designing social play through interpersonal touch: an annotated portfolio. Nordic design research, Vol. 5","DOI":"10.21606\/nordes.2013.041"},{"issue":"3","key":"15124_CR43","doi-asserted-by":"publisher","first-page":"23:1","DOI":"10.1145\/2362364.2362371","volume":"19","author":"K H\u00f6\u00f6k","year":"2012","unstructured":"H\u00f6\u00f6k K, L\u00f6wgren J (2012) Strong concepts: intermediate-level knowledge in interaction design research. ACM Trans. Computer-human Interaction 19(3):23:1\u201323:18. https:\/\/doi.org\/10.1145\/2362364.2362371","journal-title":"ACM Trans. Computer-human Interaction"},{"key":"15124_CR44","doi-asserted-by":"publisher","unstructured":"H\u00f6\u00f6k K, Dalsgaard P, Reeves S, Bardzell J, L\u00f6wgren J, Stolterman E, Rogers Y (2015) Knowledge production in interaction design. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). Association for Computing Machinery, New York, USA. pp 2429\u20132432 https:\/\/doi.org\/10.1145\/2702613.2702653","DOI":"10.1145\/2702613.2702653"},{"key":"15124_CR45","doi-asserted-by":"publisher","unstructured":"Ikeuchi K, Otsuka T, Yoshii A, Sakamoto M, Nakajima T (2014) KinecDrone: enhancing somatic sensation to fly in the sky with Kinect and AR.Drone. In: Proceedings of the 5th Augmented Human International Conference (AH '14). ACM, New York, USA, article 53. p 2 https:\/\/doi.org\/10.1145\/2582051.2582104","DOI":"10.1145\/2582051.2582104"},{"key":"15124_CR46","doi-asserted-by":"publisher","first-page":"21329","DOI":"10.1007\/s11042-017-5595-8","volume":"77","author":"F Ishizawa","year":"2018","unstructured":"Ishizawa F, Sakamoto M, Nakajima T (2018) Extracting intermediate-level design knowledge for speculating digital\u2013physical hybrid alternate reality experiences. Multimed Tools Appl 77:21329\u201321370. https:\/\/doi.org\/10.1007\/s11042-017-5595-8","journal-title":"Multimed Tools Appl"},{"key":"15124_CR47","doi-asserted-by":"publisher","DOI":"10.4324\/9780203305683","volume-title":"Designing pleasurable Products: An Introduction to the New Human Factors","author":"PW Jordan","year":"2000","unstructured":"Jordan PW (2000) Designing pleasurable Products: An Introduction to the New Human Factors. CRC Press. https:\/\/doi.org\/10.4324\/9780203305683"},{"issue":"3","key":"15124_CR48","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1109\/MPRV.2018.03367740","volume":"17","author":"F Kawsar","year":"2018","unstructured":"Kawsar F, Min C, Mathur A, Montanari A (2018) Earables for personal-scale behavior analytics. IEEE Pervasive Comput 17(3):83\u201389. https:\/\/doi.org\/10.1109\/MPRV.2018.03367740","journal-title":"IEEE Pervasive Comput"},{"key":"15124_CR49","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1145\/1753326.1753390","volume-title":"The infrastructure problem in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10)","author":"W Keith Edwards","year":"2010","unstructured":"Keith Edwards W, Newman MW, Poole ES (2010) The infrastructure problem in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, USA, pp 423\u2013432. https:\/\/doi.org\/10.1145\/1753326.1753390"},{"key":"15124_CR50","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.futures.2014.12.004","volume":"70","author":"A Kelliher","year":"2015","unstructured":"Kelliher A, Byrne D (2015) Design futures in action: documenting experiential futures for participatory audiences. Futures 70:36\u201347","journal-title":"Futures"},{"key":"15124_CR51","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-50439-7_14","volume-title":"Augmented Cognition. Human Cognition and Behavior. HCII 2020. Lecture notes in computer science, vol 12197","author":"R Kimura","year":"2020","unstructured":"Kimura R, Nakajima T (2020) Gathering People\u2019s Happy Moments from Collective Human Eyes and Ears for a Wellbeing and Mindful Society. In: Schmorrow D, Fidopiastis C (eds) Augmented Cognition. Human Cognition and Behavior. HCII 2020. Lecture notes in computer science, vol 12197. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-030-50439-7_14"},{"issue":"5","key":"15124_CR52","doi-asserted-by":"publisher","first-page":"298:1","DOI":"10.1007\/s42979-020-00313-w","volume":"1","author":"R Kimura","year":"2020","unstructured":"Kimura R, Nakajima T (2020) Collectively sharing People\u2019s visual and auditory capabilities: Exploring opportunities and pitfalls. SN Computer Science 1(5):298:1\u2013298:24, Springer Nature. https:\/\/doi.org\/10.1007\/s42979-020-00313-w","journal-title":"SN Computer Science"},{"key":"15124_CR53","doi-asserted-by":"crossref","unstructured":"Kimura R, Nakajima T (2021) Collectively sharing human hearing in artful CollectiveEars. In: Proceedings of the 9th International Conference on Distributed, Ambient and Pervasive Interactions (DAPI 2021)","DOI":"10.1007\/978-3-030-77015-0_16"},{"key":"15124_CR54","doi-asserted-by":"crossref","unstructured":"Kimura R, Nakajima T (2021) Hunting lovely and serendipitous eye sights through sharing collective human eye views. In: Proceedings of the 23rd International Conference on Information Integration and Web-based Applications & Services (iiWAS 2021)","DOI":"10.1145\/3487664.3487675"},{"key":"15124_CR55","doi-asserted-by":"crossref","unstructured":"Kimura R, Nakajima T (2021) CollectiveEars: sharing collective People\u2019s hearing capability, in proceedings of the 23rd international conference on information integration and web-based applications & services (iiWAS 2021)","DOI":"10.1145\/3487664.3487801"},{"key":"15124_CR56","doi-asserted-by":"crossref","unstructured":"Kimura R, Nakajima T (2021) Ambient photomontage: Ambiently presenting multiple perspectives on a human visual perspective. In: Proceedings of the 12th international symposium on ambient intelligence (ISAmI 2021)","DOI":"10.1007\/978-3-031-06894-2_14"},{"key":"15124_CR57","doi-asserted-by":"crossref","unstructured":"Kimura R, Nakajima T (2021) Gamification in CollectiveEyes. In: proceedings of the IEEE 10th Global Conference on Consumer Electronics (GCCE 2021)","DOI":"10.1109\/GCCE53005.2021.9622036"},{"key":"15124_CR58","doi-asserted-by":"crossref","unstructured":"Kimura R, Nakajima T (2022) Case studies to enhance collectively sharing human hearing: ambient sounds memory and mindful speaker. In: Proceedings of the 10th International Conference on Distributed, Ambient and Pervasive Interactions (DAPI 2022)","DOI":"10.1007\/978-3-031-05431-0_26"},{"key":"15124_CR59","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58356-9_2","volume-title":"Ambient Intelligence \u2013 Software and Applications. ISAmI 2020. Advances in Intelligent Systems and Computing, vol 1239","author":"R Kimura","year":"2020","unstructured":"Kimura R, Jiang K, Zhang D, Nakajima T (2020) Society of \u201cCitizen Science through Dancing\u201d. In: Novais P, Vercelli G, Larriba-Pey JL, Herrera F, Chamoso P (eds) Ambient Intelligence \u2013 Software and Applications. ISAmI 2020. Advances in Intelligent Systems and Computing, vol 1239. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-030-58356-9_2"},{"key":"15124_CR60","volume-title":"Experiential learning: experience as the source of learning and development. 2nd edition","author":"DA Kolb","year":"2015","unstructured":"Kolb DA (2015) Experiential learning: experience as the source of learning and development. 2nd edition. Pearson Education, Inc., Upper Saddle River"},{"key":"15124_CR61","doi-asserted-by":"crossref","unstructured":"Koskinen I, Zimmerman J, Binder T, Redstr\u00f6m J, Wensveen S. 2012. Design research through practice: from the lab, field, and showroom, Morgan Kaufmann, Field","DOI":"10.1016\/B978-0-12-385502-2.00006-7"},{"issue":"2","key":"15124_CR62","first-page":"4","volume":"3","author":"K Krippendorff","year":"1984","unstructured":"Krippendorff K, Butter R (1984) Product semantics: exploring the symbolic qualities of form. Innovation 3(2):4\u20139","journal-title":"Innovation"},{"key":"15124_CR63","volume-title":"Ethnographies of Collaborative Economies Conference Proceedings","author":"J Larner","year":"2019","unstructured":"Larner J (2019) Reflective ethnographic design of collaborative economy models using annotated portfolios. In: Travlou P, Ciolfi L (eds) Ethnographies of Collaborative Economies Conference Proceedings. University of Edinburgh ISBN 978-1-912669-11-0. Paper no. 8"},{"key":"15124_CR64","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780199256044.001.0001","volume-title":"Reassembling the social: an introduction to actor-network-theory","author":"B Latour","year":"2005","unstructured":"Latour B (2005) Reassembling the social: an introduction to actor-network-theory. Oxford University press, Oxford, New York"},{"key":"15124_CR65","doi-asserted-by":"crossref","unstructured":"Leonardi PM (2010) Digital materiality? How artifacts without matter, matter, First Monday, 15, 6. http:\/\/firstmonday.org\/htbin\/cgiwrap\/bin\/ojs\/index.php\/fm\/article\/view\/3036\/2567","DOI":"10.5210\/fm.v15i6.3036"},{"issue":"1","key":"15124_CR66","doi-asserted-by":"publisher","first-page":"147","DOI":"10.2307\/23043493","volume":"35","author":"PM Leonardi","year":"2011","unstructured":"Leonardi PM (2011) When flexible routines meet flexible technologies: affordance, constraint, and the imbrication of human and material agencies. MIS Q 35(1):147\u2013167","journal-title":"MIS Q"},{"issue":"1","key":"15124_CR67","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1080\/17547075.2019.1567985","volume":"11","author":"A Light","year":"2019","unstructured":"Light A (2019) Design and social innovation at the margins: finding and making cultures of plurality. Des Cult 11(1):13\u201335. https:\/\/doi.org\/10.1080\/17547075.2019.1567985","journal-title":"Des Cult"},{"key":"15124_CR68","doi-asserted-by":"publisher","unstructured":"Lindtner S, Hertz GD, Dourish P (2014) Emerging sites of HCI innovation: hackerspaces, Hardware Startups & Incubators. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI \u201814). pp 439\u2013448 https:\/\/doi.org\/10.1145\/2556288.2557132","DOI":"10.1145\/2556288.2557132"},{"issue":"1","key":"15124_CR69","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1145\/2405716.2405725","volume":"20","author":"J L\u00f6wgren","year":"2013","unstructured":"L\u00f6wgren J (2013) Annotated portfolios and other forms of intermediate-level knowledge. Interactions 20(1):30\u201334. https:\/\/doi.org\/10.1145\/2405716.2405725","journal-title":"Interactions"},{"key":"15124_CR70","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9873.001.0001","volume-title":"Design, when everybody designs: an introduction to design for social innovation","author":"E Manzini","year":"2015","unstructured":"Manzini E (2015) Design, when everybody designs: an introduction to design for social innovation. MIT press"},{"key":"15124_CR71","unstructured":"Marita S, Conny B, Ruud B (2018) Annotated portfolios as a method to analyze interview. In: Proceedings of Design Research Society 2018. pp 1148-1158"},{"key":"15124_CR72","unstructured":"Mitrovi\u0107 I, Golub M, \u0160uran O (2015) Design fiction: Eutropia \u2013 introduction to speculative design practice, HDD & DVK UMAS, Zagreb\/Split"},{"issue":"1","key":"15124_CR73","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1007\/s00779-011-0469-y","volume":"17","author":"T Nakajima","year":"2013","unstructured":"Nakajima T, Lehdonvirta V (2013) Designing motivation using persuasive ambient mirrors. Pers Ubiquit Comput 17(1):107\u2013126. https:\/\/doi.org\/10.1007\/s00779-011-0469-y","journal-title":"Pers Ubiquit Comput"},{"key":"15124_CR74","doi-asserted-by":"publisher","unstructured":"Odom WT, Sellen AJ, Banks R, Kirk DS, Regan T, Selby M, Forlizzi JL, Zimmerman J (2014) Designing for slowness, anticipation and re-visitation: a long term field study of the Photobox. In: Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI \u201814). pp 1961\u20131970 https:\/\/doi.org\/10.1145\/2556288.2557178","DOI":"10.1145\/2556288.2557178"},{"issue":"5","key":"15124_CR75","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1111\/joms.12114","volume":"52","author":"WJ Orlikowski","year":"2015","unstructured":"Orlikowski WJ, Scott SV (2015) Exploring material-discursive practices. J Manag Stud 52(5):697\u2013705","journal-title":"J Manag Stud"},{"issue":"4","key":"15124_CR76","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1287\/orsc.6.4.423","volume":"6","author":"WJ Orlikowski","year":"1995","unstructured":"Orlikowski WJ, Yates JA, Okamura K, Fujimoto M (1995) Shaping electronic communication: The metastruczturing of technology in the context of use. Organ Sci 6(4):423\u2013444","journal-title":"Organ Sci"},{"key":"15124_CR77","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1007\/s10209-018-0639-z","volume":"19","author":"D Pal","year":"2020","unstructured":"Pal D, Funilkul S, Vanijja V (2020) The future of smartwatches: assessing the end-users\u2019 continuous usage using an extended expectation-confrmation model. Univ Access Inf Soc 19:261\u2013281. https:\/\/doi.org\/10.1007\/s10209-018-0639-z","journal-title":"Univ Access Inf Soc"},{"issue":"3","key":"15124_CR78","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1108\/JFMM-04-2018-0062","volume":"23","author":"ERG Pedersen","year":"2019","unstructured":"Pedersen ERG, Earley R, Andersen KR (2019) From singular to plural: exploring organisational complexities and circular business model design. J Fashion Market Manag Int J 23(3):308\u2013326","journal-title":"J Fashion Market Manag Int J"},{"key":"15124_CR79","volume-title":"Personal knowledge","author":"M Polanyi","year":"1958","unstructured":"Polanyi M (1958) Personal knowledge. University of Chicago Press, Chicago"},{"key":"15124_CR80","doi-asserted-by":"crossref","unstructured":"Rauchs M, Glidden A, Gordon B, Pieters G, Recanatini M, Rostand F, Vagneur K, Zhang B (2018) Distributed Ledger Technology Systems: a conceptual framework. Centre for Alternative Finance, Cambridge","DOI":"10.2139\/ssrn.3230013"},{"key":"15124_CR81","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/11160.001.0001","volume-title":"Making design theory","author":"J Redstr\u00f6m","year":"2017","unstructured":"Redstr\u00f6m J (2017) Making design theory. The MIT Press, Cambridge, Massachusetts"},{"key":"15124_CR82","doi-asserted-by":"publisher","first-page":"12539","DOI":"10.1007\/s11042-016-3665-y","volume":"76","author":"M Sakamoto","year":"2017","unstructured":"Sakamoto M, Nakajima T, Akioka S (2017) Gamifying collective human behavior with gameful digital rhetoric. Multimed Tools Appl 76:12539\u201312581. https:\/\/doi.org\/10.1007\/s11042-016-3665-y","journal-title":"Multimed Tools Appl"},{"key":"15124_CR83","volume-title":"Collaborative design","author":"EBN Sanders","year":"2000","unstructured":"Sanders EBN (2000) Generative tools for co-designing. In: Scrivener SAR, Ball LJ, Woodcock A (eds) Collaborative design. Springer, London"},{"key":"15124_CR84","unstructured":"Schifferstein HNJ, Hekkert P (2011) Product Experience, Elsevier Science"},{"key":"15124_CR85","volume-title":"The reflective practitioner: how professionals think in action","author":"DA Sch\u00f6n","year":"1983","unstructured":"Sch\u00f6n DA (1983) The reflective practitioner: how professionals think in action. Basic Books, New York"},{"key":"15124_CR86","doi-asserted-by":"publisher","first-page":"878","DOI":"10.1037\/0022-3514.58.5.878","volume":"58","author":"SH Schwartz","year":"1990","unstructured":"Schwartz SH, Bilsky W (1990) Toward a theory of the universal content and structure of values: extensions and cross cultural replications. J Pers Soc Psychol 58:878\u2013891","journal-title":"J Pers Soc Psychol"},{"issue":"4","key":"15124_CR87","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/3419764","volume":"10","author":"B Shneiderman","year":"2020","unstructured":"Shneiderman B (2020) Bridging the Gap Between Ethics and Practice: Guidelines for Reliable, Safe, and Trustworthy Human-centered AI Systems. ACM Trans Int Intel Syst 10(4) Article 26:31. https:\/\/doi.org\/10.1145\/3419764","journal-title":"ACM Trans Int Intel Syst"},{"key":"15124_CR88","unstructured":"Shneiderman B (2020) Human-Centered AI: A second Copernican Revolution, AIS Transactions on Human-Computer Interaction, Vol.12, No.3 (September 2020)"},{"key":"15124_CR89","doi-asserted-by":"crossref","unstructured":"Smith A (2017) Social Innovation, Democracy and Makerspaces. Social Science Research Network, Rochester. Retrieved December 5, 2019 from https:\/\/papers.ssrn.com\/abstract=2986245","DOI":"10.2139\/ssrn.2986245"},{"key":"15124_CR90","unstructured":"Srivastava S, Cul\u00e9n AL (2017) Designing for the second-hand use of consumer goods. In: Proceedings of the International Conference Interfaces and Human Computer Interaction. pp. 193\u2013206"},{"issue":"2","key":"15124_CR91","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1080\/07370020903586696","volume":"25","author":"E Stolterman","year":"2010","unstructured":"Stolterman E, Wiberg M (2010) Concept driven interaction design research. Human\u2013Comput Int 25(2):95\u2013118. https:\/\/doi.org\/10.1080\/07370020903586696","journal-title":"Human\u2013Comput Int"},{"issue":"1","key":"15124_CR92","first-page":"5","volume":"5","author":"L Suchman","year":"1998","unstructured":"Suchman L (1998) Human\/Machine Reconsidered. Cogn Stud 5(1):5\u201313","journal-title":"Cogn Stud"},{"key":"15124_CR93","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/11192.001.0001","volume-title":"Discursive design: critical, speculative, and alternative things","author":"BM Tharp","year":"2019","unstructured":"Tharp BM, Tharp SM (2019) Discursive design: critical, speculative, and alternative things. The MIT Press"},{"key":"15124_CR94","unstructured":"The Agoraphobic Traveller, https:\/\/www.pinterest.jp\/ashleyschleeper\/jacqui-kenny\/ (Accessed September 15 2022)"},{"key":"15124_CR95","volume-title":"The pursuit of pleasure","author":"L Tiger","year":"1992","unstructured":"Tiger L (1992) The pursuit of pleasure. Little Brown & Co."},{"key":"15124_CR96","doi-asserted-by":"publisher","unstructured":"Urbani J, Al-Sada M, Nakajima T, H\u00f6glund T (2018) Exploring Augmented Reality Interaction for Everyday Multipurpose Wearable Robots. In: Proceedings of the IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA), Hakodate. pp 209\u2013216 https:\/\/doi.org\/10.1109\/RTCSA.2018.00033","DOI":"10.1109\/RTCSA.2018.00033"},{"key":"15124_CR97","volume-title":"The moral status of technical artefacts. Philosophy of engineering and technology, vol 17","author":"I van de Poel","year":"2014","unstructured":"van de Poel I, Kroes P (2014) Can technology embody values? In: Kroes P, Verbeek PP (eds) The moral status of technical artefacts. Philosophy of engineering and technology, vol 17. Springer"},{"key":"15124_CR98","doi-asserted-by":"publisher","unstructured":"Vlachokyriakos V, Crivellaro C, Wright P, Olivier P (2018) Infrastructuring the solidarity economy: unpacking strategies and tactics in designing social innovation. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI \u201818). pp.481:1\u2013481:12 https:\/\/doi.org\/10.1145\/3173574.3174055","DOI":"10.1145\/3173574.3174055"},{"key":"15124_CR99","doi-asserted-by":"crossref","unstructured":"von Ahn L, Dabbish L (2008) Designing games with a purpose. Communication of the ACM, 51, 8","DOI":"10.1145\/1378704.1378719"},{"key":"15124_CR100","doi-asserted-by":"publisher","unstructured":"William WG, Bowers J, Boehner K, Boucher A, Cameron DWT, Hauenstein M, Jarvis N, Pennington S (2013) Indoor Weather Stations: Investigating a Ludic Approach to Environmental HCI Through Batch Prototyping. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI \u201813). pp 3451\u20133460 https:\/\/doi.org\/10.1145\/2470654.2466474","DOI":"10.1145\/2470654.2466474"},{"key":"15124_CR101","unstructured":"WindowSwap, https:\/\/www.window-swap.com\/(Accessed September 15 2022)"},{"key":"15124_CR102","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1007\/978-1-4939-0378-8_8","volume-title":"In ways of knowing in HCI","author":"J Zimmerman","year":"2014","unstructured":"Zimmerman J, Forlizzi J (2014) Research through design in HCI. In: Olson JS, Kellogg WA (eds) In ways of knowing in HCI. Springer, New York, pp 167\u2013189"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-15124-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-023-15124-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-15124-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,9]],"date-time":"2023-12-09T13:33:32Z","timestamp":1702128812000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-023-15124-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,23]]},"references-count":102,"journal-issue":{"issue":"26","published-print":{"date-parts":[[2023,11]]}},"alternative-id":["15124"],"URL":"https:\/\/doi.org\/10.1007\/s11042-023-15124-3","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,23]]},"assertion":[{"value":"25 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 September 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 March 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"On behalf of all authors, the corresponding author states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}