{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T00:58:39Z","timestamp":1767142719934,"version":"build-2238731810"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2023,8,29]],"date-time":"2023-08-29T00:00:00Z","timestamp":1693267200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,29]],"date-time":"2023-08-29T00:00:00Z","timestamp":1693267200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Nagoya University Interdisciplinary Frontier Fellowship"},{"name":"Microsoft Research CORE16 program"},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["22H03612"],"award-info":[{"award-number":["22H03612"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Sound symbolism is a well-researched topic of psycholinguistics, which tries to comprehend the connection between the sound of a word and its meanings. The\n                    <jats:italic>Bouba-Kiki effect<\/jats:italic>\n                    , one form of sound symbolism, claims that people perceive the pronunciation of \u201cKiki\u201d as pointier than that of \u201cBouba.\u201d There is no research that focuses on modeling such perception, i.e., how pointy a pronunciation sounds to humans, through computational and data-driven approaches. To address this, this paper first proposes the novel concept of \u201cphonetic pointiness\u201d defined as how pointy a shape humans are most likely to associate with a given pronunciation. We then model this phonetic pointiness from computational and data-driven approaches to calculate a score for an arbitrary pronunciation. There are three proposed models: a referential model, an expressive model, and a combined model, which integrates the previous two. The idea comes from an existing psycholinguistic classification of two types of sound symbolisms:\n                    <jats:italic>referential symbolism<\/jats:italic>\n                    and\n                    <jats:italic>expressive symbolism<\/jats:italic>\n                    , where the former relates to vocabulary knowledge, while the latter is based on pure human intuition. The proposed models are constructed only with image and language data available on the Web, therefore not requiring task-specific human annotations. We evaluate these models through a crowd-sourced user study, finding a promising correlation between human perception and the phonetic pointiness calculated by the proposed models. The results indicate that human perception can be modeled better by combining both types of sound symbolisms. Furthermore, by observing the behaviors of the models, we show several possible use-cases, such as product naming and psycholinguistic research, which can be a useful insight to further studies and applications.\n                  <\/jats:p>","DOI":"10.1007\/s11042-023-15732-z","type":"journal-article","created":{"date-parts":[[2023,8,28]],"date-time":"2023-08-28T23:27:10Z","timestamp":1693265230000},"page":"26183-26210","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Computational measurement of perceived pointiness from pronunciation"],"prefix":"10.1007","volume":"83","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2453-4560","authenticated-orcid":false,"given":"Chihaya","family":"Matsuhira","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9193-5973","authenticated-orcid":false,"given":"Marc A.","family":"Kastner","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3041-4330","authenticated-orcid":false,"given":"Takahiro","family":"Komamizu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3942-9296","authenticated-orcid":false,"given":"Ichiro","family":"Ide","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6290-9680","authenticated-orcid":false,"given":"Takatsugu","family":"Hirayama","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3799-4550","authenticated-orcid":false,"given":"Yasutomo","family":"Kawanishi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6040-4988","authenticated-orcid":false,"given":"Keisuke","family":"Doman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0603-8790","authenticated-orcid":false,"given":"Daisuke","family":"Deguchi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,8,29]]},"reference":[{"issue":"2","key":"15732_CR1","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/j.cognition.2012.09.007","volume":"126","author":"AJ Bremner","year":"2013","unstructured":"Bremner AJ, Caparos S, Davidoff J, de Fockert J, Linnell KJ, Spence C (2013) \u2018Bouba\u2019 and \u2018Kiki\u2019 in Namibia? A remote culture make similar shape-sound matches, but different shape-taste matches to Westerners. Cognition 126(2):165\u2013172. https:\/\/doi.org\/10.1016\/j.cognition.2012.09.007","journal-title":"Cognition"},{"key":"15732_CR2","doi-asserted-by":"publisher","unstructured":"Chen YC, Huang PC, Woods A, Spence C (2016) When \u2018Bouba\u2019 equals \u2018Kiki\u2019: Cultural commonalities and cultural differences in sound-shape correspondences. Sci. Rep. 6:26681_1\u201326681_9. https:\/\/doi.org\/10.1038\/srep26681","DOI":"10.1038\/srep26681"},{"key":"15732_CR3","doi-asserted-by":"publisher","unstructured":"\u0106wiek A, Fuchs S, Draxler C, Asu EL, Dediu D, Hiovain K, Kawahara S, Koutalidis S, Krifka M, Lippus P, Lupyan G, Oh G, Paul J, Petrone C, Ridouane R, Reiter S, Sch\u00fcmchen N, Szalontai \u00c1, \u00dcnal-Logacev \u00d6, Winter B (2021) The Bouba\/Kiki effect is robust across cultures and writing systems. Philos. Trans. Royal Soc. B Biol. Sci. 377:13p. https:\/\/doi.org\/10.1098\/rstb.2020.0390","DOI":"10.1098\/rstb.2020.0390"},{"issue":"2","key":"15732_CR4","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1177\/0023830914534951","volume":"58","author":"M Fort","year":"2015","unstructured":"Fort M, Martin A, Peperkamp S (2015) Consonants are more important than vowels in the Bouba-Kiki effect. Lang. Speech 58(2):247\u2013266. https:\/\/doi.org\/10.1177\/0023830914534951","journal-title":"Lang. Speech"},{"key":"15732_CR5","doi-asserted-by":"publisher","unstructured":"Fukusato T, Morishima S (2014) Automatic depiction of onomatopoeia in animation considering physical phenomena. In: Proc. 7th Int. Conf. Motion Games, pp. 161\u2013169. https:\/\/doi.org\/10.1145\/2668064.2668096","DOI":"10.1145\/2668064.2668096"},{"issue":"2","key":"15732_CR6","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1007\/s10844-005-0321-9","volume":"24","author":"O Gillet","year":"2005","unstructured":"Gillet O, Richard G (2005) Drum loops retrieval from spoken queries. J. Intell. Inf. Syst. 24(2):159\u2013177. https:\/\/doi.org\/10.1007\/s10844-005-0321-9","journal-title":"J. Intell. Inf. Syst."},{"key":"15732_CR7","unstructured":"Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Adv. Neural Inf. Process. Syst., vol. 27, 9p"},{"key":"15732_CR8","unstructured":"Heusel M, Ramsauer H, Unterthiner T, Nessler B, Hochreiter S (2017) GANs trained by a two time-scale update rule converge to a local Nash equilibrium. In: Adv. Neural Inf. Process. Syst., vol. 30, 12p"},{"key":"15732_CR9","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511751806","author":"L Hinton","year":"1995","unstructured":"Hinton L, Nichols J, Ohala JJ (1995) Sound Symbolism. Cambridge University Press, Cambridge, England, UK. https:\/\/doi.org\/10.1017\/CBO9780511751806","journal-title":"Cambridge University Press, Cambridge, England, UK"},{"issue":"8","key":"15732_CR10","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput. 9(8):1735\u20131780. https:\/\/doi.org\/10.1162\/neco.1997.9.8.1735","journal-title":"Neural Comput."},{"key":"15732_CR11","doi-asserted-by":"publisher","DOI":"10.1017\/9780511807954","volume-title":"Handbook of the International Phonetic Association: A Guide to the Use of the International Phonetic Alphabet","author":"International Phonetic Association","year":"1999","unstructured":"International Phonetic Association (1999) Handbook of the International Phonetic Association: A Guide to the Use of the International Phonetic Alphabet. Cambridge University Press, Cambridge, England, UK"},{"issue":"1","key":"15732_CR12","doi-asserted-by":"publisher","first-page":"5562\\_1","DOI":"10.1038\/s41598-017-05965-y","volume":"7","author":"K Knoeferle","year":"2017","unstructured":"Knoeferle K, Li J, Maggioni E, Spence C (2017) What drives sound symbolism? Different acoustic cues underlie sound-size and sound-shape mappings. Sci. Rep. 7(1):5562_1-5562_11. https:\/\/doi.org\/10.1038\/s41598-017-05965-y","journal-title":"Sci. Rep."},{"key":"15732_CR13","volume-title":"Gestalt Psychology","author":"W K\u00f6hler","year":"1929","unstructured":"K\u00f6hler W (1929) Gestalt Psychology. H. Liveright, New York, NY, USA"},{"key":"15732_CR14","doi-asserted-by":"publisher","unstructured":"Kolachina S, Magyar L (2019) What do phone embeddings learn about Phonology? In: Proc. 16th Workshop Comput. Res. Phonetics, Phonol., Morphol., pp. 160\u2013169. https:\/\/doi.org\/10.18653\/v1\/W19-4219","DOI":"10.18653\/v1\/W19-4219"},{"key":"15732_CR15","doi-asserted-by":"publisher","unstructured":"Matsuhira C, Kastner MA, Ide I, Kawanishi Y, Hirayama T, Doman K, Deguchi D, Murase H (2021) Pointedness of an image: Measuring how pointy an image is perceived. In: HCI Int. Conf. 2021 \u2014Posters, Procs., Part I, Commun. Comput. Inf. Sci., vol. 1419, pp. 137\u2013144. https:\/\/doi.org\/10.1007\/978-3-030-78635-9_20","DOI":"10.1007\/978-3-030-78635-9_20"},{"issue":"3","key":"15732_CR16","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1111\/j.1467-7687.2006.00495.x","volume":"9","author":"D Maurer","year":"2006","unstructured":"Maurer D, Pathman T, Mondloch C (2006) The shape of Boubas: Sound-shape correspondences in toddlers and adults. Dev. Sci. 9(3):316\u2013322. https:\/\/doi.org\/10.1111\/j.1467-7687.2006.00495.x","journal-title":"Dev. Sci."},{"key":"15732_CR17","unstructured":"McCormick, K, Kim JY, List S, Nygaard L (2015) Sound to meaning mappings in the Bouba-Kiki effect. In: Proc. 37th Annual Meet. Cogn. Sci. Soc., pp. 1565\u20131570"},{"key":"15732_CR18","first-page":"3111","volume":"26","author":"T Mikolov","year":"2013","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. Adv. Neural Inf. Process. Syst. 26:3111\u20133119","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"15732_CR19","unstructured":"Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. Comput. Res. Reposit. arXiv:1301.3781, https:\/\/doi.org\/10.48550"},{"issue":"5","key":"15732_CR20","doi-asserted-by":"publisher","first-page":"1152","DOI":"10.1037\/a0027747","volume":"38","author":"P Monaghan","year":"2012","unstructured":"Monaghan P, Mattock K, Walker P (2012) The role of sound symbolism in language learning. J. Exp. Psychol. Learn. Mem. Cogn. 38(5):1152\u20131164. https:\/\/doi.org\/10.1037\/a0027747","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn."},{"issue":"2","key":"15732_CR21","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1016\/j.jecp.2012.05.004","volume":"114","author":"O Ozturk","year":"2013","unstructured":"Ozturk O, Krehm M, Vouloumanos A (2013) Sound symbolism in infancy: Evidence for sound-shape cross-modal correspondences in 4-month-olds. J. Exp. Child Psychol. 114(2):173\u2013186. https:\/\/doi.org\/10.1016\/j.jecp.2012.05.004","journal-title":"J. Exp. Child Psychol."},{"key":"15732_CR22","doi-asserted-by":"publisher","unstructured":"Papantoniou K, Konstantopoulos S (2016) Unravelling names of fictional characters. In: Proc. 54th Annual Meet. Assoc. Comput. Linguist., vol. 1, pp. 2154\u20132163. https:\/\/doi.org\/10.18653\/v1\/P16-1203","DOI":"10.18653\/v1\/P16-1203"},{"issue":"12","key":"15732_CR23","first-page":"3","volume":"8","author":"VS Ramachandran","year":"2001","unstructured":"Ramachandran VS, Hubbard EM (2001) Synaesthesia \u2013A window into perception, thought and language. J. Conscious. Stud. 8(12):3\u201334","journal-title":"J. Conscious. Stud."},{"issue":"1","key":"15732_CR24","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1068\/p040105","volume":"4","author":"SK Rogers","year":"1975","unstructured":"Rogers SK, Ross AS (1975) A cross-cultural test of the Maluma-Takete phenomenon. Perception 4(1):105\u2013106. https:\/\/doi.org\/10.1068\/p040105","journal-title":"Perception"},{"key":"15732_CR25","doi-asserted-by":"publisher","unstructured":"Sabbatino V, Troiano E, Schweitzer A, Klinger R (2022)\u201csplink\u201d is happy and \u201cphrouth\u201d is scary: Emotion intensity analysis for nonsense words. In: Proc. 12th Workshop Comput. Approaches to Subj. Sentiment Soc. Media Anal., pp. 37\u201350. https:\/\/doi.org\/10.18653\/v1\/2022.wassa-1.4","DOI":"10.18653\/v1\/2022.wassa-1.4"},{"issue":"3","key":"15732_CR26","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1037\/h0070931","volume":"12","author":"E Sapir","year":"1929","unstructured":"Sapir E (1929) A study in phonetic symbolism. J. Exp. Psychol. 12(3):225\u2013239. https:\/\/doi.org\/10.1037\/h0070931","journal-title":"J. Exp. Psychol."},{"issue":"4","key":"15732_CR27","doi-asserted-by":"publisher","first-page":"17p","DOI":"10.1177\/2041669517724807","volume":"8","author":"SJ Styles","year":"2017","unstructured":"Styles SJ, Gawne L (2017) When does Maluma\/Takete fail? Two key failures and a meta-analysis suggest that phonology and phonotactics matter. i-Perception 8(4):17p. https:\/\/doi.org\/10.1177\/2041669517724807","journal-title":"i-Perception"},{"key":"15732_CR28","doi-asserted-by":"publisher","unstructured":"Sundaram S, Narayanan S (2008) Classification of sound clips by two schemes: Using onomatopoeia and semantic labels. In: Proc. 2008 IEEE Int. Conf. Multimed. Expo, pp. 1341\u20131344. https:\/\/doi.org\/10.1109\/ICME.2008.4607691","DOI":"10.1109\/ICME.2008.4607691"},{"key":"15732_CR29","unstructured":"Tao M, Tang H, Wu S, Sebe N, Wu F, Jing XY, Bao B (2020) DF-GAN: Deep Fusion Generative Adversarial Networks for text-to-image synthesis. Comput. Res. Reposit. arXiv:2008.05865, https:\/\/doi.org\/10.48550"},{"issue":"86","key":"15732_CR30","first-page":"2579","volume":"9","author":"L van der Maaten","year":"2008","unstructured":"van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J. Mach. Learn. Res. 9(86):2579\u20132605","journal-title":"J. Mach. Learn. Res."},{"key":"15732_CR31","doi-asserted-by":"publisher","unstructured":"Wells JC (1982) Accents of English vol. 3. Cambridge University Press, Cambridge, England, UK. https:\/\/doi.org\/10.1017\/CBO9780511611759","DOI":"10.1017\/CBO9780511611759"}],"updated-by":[{"DOI":"10.1007\/s11042-023-17657-z","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2023,12,16]],"date-time":"2023-12-16T00:00:00Z","timestamp":1702684800000}}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-15732-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-023-15732-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-15732-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T05:41:01Z","timestamp":1709185261000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-023-15732-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,29]]},"references-count":31,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["15732"],"URL":"https:\/\/doi.org\/10.1007\/s11042-023-15732-z","relation":{},"ISSN":["1573-7721"],"issn-type":[{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,29]]},"assertion":[{"value":"21 May 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 September 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 August 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 December 2023","order":5,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":6,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s11042-023-17657-z","URL":"https:\/\/doi.org\/10.1007\/s11042-023-17657-z","order":8,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This work was partly supported by Microsoft Research CORE16 program, JSPS Grant-in-aid for Scientific Research (22H03612), and Nagoya University Interdisciplinary Frontier Fellowship supported by Japan Science and Technology Agency and Nagoya University. This work is a fruit of a joint research project between Nagoya University and the National Institute of Informatics. The computation was carried out using the General Projects on supercomputer \u201cFlow\u201d at Information Technology Center, Nagoya University.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Statements and Declaration"}},{"value":"This research was approved by the Institutional Review Board at the Graduate School of Informatics, Nagoya University. Informed consent was obtained from each participant.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with Ethical Standards"}}]}}