{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T08:55:56Z","timestamp":1773996956962,"version":"3.50.1"},"reference-count":37,"publisher":"Emerald","issue":"2","license":[{"start":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T00:00:00Z","timestamp":1657584000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JD"],"published-print":{"date-parts":[[2023,3,6]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>The purpose of this study was to explore the viability of transinformation analysis as a multimodal readability metric. A novel approach was called for, considering that existing and established readability metrics are strictly used to measure linguistic complexity. Yet, the corpus of multimodal literature continues to grow, along with the need to understand how non-linguistic modalities contribute to the complexity of the reading experience.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>In this exploratory study, think aloud screen recordings of eighth-grade readers of the born-digital novel Inanimate Alice were analyzed for complexity, along with transcripts of post-oral retellings. Pixel-level entropy analysis served as both an objective measure of the document and a subjective measure of the amount of reader information attention. Post-oral retelling entropy was calculated at the unit level of the word, serving as an indication of complexity in recall.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>Findings confirmed that transinformation analysis is a viable multimodal readability metric. Inanimate Alice is an objectively complex document, creating a subjectively complex reading experience for the participants. Readers largely attended to the linguistic mode of the story, effectively reducing the amount of information they processed. This was also evident in the brevity and below average complexity of their post-oral retellings, which relied on recall of the linguistic mode. There were no significant group differences among the readers.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>This is the first study that uses entropy to analyze multimodal readability.<\/jats:p><\/jats:sec>","DOI":"10.1108\/jd-04-2022-0094","type":"journal-article","created":{"date-parts":[[2022,7,9]],"date-time":"2022-07-09T04:29:26Z","timestamp":1657340966000},"page":"415-430","source":"Crossref","is-referenced-by-count":2,"title":["The reader as subjective entropy: a\u00a0novel analysis of multimodal readability"],"prefix":"10.1108","volume":"79","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5747-9487","authenticated-orcid":false,"given":"Amanda S.","family":"Hovious","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3317-7569","authenticated-orcid":false,"given":"Brian C.","family":"O'Connor","sequence":"additional","affiliation":[]}],"member":"140","published-online":{"date-parts":[[2022,7,12]]},"reference":[{"key":"key2023030414462136500_ref001","unstructured":"Achieve (2019), \u201cA framework to evaluate cognitive complexity in reading assessments\u201d, September, available at: https:\/\/www.achieve.org\/cognitive-complexity-reading (accessed 2 March 2022)."},{"key":"key2023030414462136500_ref002","unstructured":"Anderson, R.L., O'Connor, B.C. and Kearns, J.L. (2007), \u201cThe functional ontology of filmic documents\u201d, in Skare, R., Lund, N.W. and Varheim, A. (Eds), A Document (Re)turn: Contributions from a Research Field in Transition, Peter Lang, New York, New York, pp.\u00a0345-363."},{"issue":"45","key":"key2023030414462136500_ref003","doi-asserted-by":"publisher","first-page":"8969","DOI":"10.1523\/JNEUROSCI.2575-18.2019","article-title":"An integrated neural decoder of linguistic and experiential meaning","volume":"39","year":"2019","journal-title":"Journal of Neuroscience"},{"key":"key2023030414462136500_ref004","volume-title":"An Introduction to Transfer Entropy","year":"2016"},{"key":"key2023030414462136500_ref005","first-page":"1","article-title":"Humanities approaches to interface theory","volume":"12","year":"2011","journal-title":"Culture Machine"},{"issue":"3","key":"key2023030414462136500_ref006","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1037\/h0057532","article-title":"A new readability yardstick","volume":"32","year":"1948","journal-title":"Journal of Applied Psychology"},{"key":"key2023030414462136500_ref007","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1111\/tops.12025","article-title":"Uncertainty reduction as a measure of cognitive load in sentence comprehension","volume":"5","year":"2013","journal-title":"Topics in Cognitive Science"},{"key":"key2023030414462136500_ref008","unstructured":"Girash, J. (2014), \u201cMetacognition and instruction\u201d, in Benassi, V.A., Overson, C.E.C.E. and Hakala, C.M. (Eds), Applying Science of Learning in Education: Infusing Psychological Science into the Curriculum, Society for the Teaching of Psychology, Washington, DC, pp.\u00a0152-168."},{"key":"key2023030414462136500_ref009","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1207\/s15516709cog0000_64","article-title":"Uncertainty about the rest of the sentence","volume":"30","year":"2006","journal-title":"Cognitive Science"},{"key":"key2023030414462136500_ref010","unstructured":"Jewitt, C. (2017), \u201cAn introduction to multimodality\u201d, in Jewitt, C. (Ed.), The Routledge Handbook of Multimodal Analysis, 2nd ed., Routledge, New York, New York, pp.\u00a015-30."},{"issue":"3","key":"key2023030414462136500_ref011","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1002\/trtr.1630","article-title":"Moving our can(n)ons: toward an appreciation of multimodal texts in the classroom","volume":"71","year":"2017","journal-title":"The Reading Teacher"},{"issue":"2","key":"key2023030414462136500_ref012","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1108\/00220410410522034","article-title":"Dancing with entropy: form attributes, children, and representation","volume":"6","year":"2004","journal-title":"Journal of Documentation"},{"key":"key2023030414462136500_ref013","volume-title":"Reading Images: The Grammar of Visual Design","year":"2006"},{"issue":"6","key":"key2023030414462136500_ref014","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1002\/trtr.1701","article-title":"Multimodal becoming: literacy in and beyond the classroom","volume":"71","year":"2018","journal-title":"The Reading Teacher"},{"key":"key2023030414462136500_ref015","first-page":"967","article-title":"A computational model for saliency maps by using local entropy","year":"2010"},{"issue":"2","key":"key2023030414462136500_ref016","doi-asserted-by":"publisher","DOI":"10.35492\/docam\/3\/2\/1","article-title":"A discussion on document conceptualization","volume":"3","year":"2016","journal-title":"Proceedings from the Document Academy"},{"issue":"4","key":"key2023030414462136500_ref017","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1002\/rrq.247","article-title":"An exploration of text difficulty and knowledge support on adolescents' comprehension","volume":"54","year":"2019","journal-title":"Reading Research Quarterly"},{"key":"key2023030414462136500_ref018","doi-asserted-by":"publisher","first-page":"1316","DOI":"10.3758\/s13423-015-0982-5","article-title":"Twenty years of load theory \u2013 where are we now, and where should we go next?","volume":"23","year":"2016","journal-title":"Psychonomic Bulletin and Review"},{"key":"key2023030414462136500_ref019","doi-asserted-by":"crossref","unstructured":"O'Connor, B. and Anderson, R. (2019), \u201cVideo structure meaning\u201d, in Marchionini, G. (Ed.), Synthesis Lectures on Information Concepts, Retrieval, and Services, Morgan and Claypool, Chapel Hill, North Carolina, pp.\u00a01-79.","DOI":"10.2200\/S00945ED1V01Y201908ICR068"},{"key":"key2023030414462136500_ref035","volume-title":"Doing Things with Information: Beyond Indexing and Abstracting","year":"2008"},{"key":"key2023030414462136500_ref020","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2020.106411","article-title":"Does thinking-aloud affect learning, visual information processing and cognitive load when learning with seductive details as expected from self-regulation perspective?","volume":"111","year":"2020","journal-title":"Computers in Human Behavior"},{"key":"key2023030414462136500_ref021","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/j.neuropsychologia.2017.03.033","article-title":"Category selectivity in human visual cortex: beyond visual object recognition","volume":"105","year":"2017","journal-title":"Neuropsychologia"},{"key":"key2023030414462136500_ref022","unstructured":"Pullinger, K. and Joseph, C. (2005), \u201cInanimate Alice\u201d, available at: https:\/\/inanimatealice.com\/ (accessed 29 April 2022)."},{"issue":"5","key":"key2023030414462136500_ref023","doi-asserted-by":"crossref","first-page":"311","DOI":"10.58680\/la201829586","article-title":"Revisiting the multimodal nature of children's literature","volume":"95","year":"2018","journal-title":"Language Arts"},{"issue":"3","key":"key2023030414462136500_ref024","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1002\/trtr.1948","article-title":"Incorporating multimodal literacies into classroom-based reading assessment","volume":"74","year":"2020","journal-title":"The Reading Teacher"},{"issue":"3","key":"key2023030414462136500_ref025","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","year":"1948","journal-title":"Bell System Technical Journal"},{"key":"key2023030414462136500_ref026","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1002\/j.1538-7305.1951.tb01366.x","article-title":"Prediction and entropy of printed English","volume":"30","year":"1951","journal-title":"Bell System Technical Journal"},{"key":"key2023030414462136500_ref027","volume-title":"The Mathematical Theory of Communication","year":"1949"},{"key":"key2023030414462136500_ref036","article-title":"Reading path and comprehension: an investigation of eighth-grade skilled readers' engagement with online, multimodal texts","year":"2012","journal-title":"Doctoral dissertation, ProQuest Dissertations & Theses Global (3555418)"},{"key":"key2023030414462136500_ref028","volume-title":"The Lexile Scale in Theory and Practice","year":"1989"},{"issue":"1","key":"key2023030414462136500_ref037","first-page":"27","article-title":"The \u2018textual shift\u2019: examining the reading process with print, visual and multimodal text","volume":"29","year":"2006","journal-title":"Australian Journal of Language and Literacy"},{"issue":"3","key":"key2023030414462136500_ref029","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/BF03651836","article-title":"Multimodal literacy: what does it mean for classroom practice?","volume":"33","year":"2010","journal-title":"Australian Journal of Language and Literacy"},{"issue":"1","key":"key2023030414462136500_ref030","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1177\/009365027400100103","article-title":"An information theory measure for television programming","volume":"1","year":"1974","journal-title":"Communication Research"},{"key":"key2023030414462136500_ref031","volume-title":"The Measurement of Verbal Information in Psychology and Education","year":"1973"},{"key":"key2023030414462136500_ref032","volume-title":"Proust and the Squid: The Story and Science of the Reading Brain","year":"2008"},{"key":"key2023030414462136500_ref033","volume-title":"Reader, Come Home: The Reading Brain in a Digital World","year":"2018"},{"key":"key2023030414462136500_ref034","doi-asserted-by":"crossref","unstructured":"Wylie, J., Thomson, J., Lepp\u00e4nen, P.H.T., Ackerman, R., Kanniainen, L. and Prieler, T. (2018), \u201cCognitive processes in digital reading\u201d, in Barzillai, M., Thomson, J., Schroeder, S. and van den Broek, P. (Eds), Learning to Read in a Digital World, John Benjamins, Amsterdam, pp.\u00a057-90.","DOI":"10.1075\/swll.17.03wyl"}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-04-2022-0094\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-04-2022-0094\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:33:54Z","timestamp":1753396434000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jd\/article\/79\/2\/415-430\/221633"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,12]]},"references-count":37,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,7,12]]},"published-print":{"date-parts":[[2023,3,6]]}},"alternative-id":["10.1108\/JD-04-2022-0094"],"URL":"https:\/\/doi.org\/10.1108\/jd-04-2022-0094","relation":{},"ISSN":["0022-0418"],"issn-type":[{"value":"0022-0418","type":"print"}],"subject":[],"published":{"date-parts":[[2022,7,12]]}}}