{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T18:58:19Z","timestamp":1778871499322,"version":"3.51.4"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,10,31]],"date-time":"2022-10-31T00:00:00Z","timestamp":1667174400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"2020 Seed Fund","award":["2020-0000000146"],"award-info":[{"award-number":["2020-0000000146"]}]},{"name":"Banatao Institute at the University of California"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Healthcare"],"published-print":{"date-parts":[[2022,10,31]]},"abstract":"<jats:p>Many recent breakthroughs in medical diagnostics and drug discovery arise from deploying machine learning algorithms to large-scale data sets. However, a significant obstacle to such approaches is that they depend on high-quality annotations generated by domain experts. This study develops and evaluates BioLumin, a novel immersive mixed reality environment that enables users to virtually shrink down to the microscopic level for navigation and annotation of 3D reconstructed images. We discuss how domain experts were consulted in the specification of a pipeline to enable automatic reconstruction of biological models for mixed reality environments, driving the design of a 3DUI system to explore whether such a system allows accurate annotation of complex medical data by non-experts. To examine the usability and feasibility of BioLumin, we evaluated our prototype through a multi-stage mixed-method approach. First, three domain experts offered expert reviews, and subsequently, nineteen non-expert users performed representative annotation tasks in a controlled setting. The results indicated that the mixed reality system was learnable and that non-experts could generate high-quality 3D annotations after a short training session. Lastly, we discuss design considerations for future tools like BioLumin in medical and more general scientific contexts.<\/jats:p>","DOI":"10.1145\/3548777","type":"journal-article","created":{"date-parts":[[2022,7,18]],"date-time":"2022-07-18T12:17:14Z","timestamp":1658146634000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["BioLumin: An Immersive Mixed Reality Experience for Interactive Microscopic Visualization and Biomedical Research Annotation"],"prefix":"10.1145","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5356-3948","authenticated-orcid":false,"given":"Aviv","family":"Elor","sequence":"first","affiliation":[{"name":"University of California, Santa Cruz, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3893-2551","authenticated-orcid":false,"given":"Steve","family":"Whittaker","sequence":"additional","affiliation":[{"name":"University of California, Santa Cruz, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2974-7963","authenticated-orcid":false,"given":"Sri","family":"Kurniawan","sequence":"additional","affiliation":[{"name":"University of California, Santa Cruz, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1070-6563","authenticated-orcid":false,"given":"Sam","family":"Michael","sequence":"additional","affiliation":[{"name":"The National Institutes of Health, National Center for Advancing Translational Sciences, Bethesda MD, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,11,3]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"2021. Microscopy Image Analysis Software - Imaris. (2021). https:\/\/imaris.oxinst.com\/."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbr005"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1002\/pon.4173"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1089\/cpb.2004.7.734"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-29169-0"},{"issue":"194","key":"e_1_3_2_8_2","first-page":"4","article-title":"SUS-a quick and dirty usability scale","volume":"189","author":"Brooke John","year":"1996","unstructured":"John Brooke et\u00a0al. 1996. SUS-a quick and dirty usability scale. Usability Evaluation in Industry 189, 194 (1996), 4\u20137.","journal-title":"Usability Evaluation in Industry"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.1.2.150"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2014.04.006"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASI.2017.7988432"},{"issue":"3","key":"e_1_3_2_12_2","first-page":"1","article-title":"Opportunities for crowdsourcing research on Amazon Mechanical Turk","volume":"5","author":"Chen Jenny J.","year":"2011","unstructured":"Jenny J. Chen, Natala J. Menezes, Adam D. Bradley, and T. North. 2011. Opportunities for crowdsourcing research on Amazon Mechanical Turk. Interfaces 5, 3 (2011), 1.","journal-title":"Interfaces"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2013.247"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2599107"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1177\/1075547015609322"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8535.2009.01038.x"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2015.00026"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2014.7004282"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tibs.2011.01.002"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.5555\/513034"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10956-008-9119-1"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.3389\/frvir.2020.585993"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3396249"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/2390803.2390808"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1517\/17460441.2016.1165203"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/38.799740"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1118\/1.2174127"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240431.3240442"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclepro.2017.07.162"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1177\/00220345860650020701"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eplepsyres.2005.07.009"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1111\/tra.12538"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.12.145"},{"key":"e_1_3_2_34_2","first-page":"143","volume-title":"2012 IEEE Virtual Reality Workshops (VRW)","author":"Kim Kwanguk","year":"2012","unstructured":"Kwanguk Kim, M. Zachary Rosenthal, David Zielinski, and Rachel Brady. 2012. Comparison of desktop, head mounted display, and six wall fully immersive systems using a stressful task. In 2012 IEEE Virtual Reality Workshops (VRW). IEEE, 143\u2013144."},{"key":"e_1_3_2_35_2","article-title":"Magic Leap One\u2013CREATOR EDITION","author":"Leap Magic","year":"2019","unstructured":"Magic Leap. 2019. Magic Leap One\u2013CREATOR EDITION. Internet: https:\/\/www.magicleap.com\/magic-leap-one [Jan. 19, 2019] (2019).","journal-title":"Internet: https:\/\/www.magicleap.com\/magic-leap-one [Jan. 19, 2019]"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.02.005"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1089\/gen.35.07.08"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymeth.2015.11.013"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1093\/gigascience\/gix054"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X13511661"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2016.01.001"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2017.07.005"},{"key":"e_1_3_2_43_2","unstructured":"S. Liu. 2019. AR\/VR headset shipments worldwide 2020-2025 | Forecast unit shipments of augmented (AR) and virtual reality (VR) headsets from 2019 to 2023 (in millions) | Statista Research . (2019). https:\/\/www.statista.com\/statistics\/653390\/worldwide-virtual-and-augmented-reality-headset-shipments\/."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2338"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0057990"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chembiol.2012.02.005"},{"key":"e_1_3_2_47_2","volume-title":"MATLAB for Engineers (Fourth edition)","author":"Moore Holly","year":"2015","unstructured":"Holly Moore. 2015. MATLAB for Engineers (Fourth edition). Pearson, Boston."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2016.543"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/PL00022704"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-015-0031-2"},{"key":"e_1_3_2_51_2","volume-title":"WebGL: Up and Running (1st edition)","author":"Parisi Tony","year":"2012","unstructured":"Tony Parisi. 2012. WebGL: Up and Running (1st edition). O\u2019Reilly, Sebastopol, Calif. OCLC: ocn809911501."},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1186\/1756-0381-1-12"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-8-316"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-65981-7_12"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.11648\/j.ajtab.20180402.14"},{"key":"e_1_3_2_56_2","volume-title":"Quantifying the User Experience: Practical Statistics for User Research (2nd edition)","author":"Sauro Jeff","year":"2016","unstructured":"Jeff Sauro and James R. Lewis. 2016. Quantifying the User Experience: Practical Statistics for User Research (2nd edition). Morgan Kaufmann, Cambridge. OCLC: 957463646."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrd3681"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/6.591665"},{"key":"e_1_3_2_59_2","first-page":"762808","volume-title":"Medical Imaging 2010: Advanced PACS-based Imaging Informatics and Therapeutic Applications","author":"Seifert Sascha","year":"2010","unstructured":"Sascha Seifert, Michael Kelm, Manuel Moeller, Saikat Mukherjee, Alexander Cavallaro, Martin Huber, and Dorin Comaniciu. 2010. Semantic annotation of medical images. In Medical Imaging 2010: Advanced PACS-based Imaging Informatics and Therapeutic Applications, Vol. 7628. International Society for Optics and Photonics, 762808."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3134301"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1162\/105474699566477"},{"key":"e_1_3_2_62_2","article-title":"Unity real-time development platform | 3d, 2D VR & AR","author":"Technologies Unity","year":"2019","unstructured":"Unity Technologies. 2019. Unity real-time development platform | 3d, 2D VR & AR. Internet: https:\/\/unity.com\/ [Jun. 06, 2019] (2019).","journal-title":"Internet: https:\/\/unity.com\/ [Jun. 06, 2019]"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1162\/105474600566989"},{"key":"e_1_3_2_64_2","volume-title":"Linear Mixed Models: A Practical Guide Using Statistical Software (Second edition)","author":"West Brady T.","year":"2015","unstructured":"Brady T. West, Kathleen B. Welch, Andrzej T. Ga\u0142ecki, and Brenda W. Gillespie. 2015. Linear Mixed Models: A Practical Guide Using Statistical Software (Second edition). CRC Press, Taylor & Francis Group, Boca Raton."},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-59140-459-0"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsb.2011.09.006"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-011-9710-5"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2513"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-019-2666-z"}],"container-title":["ACM Transactions on Computing for Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3548777","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3548777","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:50:53Z","timestamp":1750182653000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3548777"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,31]]},"references-count":68,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,10,31]]}},"alternative-id":["10.1145\/3548777"],"URL":"https:\/\/doi.org\/10.1145\/3548777","relation":{},"ISSN":["2691-1957","2637-8051"],"issn-type":[{"value":"2691-1957","type":"print"},{"value":"2637-8051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,31]]},"assertion":[{"value":"2021-02-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-07-08","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}