{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T09:37:18Z","timestamp":1766137038219,"version":"3.41.2"},"reference-count":28,"publisher":"Walter de Gruyter GmbH","issue":"2","license":[{"start":{"date-parts":[[2018,6,1]],"date-time":"2018-06-01T00:00:00Z","timestamp":1527811200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,6,26]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Immersive technologies like stereo rendering, virtual reality, or augmented reality (AR) are often used in the field of molecular visualisation. Modern, comparably lightweight and affordable AR headsets like Microsoft\u2019s HoloLens open up new possibilities for immersive analytics in molecular visualisation. A crucial factor for a comprehensive analysis of molecular data in AR is the rendering speed. HoloLens, however, has limited hardware capabilities due to requirements like battery life, fanless cooling and weight. Consequently, insights from best practises for powerful desktop hardware may not be transferable. Therefore, we evaluate the capabilities of the HoloLens hardware for modern, GPU-enabled, high-quality rendering methods for the space-filling model commonly used in molecular visualisation. We also assess the scalability for large molecular data sets. Based on the results, we discuss ideas and possibilities for immersive molecular analytics. Besides more obvious benefits like the stereoscopic rendering offered by the device, this specifically includes natural user interfaces that use physical navigation instead of the traditional virtual one. Furthermore, we consider different scenarios for such an immersive system, ranging from educational use to collaborative scenarios.<\/jats:p>","DOI":"10.1515\/jib-2018-0005","type":"journal-article","created":{"date-parts":[[2018,6,13]],"date-time":"2018-06-13T22:51:14Z","timestamp":1528930274000},"source":"Crossref","is-referenced-by-count":34,"title":["Interactive Molecular Graphics for Augmented Reality Using HoloLens"],"prefix":"10.1515","volume":"15","author":[{"given":"Christoph","family":"M\u00fcller","sequence":"first","affiliation":[{"name":"Visualisation Research Centre (VISUS), University of Stuttgart , 70569 Stuttgart , Germany"}]},{"given":"Michael","family":"Krone","sequence":"additional","affiliation":[{"name":"Visualisation Research Centre (VISUS), University of Stuttgart , 70569 Stuttgart , Germany"}]},{"given":"Markus","family":"Huber","sequence":"additional","affiliation":[{"name":"Visualisation Research Centre (VISUS), University of Stuttgart , 70569 Stuttgart , Germany"}]},{"given":"Verena","family":"Biener","sequence":"additional","affiliation":[{"name":"Visualisation Research Centre (VISUS), University of Stuttgart , 70569 Stuttgart , Germany"}]},{"given":"Dominik","family":"Herr","sequence":"additional","affiliation":[{"name":"Institute for Visualisation and Interactive Systems (VIS), University of Stuttgart , 70569 Stuttgart , Germany"},{"name":"Graduate School Advanced Manufacturing Engineering (GSaME), University of Stuttgart , 70569 Stuttgart , Germany"}]},{"given":"Steffen","family":"Koch","sequence":"additional","affiliation":[{"name":"Institute for Visualisation and Interactive Systems (VIS), University of Stuttgart , 70569 Stuttgart , Germany"}]},{"given":"Guido","family":"Reina","sequence":"additional","affiliation":[{"name":"Visualisation Research Centre (VISUS), University of Stuttgart , 70569 Stuttgart , Germany"}]},{"given":"Daniel","family":"Weiskopf","sequence":"additional","affiliation":[{"name":"Visualisation Research Centre (VISUS), University of Stuttgart , 70569 Stuttgart , Germany"},{"name":"Institute for Visualisation and Interactive Systems (VIS), University of Stuttgart , 70569 Stuttgart , Germany"}]},{"given":"Thomas","family":"Ertl","sequence":"additional","affiliation":[{"name":"Visualisation Research Centre (VISUS), University of Stuttgart , 70569 Stuttgart , Germany"},{"name":"Institute for Visualisation and Interactive Systems (VIS), University of Stuttgart , 70569 Stuttgart , Germany"}]}],"member":"374","published-online":{"date-parts":[[2018,6,13]]},"reference":[{"key":"2023033120302589391_j_jib-2018-0005_ref_001_w2aab3b7b3b1b6b1ab1b8b1Aa","doi-asserted-by":"crossref","unstructured":"Humphrey W, Dalke A, Schulten K. VMD: visual molecular dynamics. J Mol Graph. 1996;14:33\u20138.10.1016\/0263-7855(96)00018-5","DOI":"10.1016\/0263-7855(96)00018-5"},{"key":"2023033120302589391_j_jib-2018-0005_ref_002_w2aab3b7b3b1b6b1ab1b8b2Aa","unstructured":"Schr\u00f6dinger L. The PyMOL molecular graphics system, Version 1.8; 2016."},{"key":"2023033120302589391_j_jib-2018-0005_ref_003_w2aab3b7b3b1b6b1ab1b8b3Aa","unstructured":"Ni T, Schmidt GS, Staadt OG, Livingston MA, Ball R, May R. A survey of large high-resolution display technologies, techniques, and applications. In: IEEE Virtual Reality Conference; 2006. p. 223\u201336."},{"key":"2023033120302589391_j_jib-2018-0005_ref_004_w2aab3b7b3b1b6b1ab1b8b4Aa","doi-asserted-by":"crossref","unstructured":"Cruz-Neira C, Sandin DJ, DeFanti TA, Kenyon RV, Hart JC. The CAVE: audio visual experience automatic virtual environment. Commun ACM. 1992;35:64\u201372.10.1145\/129888.129892","DOI":"10.1145\/129888.129892"},{"key":"2023033120302589391_j_jib-2018-0005_ref_005_w2aab3b7b3b1b6b1ab1b8b5Aa","unstructured":"Gumhold S. Splatting illuminated ellipsoids with depth correction. In: Vision, modeling, and visualization; 2003. p. 245\u201352."},{"key":"2023033120302589391_j_jib-2018-0005_ref_006_w2aab3b7b3b1b6b1ab1b8b6Aa","unstructured":"Klein T, Ertl T. Illustrating magnetic field lines using a discrete particle model. In: Vision, modeling, and visualization; 2004. p. 387\u201394."},{"key":"2023033120302589391_j_jib-2018-0005_ref_007_w2aab3b7b3b1b6b1ab1b8b7Aa","doi-asserted-by":"crossref","unstructured":"Falk M, Grottel S, Krone M, et al. Interactive GPU-based Visualization of Large Dynamic Particle Data. San Rafael: Morgan & Claypool Publishers, 2016.","DOI":"10.1007\/978-3-031-02604-1"},{"key":"2023033120302589391_j_jib-2018-0005_ref_008_w2aab3b7b3b1b6b1ab1b8b8Aa","unstructured":"Reina G, Ertl T. Hardware-accelerated glyphs for mono- and dipoles in molecular dynamics visualization. In: EG\/IEEE VGTC symposium on visualization; 2005. p. 177\u201382."},{"key":"2023033120302589391_j_jib-2018-0005_ref_009_w2aab3b7b3b1b6b1ab1b8b9Aa","doi-asserted-by":"crossref","unstructured":"Grottel S, Reina G, Ertl T. Optimized data transfer for time-dependent, GPU-based glyphs. In: IEEE pacific visualization symposium; 2009. p. 65\u201372.","DOI":"10.1109\/PACIFICVIS.2009.4906839"},{"key":"2023033120302589391_j_jib-2018-0005_ref_010_w2aab3b7b3b1b6b1ab1b8c10Aa","doi-asserted-by":"crossref","unstructured":"Grottel S, Krone M, M\u00fcller C, Reina G, Ertl T. MegaMol \u2013 a prototyping framework for particle-based visualization. IEEE Trans Vis Comput Graph. 2015;21:201\u201314.2635703010.1109\/TVCG.2014.2350479","DOI":"10.1109\/TVCG.2014.2350479"},{"key":"2023033120302589391_j_jib-2018-0005_ref_011_w2aab3b7b3b1b6b1ab1b8c11Aa","unstructured":"Berman HM, Westbrook J, Feng Z, Gilliland G, Bhat TN, Weissig H, et al. The protein data bank. Nucleic Acids Res. 2000;28:235\u201342. Available from: http:\/\/www.rcsb.org.10.1093\/nar\/28.1.23510592235"},{"key":"2023033120302589391_j_jib-2018-0005_ref_012_w2aab3b7b3b1b6b1ab1b8c12Aa","doi-asserted-by":"crossref","unstructured":"Chandler T, Cordeil M, Czauderna T, Dwyer T, Glowacki J, Goncu C, et al. Immersive analytics. In: 2015 Big Data Visual Analytics (BDVA); 2015. p. 1\u20138.","DOI":"10.1109\/BDVA.2015.7314296"},{"key":"2023033120302589391_j_jib-2018-0005_ref_013_w2aab3b7b3b1b6b1ab1b8c13Aa","doi-asserted-by":"crossref","unstructured":"Kozl\u00edkov\u00e1 B, Krone M, Falk M, Lindow N, Baaden M, Baum D, et al. Visualization of biomolecular structures: State of the art revisited. Comput Graph Forum. 2017;36:178\u2013204.10.1111\/cgf.13072","DOI":"10.1111\/cgf.13072"},{"key":"2023033120302589391_j_jib-2018-0005_ref_014_w2aab3b7b3b1b6b1ab1b8c14Aa","doi-asserted-by":"crossref","unstructured":"Norrby M, Grebner C, Eriksson J, Bostr\u00f6m J. Molecular rift: virtual reality for drug designers. J Chem Inf Model. 2015;55:2475\u201384.10.1021\/acs.jcim.5b0054426558887","DOI":"10.1021\/acs.jcim.5b00544"},{"key":"2023033120302589391_j_jib-2018-0005_ref_015_w2aab3b7b3b1b6b1ab1b8c15Aa","doi-asserted-by":"crossref","unstructured":"Salvadori A, Brogni A, Mancini G, Barone V. Moka: designing a simple scene graph library for cluster-based virtual reality systems. In: Augmented and virtual reality. Cham: Springer; 2014. p. 333\u201350.","DOI":"10.1007\/978-3-319-13969-2_25"},{"key":"2023033120302589391_j_jib-2018-0005_ref_016_w2aab3b7b3b1b6b1ab1b8c16Aa","doi-asserted-by":"crossref","unstructured":"Salvadori A, Del Frate G, Pagliai M, Mancini G, Barone V. Immersive virtual reality in computational chemistry: applications to the analysis of QM and MM data. Int J Quantum Chem. 2016;116:1731\u201346.2786721410.1002\/qua.25207","DOI":"10.1002\/qua.25207"},{"key":"2023033120302589391_j_jib-2018-0005_ref_017_w2aab3b7b3b1b6b1ab1b8c17Aa","doi-asserted-by":"crossref","unstructured":"Grebner C, Norrby M, Enstrm J, Nilsson I, Hogner A, Henriksson J, et al. 3D-Lab: a collaborative web-based platform for molecular modeling. Future Med Chem. 2016;8:1739\u201352.2757786010.4155\/fmc-2016-0081","DOI":"10.4155\/fmc-2016-0081"},{"key":"2023033120302589391_j_jib-2018-0005_ref_018_w2aab3b7b3b1b6b1ab1b8c18Aa","doi-asserted-by":"crossref","unstructured":"Gillet A, Sanner M, Stoffler D, Goodsell D, Olson A. Augmented reality with tangible auto-fabricated models for molecular biology applications. In: Proceedings of the IEEE conference on visualization; 2004. p. 235\u201342.","DOI":"10.1109\/VISUAL.2004.7"},{"key":"2023033120302589391_j_jib-2018-0005_ref_019_w2aab3b7b3b1b6b1ab1b8c19Aa","doi-asserted-by":"crossref","unstructured":"Berry C, Board J. A protein in the palm of your hand through augmented reality. Biochem Mol Biol Educ. 2014;42:446\u20139.10.1002\/bmb.2080524979189","DOI":"10.1002\/bmb.20805"},{"key":"2023033120302589391_j_jib-2018-0005_ref_020_w2aab3b7b3b1b6b1ab1b8c20Aa","doi-asserted-by":"crossref","unstructured":"Zheng M, Waller MP. ChemPreview: an augmented reality-based molecular interface. J Mol Graph Model. 2017;73:18\u201323.10.1016\/j.jmgm.2017.01.01928214437","DOI":"10.1016\/j.jmgm.2017.01.019"},{"key":"2023033120302589391_j_jib-2018-0005_ref_021_w2aab3b7b3b1b6b1ab1b8c21Aa","unstructured":"Hoffman M, Provance J. Visualization of molecular structures using HoloLens-based augmented reality. AMIA Jt Summits Transl Sci Proc. 2017;2017:68\u201374.28815109"},{"key":"2023033120302589391_j_jib-2018-0005_ref_022_w2aab3b7b3b1b6b1ab1b8c22Aa","doi-asserted-by":"crossref","unstructured":"Voinea A, Moldoveanu A, Moldoveanu F. Bringing the augmented reality benefits to biomechanics study. In: Proceedings of the 2016 workshop on multimodal virtual and augmented reality; 2016. p. 9:1\u20136.","DOI":"10.1145\/3001959.3001969"},{"key":"2023033120302589391_j_jib-2018-0005_ref_023_w2aab3b7b3b1b6b1ab1b8c23Aa","doi-asserted-by":"crossref","unstructured":"Joachimczak M, Liu J, Ando H. Real-time mixed-reality telepresence via 3D reconstruction with HoloLens and commodity depth sensors. In: Proceedings of the ACM international conference on multimodal interaction; 2017. p. 514\u20135.","DOI":"10.1145\/3136755.3143031"},{"key":"2023033120302589391_j_jib-2018-0005_ref_024_w2aab3b7b3b1b6b1ab1b8c24Aa","doi-asserted-by":"crossref","unstructured":"Chen Z, Hu W, Wang J, Zhao S, Amos B, Wu G, et al. An empirical study of latency in an emerging class of edge computing applications for wearable cognitive assistance. In: Proceedings of the ACM\/IEEE symposium on edge computing; 2017. p. 14:1\u201314.","DOI":"10.1145\/3132211.3134458"},{"key":"2023033120302589391_j_jib-2018-0005_ref_025_w2aab3b7b3b1b6b1ab1b8c25Aa","doi-asserted-by":"crossref","unstructured":"Ball R, North C, Bowman D. Move to improve: promoting physical navigation to increase user performance with large displays. In: Proceedings of the SIGCHI conference on human factors in computing systems; 2007. p. 191\u2013200.","DOI":"10.1145\/1240624.1240656"},{"key":"2023033120302589391_j_jib-2018-0005_ref_026_w2aab3b7b3b1b6b1ab1b8c26Aa","doi-asserted-by":"crossref","unstructured":"M\u00fcller C, Krone M, Scharnowski K, Reina G, Ertl T. On the utility of large high-resolution displays for comparative scientific visualisation. In: International symposium on visual information communication and interaction. vol. 8; 2015. p. 131\u20136.","DOI":"10.1145\/2801040.2801045"},{"key":"2023033120302589391_j_jib-2018-0005_ref_027_w2aab3b7b3b1b6b1ab1b8c27Aa","doi-asserted-by":"crossref","unstructured":"Parulek J, J\u00f6nsson D, Ropinski T, Bruckner S, Ynnerman A, Viola I. Continuous levels-of-detail and visual abstraction for seamless molecular visualization. Comput Graph Forum. 2014;33:276\u201387.10.1111\/cgf.12349","DOI":"10.1111\/cgf.12349"},{"key":"2023033120302589391_j_jib-2018-0005_ref_028_w2aab3b7b3b1b6b1ab1b8c28Aa","unstructured":"Le Muzic M, Autin L, Parulek J, Viola I. cellVIEW: a tool for illustrative and multi-scale rendering of large biomolecular datasets. In: EG workshop on visual computing for biology and medicine; 2015. p. 61\u201370."}],"container-title":["Journal of Integrative Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyter.com\/view\/journals\/jib\/15\/2\/article-20180005.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/jib-2018-0005\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/jib-2018-0005\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,5]],"date-time":"2025-07-05T03:28:37Z","timestamp":1751686117000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/jib-2018-0005\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,1]]},"references-count":28,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2018,6,21]]},"published-print":{"date-parts":[[2018,6,26]]}},"alternative-id":["10.1515\/jib-2018-0005"],"URL":"https:\/\/doi.org\/10.1515\/jib-2018-0005","relation":{},"ISSN":["1613-4516"],"issn-type":[{"type":"electronic","value":"1613-4516"}],"subject":[],"published":{"date-parts":[[2018,6,1]]},"article-number":"20180005"}}