{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T04:48:37Z","timestamp":1776142117728,"version":"3.50.1"},"reference-count":35,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T00:00:00Z","timestamp":1710288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000015","name":"Office of Science of the U.S. Department of Energy","doi-asserted-by":"publisher","award":["DE-AC02-05CH11231"],"award-info":[{"award-number":["DE-AC02-05CH11231"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"Office of Science of the U.S. Department of Energy","doi-asserted-by":"publisher","award":["NERSC DDR-ERCAP0025759"],"award-info":[{"award-number":["NERSC DDR-ERCAP0025759"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"Office of Science of the U.S. Department of Energy","doi-asserted-by":"publisher","award":["DE-SC0012447"],"award-info":[{"award-number":["DE-SC0012447"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"Office of Science of the U.S. Department of Energy","doi-asserted-by":"publisher","award":["DE-SC0022148"],"award-info":[{"award-number":["DE-SC0022148"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"Office of Science of the U.S. Department of Energy","doi-asserted-by":"publisher","award":["DE-SC0024407"],"award-info":[{"award-number":["DE-SC0024407"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy (DOE)","doi-asserted-by":"publisher","award":["DE-AC02-05CH11231"],"award-info":[{"award-number":["DE-AC02-05CH11231"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy (DOE)","doi-asserted-by":"publisher","award":["NERSC DDR-ERCAP0025759"],"award-info":[{"award-number":["NERSC DDR-ERCAP0025759"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy (DOE)","doi-asserted-by":"publisher","award":["DE-SC0012447"],"award-info":[{"award-number":["DE-SC0012447"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy (DOE)","doi-asserted-by":"publisher","award":["DE-SC0022148"],"award-info":[{"award-number":["DE-SC0022148"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy (DOE)","doi-asserted-by":"publisher","award":["DE-SC0024407"],"award-info":[{"award-number":["DE-SC0024407"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"name":"College of Liberal Arts and Sciences Research Fund at the University of Kansas","award":["DE-AC02-05CH11231"],"award-info":[{"award-number":["DE-AC02-05CH11231"]}]},{"name":"College of Liberal Arts and Sciences Research Fund at the University of Kansas","award":["NERSC DDR-ERCAP0025759"],"award-info":[{"award-number":["NERSC DDR-ERCAP0025759"]}]},{"name":"College of Liberal Arts and Sciences Research Fund at the University of Kansas","award":["DE-SC0012447"],"award-info":[{"award-number":["DE-SC0012447"]}]},{"name":"College of Liberal Arts and Sciences Research Fund at the University of Kansas","award":["DE-SC0022148"],"award-info":[{"award-number":["DE-SC0022148"]}]},{"name":"College of Liberal Arts and Sciences Research Fund at the University of Kansas","award":["DE-SC0024407"],"award-info":[{"award-number":["DE-SC0024407"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Axioms"],"abstract":"<jats:p>Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the amount and complexity of the data increases. Quantum-based vision transformer models could potentially alleviate this issue by reducing the training and operating time while maintaining the same predictive power. Although current quantum computers are not yet able to perform high-dimensional tasks, they do offer one of the most efficient solutions for the future. In this work, we construct several variations of a quantum hybrid vision transformer for a classification problem in high-energy physics (distinguishing photons and electrons in the electromagnetic calorimeter). We test them against classical vision transformer architectures. Our findings indicate that the hybrid models can achieve comparable performance to their classical analogs with a similar number of parameters.<\/jats:p>","DOI":"10.3390\/axioms13030187","type":"journal-article","created":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T03:46:31Z","timestamp":1710301591000},"page":"187","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6683-6463","authenticated-orcid":false,"given":"Eyup B.","family":"Unlu","sequence":"first","affiliation":[{"name":"Institute for Fundamental Theory, Physics Department, University of Florida, Gainesville, FL 32611, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-2626-3752","authenticated-orcid":false,"given":"Mar\u00e7al","family":"Comajoan Cara","sequence":"additional","affiliation":[{"name":"Department of Signal Theory and Communications, Polytechnic University of Catalonia, 08034 Barcelona, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-8116-1950","authenticated-orcid":false,"given":"Gopal Ramesh","family":"Dahale","sequence":"additional","affiliation":[{"name":"Indian Institute of Technology Bhilai, Bhilai 491001, Chhattisgarh, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1000-3454","authenticated-orcid":false,"given":"Zhongtian","family":"Dong","sequence":"additional","affiliation":[{"name":"Department of Physics & Astronomy, University of Kansas, Lawrence, KS 66045, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0355-2076","authenticated-orcid":false,"given":"Roy T.","family":"Forestano","sequence":"additional","affiliation":[{"name":"Institute for Fundamental Theory, Physics Department, University of Florida, Gainesville, FL 32611, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6222-8102","authenticated-orcid":false,"given":"Sergei","family":"Gleyzer","sequence":"additional","affiliation":[{"name":"Department of Physics & Astronomy, University of Alabama, Tuscaloosa, AL 35487, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5450-2207","authenticated-orcid":false,"given":"Daniel","family":"Justice","sequence":"additional","affiliation":[{"name":"Software Engineering Institute, Carnegie Mellon University, 4500 Fifth Avenue, Pittsburgh, PA 15213, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4515-7303","authenticated-orcid":false,"given":"Kyoungchul","family":"Kong","sequence":"additional","affiliation":[{"name":"Department of Physics & Astronomy, University of Kansas, Lawrence, KS 66045, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3890-0066","authenticated-orcid":false,"given":"Tom","family":"Magorsch","sequence":"additional","affiliation":[{"name":"Physik-Department, Technische University of M\u00fcnchen, James-Franck-Str. 1, 85748 Garching, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4182-9096","authenticated-orcid":false,"given":"Konstantin T.","family":"Matchev","sequence":"additional","affiliation":[{"name":"Institute for Fundamental Theory, Physics Department, University of Florida, Gainesville, FL 32611, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3074-998X","authenticated-orcid":false,"given":"Katia","family":"Matcheva","sequence":"additional","affiliation":[{"name":"Institute for Fundamental Theory, Physics Department, University of Florida, Gainesville, FL 32611, USA"}]}],"member":"1968","published-online":{"date-parts":[[2024,3,13]]},"reference":[{"key":"ref_1","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the NIPS\u201917: 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_2","first-page":"1","article-title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Jun, C., Jang, H., Sim, M., Kim, H., Choi, J., Min, K., and Bae, K. (2022, January 26). ANNA: Enhanced Language Representation for Question Answering. Proceedings of the 7th Workshop on Representation Learning for NLP, Dublin, Ireland.","DOI":"10.18653\/v1\/2022.repl4nlp-1.13"},{"key":"ref_4","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3\u20137). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. Proceedings of the 2021 International Conference on Learning Representations, Virtual."},{"key":"ref_5","unstructured":"Yu, X., Xue, Y., Zhang, L., Wang, L., Liu, T., and Zhu, D. (2023). NoisyNN: Exploring the Influence of Information Entropy Change in Learning Systems. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Fang, Y., Wang, W., Xie, B., Sun, Q., Wu, L., Wang, X., Huang, T., Wang, X., and Cao, Y. (2023, January 18\u201322). EVA: Exploring the Limits of Masked Visual Representation Learning at Scale. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01855"},{"key":"ref_7","first-page":"39","article-title":"FlexiBERT: Are current transformer architectures too homogeneous and rigid?","volume":"77","author":"Tuli","year":"2023","journal-title":"J. Artif. Intell. D"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gupta, A., and Berant, J. (2021). Value-aware Approximate Attention. arXiv.","DOI":"10.18653\/v1\/2021.emnlp-main.753"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xiong, Y., Zeng, Z., Chakraborty, R., Tan, M., Fung, G., Li, Y., and Singh, V. (2021). Nystr\u00f6mformer: A Nystr\u00f6m-Based Algorithm for Approximating Self-Attention. arXiv.","DOI":"10.1609\/aaai.v35i16.17664"},{"key":"ref_10","unstructured":"Dao, T., Fu, D.Y., Ermon, S., Rudra, A., and R\u00e9, C. (2022). FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness. arXiv."},{"key":"ref_11","unstructured":"Peng, H., Pappas, N., Yogatama, D., Schwartz, R., Smith, N., and Kong, L. (2021, January 3\u20137). Random Feature Attention. Proceedings of the 2021 International Conference on Learning Representations, Virtual."},{"key":"ref_12","unstructured":"Kitaev, N., Kaiser, \u0141., and Levskaya, A. (2020). Reformer: The Efficient Transformer. arXiv."},{"key":"ref_13","unstructured":"Zaheer, M., Guruganesh, G., Dubey, A., Ainslie, J., Alberti, C., Ontanon, S., Pham, P., Ravula, A., Wang, Q., and Yang, L. (2020, January 6\u201312). Big bird: Transformers for longer sequences. Proceedings of the NIPS\u201920: 34th International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_14","unstructured":"Choromanski, K., Likhosherstov, V., Dohan, D., Song, X., Gane, A., Sarlos, T., Hawkins, P., Davis, J., Mohiuddin, A., and Kaiser, L. (2022). Rethinking Attention with Performers. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3586074","article-title":"A Practical Survey on Faster and Lighter Transformers","volume":"55","author":"Fournier","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1484","DOI":"10.1137\/S0097539795293172","article-title":"Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer","volume":"26","author":"Shor","year":"1997","journal-title":"SIAM J. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1137\/S0097539704412910","article-title":"Equivalences and Separations Between Quantum and Classical Learnability","volume":"33","author":"Servedio","year":"2004","journal-title":"SIAM J. Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"074001","DOI":"10.1088\/1361-6633\/aab406","article-title":"Machine learning & artificial intelligence in the quantum domain: A review of recent progress","volume":"81","author":"Dunjko","year":"2018","journal-title":"Rep. Prog. Phys."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"The HEP Software Foundation, Albrecht, J., Alves, A.A., Amadio, G., Andronico, G., Anh-Ky, N., Aphecetche, L., Apostolakis, J., Asai, M., and Atzori, L. (2019). A Roadmap for HEP Software and Computing R&D for the 2020s. Comput. Softw. Big Sci., 3, 7.","DOI":"10.1007\/s41781-019-0031-6"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"HSF Physics Event Generator WG, Valassi, A., Yazgan, E., McFayden, J., Amoroso, S., Bendavid, J., Buckley, A., Cacciari, M., Childers, T., and Ciulli, V. (2021). Challenges in Monte Carlo Event Generator Software for High-Luminosity LHC. Comput. Softw. Big Sci., 5, 12.","DOI":"10.1007\/s41781-021-00055-1"},{"key":"ref_21","unstructured":"Humble, T.S., Perdue, G.N., and Savage, M.J. (2022). Snowmass Computational Frontier: Topical Group Report on Quantum Computing. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"CMS Collaboration, Chatrchyan, S., Hmayakyan, G., Khachatryan, V., Sirunyan, A.M., Adam, W., Bauer, T., Bergauer, T., Bergauer, H., and Dragicevic, M. (2008). The CMS Experiment at the CERN LHC. JINST, 3, S08004.","DOI":"10.1088\/1748-0221\/3\/08\/S08004"},{"key":"ref_23","unstructured":"(2024, March 06). CMS Heavy-Ion Public Physics Results. Available online: https:\/\/twiki.cern.ch\/twiki\/bin\/view\/CMSPublic\/PhysicsResultsHIN."},{"key":"ref_24","unstructured":"(2024, March 06). Public CMS Data Quality Information. Available online: https:\/\/twiki.cern.ch\/twiki\/bin\/view\/CMSPublic\/DataQuality."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"C02008","DOI":"10.1088\/1748-0221\/9\/02\/C02008","article-title":"The CMS ECAL performance with examples","volume":"9","author":"Benaglia","year":"2014","journal-title":"JINST"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"CMS Collaboration, Chatrchyan, S., Khachatryan, V., Sirunyan, A.M., Tumasyan, A., Adam, W., Bergauer, T., Dragicevic, M., Er\u00f6, J., and Fabjan, C. (2014). Description and performance of track and primary-vertex reconstruction with the CMS tracker. JINST, 9, P10009.","DOI":"10.1088\/1748-0221\/9\/10\/P10009"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"042022","DOI":"10.1088\/1742-6596\/1085\/4\/042022","article-title":"End-to-End Event Classification of High-Energy Physics Data","volume":"1085","author":"Andrews","year":"2018","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_28","unstructured":"(2024, March 06). CMS Coordinate System. Available online: https:\/\/tikz.net\/axis3d_cms\/."},{"key":"ref_29","unstructured":"Sempere Roldan, P. (2011). Quality Control and Preparation of the PWO Crystals for the Electromagnetic Calorimeter of CMS. [Ph.D. Thesis, University of Santiago de Compostela]."},{"key":"ref_30","unstructured":"LeCun, Y., and Cortes, C. (2024, January 10). MNIST Handwritten Digit Database. Available online: http:\/\/yann.lecun.com\/exdb\/mnist\/."},{"key":"ref_31","unstructured":"Li, G., Zhao, X., and Wang, X. (2022). Quantum Self-Attention Neural Networks for Text Classification. arXiv."},{"key":"ref_32","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019). Advances in Neural Information Processing Systems 32, Curran Associates, Inc."},{"key":"ref_33","unstructured":"Bradbury, J., Frostig, R., Hawkins, P., Johnson, M.J., Leary, C., Maclaurin, D., Necula, G., Paszke, A., VanderPlas, J., and Wanderman-Milne, S. (2024, March 06). JAX: Composable Transformations of Python+NumPy programs. Available online: https:\/\/github.com\/google\/jax."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"912","DOI":"10.22331\/q-2023-02-02-912","article-title":"TensorCircuit: A Quantum Software Framework for the NISQ Era","volume":"7","author":"Zhang","year":"2023","journal-title":"Quantum"},{"key":"ref_35","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."}],"container-title":["Axioms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-1680\/13\/3\/187\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:12:41Z","timestamp":1760105561000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-1680\/13\/3\/187"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,13]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["axioms13030187"],"URL":"https:\/\/doi.org\/10.3390\/axioms13030187","relation":{},"ISSN":["2075-1680"],"issn-type":[{"value":"2075-1680","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,13]]}}}