{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T20:00:04Z","timestamp":1781726404971,"version":"3.54.5"},"reference-count":30,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T00:00:00Z","timestamp":1674777600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T00:00:00Z","timestamp":1674777600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2023,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The cross section is one of the most important physical quantities in high-energy physics and the most time consuming to compute. While machine learning has proven to be highly successful in numerical calculations in high-energy physics, analytical calculations using machine learning are still in their infancy. In this work, we use a sequence-to-sequence model, specifically, a transformer, to compute a key element of the cross section calculation, namely, the squared amplitude of an interaction. We show that a transformer model is able to predict correctly 97.6% and 99% of squared amplitudes of quantum chromodynamics and quantum electrodynamics processes, respectively, at a speed that is up to orders of magnitude faster than current symbolic computation frameworks. We discuss the performance of the current model, its limitations and possible future directions for this work.<\/jats:p>","DOI":"10.1088\/2632-2153\/acb2b2","type":"journal-article","created":{"date-parts":[[2023,1,12]],"date-time":"2023-01-12T22:42:08Z","timestamp":1673563328000},"page":"015007","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["SYMBA: symbolic computation of squared amplitudes in high energy physics with machine learning"],"prefix":"10.1088","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2460-6181","authenticated-orcid":true,"given":"Abdulhakim","family":"Alnuqaydan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sergei","family":"Gleyzer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harrison","family":"Prosper","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2023,1,27]]},"reference":[{"key":"mlstacb2b2bib1","doi-asserted-by":"crossref","DOI":"10.1088\/1742-6596\/1085\/2\/022008","article-title":"Machine learning in high energy physics community white paper","author":"Albertsson","year":"2018"},{"key":"mlstacb2b2bib2","doi-asserted-by":"publisher","DOI":"10.1142\/S0217751X19300199","article-title":"Machine and deep learning applications in particle physics","volume":"34","author":"Bourilkov","year":"2019","journal-title":"Int. J. Mod. Phys. A"},{"key":"mlstacb2b2bib3","doi-asserted-by":"publisher","DOI":"10.1103\/RevModPhys.91.045002","article-title":"Machine learning and the physical sciences","volume":"91","author":"Carleo","year":"2019","journal-title":"Rev. Mod. Phys."},{"key":"mlstacb2b2bib4","article-title":"A living review of machine learning for particle physics","author":"Feickert","year":"2021"},{"key":"mlstacb2b2bib5","article-title":"Back to the formula\u2014LHC edn","author":"Butter","year":"2021"},{"key":"mlstacb2b2bib6","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpc.2020.107478","article-title":"FeynCalc 9.3: new features and improvements","volume":"256","author":"Shtabovenko","year":"2020","journal-title":"Comput. Phys. Commun."},{"key":"mlstacb2b2bib7","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpc.2021.107928","article-title":"MARTY\u2014modern artificial theoretical physicist a c++ framework automating theoretical calculations beyond the standard model","volume":"264","author":"Uhlrich","year":"2021","journal-title":"Comput. Phys. Commun."},{"key":"mlstacb2b2bib8","article-title":"Attention is all you need","author":"Vaswani","year":"2017"},{"key":"mlstacb2b2bib9","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1016\/j.nima.2004.07.096","article-title":"CompHEP 4.4: automatic computations from Lagrangians to events","volume":"534","author":"Boos","year":"2004","journal-title":"Nucl. Instrum. Methods Phys. Res. A"},{"key":"mlstacb2b2bib10","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/W18-6301","article-title":"Scaling neural machine translation","author":"Ott","year":"2018"},{"key":"mlstacb2b2bib11","first-page":"pp 176","article-title":"Survey on automatic text summarization and transformer models applicability","author":"Guan","year":"2020"},{"key":"mlstacb2b2bib12","article-title":"CPTR: full transformer network for image captioning","author":"Liu","year":"2021"},{"key":"mlstacb2b2bib13","article-title":"Bert: pre-training of deep bidirectional transformers for language understanding","author":"Devlin","year":"2018"},{"key":"mlstacb2b2bib14","article-title":"Deep visual-semantic alignments for generating image descriptions","author":"Karpathy","year":"2014"},{"key":"mlstacb2b2bib15","article-title":"Behrt: transformer for electronic health records","author":"Yikuan","year":"2019"},{"key":"mlstacb2b2bib16","article-title":"Unetr: transformers for 3D medical image segmentation","author":"Hatamizadeh","year":"2021"},{"key":"mlstacb2b2bib17","doi-asserted-by":"publisher","first-page":"2112","DOI":"10.1093\/bioinformatics\/btab083","article-title":"Dnabert: pre-trained bidirectional encoder representations from transformers model for DNA-language in genome","volume":"37","author":"Yanrong","year":"2021","journal-title":"J. Bioinform."},{"key":"mlstacb2b2bib18","article-title":"Deep learning for symbolic mathematics","author":"Lample","year":"2019"},{"key":"mlstacb2b2bib19","article-title":"Deep symbolic regression for recurrent sequences","author":"d\u2019Ascoli","year":"2022"},{"key":"mlstacb2b2bib20","article-title":"Symbolicgpt: a generative transformer model for symbolic regression","author":"Valipour","year":"2021"},{"key":"mlstacb2b2bib21","article-title":"Learning symbolic physics with graph networks","author":"Cranmer","year":"2019"},{"key":"mlstacb2b2bib22","article-title":"Rediscovering orbital mechanics with machine learning","author":"Lemos","year":"2022"},{"key":"mlstacb2b2bib23","article-title":"AI Feynman: a physics-inspired method for symbolic regression","author":"Udrescu","year":"2019"},{"key":"mlstacb2b2bib24","author":"Goldberg","year":"2017"},{"key":"mlstacb2b2bib25","doi-asserted-by":"publisher","first-page":"e103","DOI":"10.7717\/peerj-cs.103","article-title":"Sympy: symbolic computing in python","volume":"3","author":"Meurer","year":"2017","journal-title":"PeerJ Comput. Sci."},{"key":"mlstacb2b2bib26","article-title":"TensorFlow: large-scale machine learning on heterogeneous systems","author":"Abadi","year":"2015"},{"key":"mlstacb2b2bib27","article-title":"Keras","author":"Chollet","year":"2015"},{"key":"mlstacb2b2bib28","article-title":"Adam: a method for stochastic optimization","author":"Kingma","year":"2014"},{"key":"mlstacb2b2bib29","article-title":"Big bird: transformers for longer sequences","author":"Zaheer","year":"2020"},{"key":"mlstacb2b2bib30","article-title":"Longformer: the long-document transformer","author":"Beltagy","year":"2020"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acb2b2","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acb2b2\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acb2b2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acb2b2\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acb2b2\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acb2b2\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acb2b2\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acb2b2\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T10:53:06Z","timestamp":1674816786000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acb2b2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,27]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1,27]]},"published-print":{"date-parts":[[2023,3,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/acb2b2","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,27]]},"assertion":[{"value":"SYMBA: symbolic computation of squared amplitudes in high energy physics with machine learning","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2023 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2022-09-21","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-01-12","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-01-27","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}