{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:55:36Z","timestamp":1760057736205,"version":"build-2065373602"},"reference-count":67,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,2,20]],"date-time":"2025-02-20T00:00:00Z","timestamp":1740009600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>We propose a novel approach to real-time anomaly detection at the Large Hadron Collider, aimed at enhancing the discovery potential for new fundamental phenomena in particle physics. Our method leverages the Latent Outlier Exposure technique and is evaluated using three distinct anomaly detection models. Among these is a novel adaptation of the variational autoencoder\u2019s reparameterisation trick, specifically optimised for anomaly detection. The models are validated on simulated datasets representing collider processes from the Standard Model and hypothetical Beyond the Standard Model scenarios. The results demonstrate significant advantages, particularly in addressing the formidable challenge of developing a signal-agnostic, hardware-level anomaly detection trigger for experiments at the Large Hadron Collider.<\/jats:p>","DOI":"10.3390\/computers14030079","type":"journal-article","created":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:53:06Z","timestamp":1740124386000},"page":"79","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Latent Outlier Exposure in Real-Time Anomaly Detection at the Large Hadron Collider"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-0129-6256","authenticated-orcid":false,"given":"Thomas Dartnall","family":"Stern","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, University of Cape Town, Cape Town 7701, South Africa"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6631-1539","authenticated-orcid":false,"given":"Amit Kumar","family":"Mishra","sequence":"additional","affiliation":[{"name":"Engineering Department, University West, 461 86 Trollhaten, Sweden"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0766-5307","authenticated-orcid":false,"given":"James Michael","family":"Keaveney","sequence":"additional","affiliation":[{"name":"Department of Physics, University of Cape Town, Cape Town 7700, South Africa"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"100001","DOI":"10.1088\/1674-1137\/40\/10\/100001","article-title":"Review of Particle Physics","volume":"40","author":"Patrignani","year":"2016","journal-title":"Chin. Phys. C"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"051","DOI":"10.1088\/1126-6708\/2003\/09\/051","article-title":"TeV symmetry and the little hierarchy problem","volume":"09","author":"Cheng","year":"2003","journal-title":"J. High Energy Phys."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.physrep.2012.02.007","article-title":"Physics searches at the LHC","volume":"515","author":"Morrissey","year":"2012","journal-title":"Phys. Rept."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"124201","DOI":"10.1088\/1361-6633\/ac36b9","article-title":"The LHC Olympics 2020 a community challenge for anomaly detection in high energy physics","volume":"84","author":"Kasieczka","year":"2021","journal-title":"Rep. Prog. Phys."},{"key":"ref_5","unstructured":"Ballard, D.H. (1987, January 13\u201317). Modular Learning in Neural Networks. Proceedings of the Sixth National Conference on Artificial Intelligence, AAAI\u201987, Seattle, WA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kawachi, Y., Koizumi, Y., and Harada, N. (2018, January 15\u201320). Complementary Set Variational Autoencoder for Supervised Anomaly Detection. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8462181"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.isatra.2022.09.009","article-title":"Multi-mode non-Gaussian variational autoencoder network with missing sources for anomaly detection of complex electromechanical equipment","volume":"134","author":"Luo","year":"2023","journal-title":"ISA Trans."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"105187","DOI":"10.1016\/j.knosys.2019.105187","article-title":"advae: A self-adversarial variational autoencoder with Gaussian anomaly prior knowledge for anomaly detection","volume":"190","author":"Wang","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"115009","DOI":"10.1103\/PhysRevD.105.115009","article-title":"Bump hunting in latent space","volume":"105","author":"Bortolato","year":"2022","journal-title":"Phys. Rev. D"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"P08012","DOI":"10.1088\/1748-0221\/16\/08\/P08012","article-title":"Anomalous jet identification via sequence modeling","volume":"16","author":"Kahn","year":"2021","journal-title":"J. Instrum."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zipper, N. (2023). Testing a Neural Network for Anomaly Detection in the CMS Global Trigger Test Crate during Run 3. arXiv.","DOI":"10.1088\/1748-0221\/19\/03\/C03029"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1038\/s42256-022-00441-3","article-title":"Autoencoders on field-programmable gate arrays for real-time, unsupervised new physics detection at 40 MHz at the Large Hadron Collider","volume":"4","author":"Govorkova","year":"2022","journal-title":"Nat. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"P07027","DOI":"10.1088\/1748-0221\/13\/07\/P07027","article-title":"Fast inference of deep neural networks in FPGAs for particle physics","volume":"13","author":"Duarte","year":"2018","journal-title":"J. Instrum."},{"key":"ref_14","unstructured":"Tolstikhin, I., Bousquet, O., Gelly, S., and Schoelkopf, B. (2019). Wasserstein Auto-Encoders. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"043","DOI":"10.21468\/SciPostPhys.12.1.043","article-title":"The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider","volume":"12","author":"Aarrestad","year":"2022","journal-title":"SciPost Phys."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Caron, S., Hendriks, L., and Verheyen, R. (SciPost Phys. Submiss., 2021). Rare and Different: Anomaly Scores from a Combination of Likelihood and Out-of-Distribution Models to Detect New Physics at the LHC, SciPost Phys. Submiss., Submitted.","DOI":"10.21468\/SciPostPhys.12.2.077"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Huang, W., Li, Y., Xu, Z., Yao, X., and Wan, R. (2025). Improved Deep Support Vector Data Description Model Using Feature Patching for Industrial Anomaly Detection. Sensors, 25.","DOI":"10.3390\/s25010067"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3739","DOI":"10.1109\/TKDE.2023.3328882","article-title":"DASVDD: Deep Autoencoding Support Vector Data Descriptor for Anomaly Detection","volume":"36","author":"Hojjati","year":"2024","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_19","unstructured":"(2024, October 07). ATLAS Level-1 Trigger: Technical Design Report, Release 5.5, Prepared by Mario Ruggier, Information and Programming Techniques Group, ECP Division, CERN, Geneva, Switzerland. Available online: https:\/\/cds.cern.ch\/record\/381429\/files\/cer-0307030.pdf."},{"key":"ref_20","unstructured":"ATLAS Collaboration (2024, October 07). ATLAS Public Results on Trigger Operation. Available online: https:\/\/twiki.cern.ch\/twiki\/bin\/view\/AtlasPublic\/TriggerOperationPublicResults."},{"key":"ref_21","unstructured":"Qiu, C., Li, A., Kloft, M., Rudolph, M., and Mandt, S. (2022). Latent Outlier Exposure for Anomaly Detection with Contaminated Data. arXiv."},{"key":"ref_22","unstructured":"Fortin, E. (October, January 30). Machine Learning for Real-Time Processing of ATLAS Liquid Argon Calorimeter Signals with FPGAs. Proceedings of the TIPP 2023 Conference, European Organization for Nuclear Research (CERN), Scotland, UK."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bartler, A., Mauch, L., Yang, B., Reuter, M., and Stoicescu, L. (2018, January 3\u20137). Automated detection of solar cell defects with deep learning. Proceedings of the 2018 26th European Signal Processing Conference (EUSIPCO), Rome, Italy.","DOI":"10.23919\/EUSIPCO.2018.8553025"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liao, Y., Bartler, A., and Yang, B. (2021). Anomaly Detection Based on Selection and Weighting in Latent Space. arXiv.","DOI":"10.1109\/CASE49439.2021.9551267"},{"key":"ref_25","unstructured":"Ruff, L., Vandermeulen, R., Goernitz, N., Deecke, L., Siddiqui, S.A., Binder, A., Muller, E., and Kloft, M. (2018, January 10\u201315). Deep one-class classification. Proceedings of the International Conference on Machine Learning, PMLR, Stockholm, Sweden."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Schlachter, P., Liao, Y., and Yang, B. (2019, January 2\u20135). Deep one-class classification using intra-class splitting. Proceedings of the 2019 IEEE Data Science Workshop (DSW), Minneapolis, MN, USA.","DOI":"10.1109\/DSW.2019.8755576"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1109\/JPROC.2021.3052449","article-title":"A Unifying Review of Deep and Shallow Anomaly Detection","volume":"109","author":"Ruff","year":"2021","journal-title":"Proc. IEEE"},{"key":"ref_28","unstructured":"Hendrycks, D., Mazeika, M., and Dietterich, T.G. (2018). Deep Anomaly Detection with Outlier Exposure. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chen, Z., Yeo, C.K., Lee, B.S., and Lau, C.T. (2018, January 17\u201320). Autoencoder-based network anomaly detection. Proceedings of the 2018 Wireless Telecommunications Symposium (WTS), Phoenix, AZ, USA.","DOI":"10.1109\/WTS.2018.8363930"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.neucom.2021.04.089","article-title":"VAE-based Deep SVDD for anomaly detection","volume":"453","author":"Zhou","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_31","unstructured":"Kingma, D.P., and Welling, M. (2013). Auto-Encoding Variational Bayes. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2205977","DOI":"10.1002\/smll.202205977","article-title":"Variational Convolutional Autoencoders for Anomaly Detection in Scanning Transmission Electron Microscopy","volume":"19","author":"Prifti","year":"2023","journal-title":"Small"},{"key":"ref_33","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/s42979-021-00702-9","article-title":"A Survey on Variational Autoencoders from a Green AI Perspective","volume":"2","author":"Asperti","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_35","unstructured":"Higgins, I., Matthey, L., Pal, A., Burgess, C., Glorot, X., Botvinick, M., Mohamed, S., and Lerchner, A. (2017, January 24\u201326). beta-VAE: Learning basic visual concepts with a constrained variational framework. Proceedings of the PICLR 2017, Toulon, France."},{"key":"ref_36","unstructured":"Burgess, C., Higgins, I., Pal, A., Matthey, L., Watters, N., Desjardins, G., and Lerchner, A. (2018). Understanding Disentangling in Beta-VAE. arXiv."},{"key":"ref_37","unstructured":"Chalapathy, R., Menon, A., and Chawla, S. (2018). Anomaly detection using one-class neural networks. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Govorkova, E., Puljak, E., Aarrestad, T., Pierini, M., Wo\u017aniak, K.A., and Ngadiuba, J. (2021). LHC physics dataset for unsupervised New Physics detection at 40 MHz. arXiv.","DOI":"10.1038\/s41597-022-01187-8"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1016\/0029-5582(61)90469-2","article-title":"Partial-symmetries of weak interactions","volume":"22","author":"Glashow","year":"1961","journal-title":"Nucl. Phys."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1264","DOI":"10.1103\/PhysRevLett.19.1264","article-title":"A model of leptons","volume":"19","author":"Weinberg","year":"1967","journal-title":"Phys. Rev. Lett."},{"key":"ref_41","unstructured":"Svartholm, N. (1968, January 19\u201325). Elementary Particle Theory: Relativistic Groups and Analyticity. Proceedings of the Eighth Nobel Symposium, \u00c4lvsborg, Sweden. Technical Report."},{"key":"ref_42","unstructured":"Wolchover, N. (2024, June 12). A new map of all the particles and forces. Quanta Magazine, Available online: https:\/\/www.quantamagazine.org\/a-new-map-of-the-standard-model-of-particle-physics-20201022\/."},{"key":"ref_43","unstructured":"Quigg, C. (2005, January 19\u201320). The Double simplex. Proceedings of the GUSTAVOFEST: Symposium in Honor of Gustavo C. Branco: CP Violation and the Flavor Puzzle, Lisbon, Portugal."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"083C01","DOI":"10.1093\/ptep\/ptaa104","article-title":"Review of Particle Physics","volume":"2020","author":"Zyla","year":"2020","journal-title":"Prog. Theor. Exp. Phys."},{"key":"ref_45","unstructured":"(2024, October 07). Summary of the Cross Section Measurements of Standard Model Processes. Available online: https:\/\/twiki.cern.ch\/twiki\/bin\/view\/CMSPublic\/PhysicsResultsCombined."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ellis, R.K., Stirling, W.J., and Webber, B.R. (1996). QCD and Collider Physics, Cambridge University Press. Cambridge Monographs on Particle Physics, Nuclear Physics and Cosmology.","DOI":"10.1017\/CBO9780511628788"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1807.00083","DOI":"10.1007\/s41781-019-0028-1","article-title":"Topology classification with deep learning to improve real-time event selection at the LHC","volume":"3","author":"Nguyen","year":"2019","journal-title":"Comput. Softw. Big Sci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1007\/JHEP05(2019)036","article-title":"Variational autoencoders for new physics mining at the Large Hadron Collider","volume":"2019","author":"Cerri","year":"2019","journal-title":"J. High Energy Phys."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Knapp, O., Dissertori, G., Cerri, O., Nguyen, T.Q., Vlimant, J.R., and Pierini, M. (2020). Adversarially Learned Anomaly Detection on CMS Open Data: Re-discovering the top quark. arXiv.","DOI":"10.1140\/epjp\/s13360-021-01109-4"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Govorkova, E., Puljak, E., Aarrestad, T., Pierini, M., Wo\u017aniak, K.A., and Ngadiuba, J. (2021). Unsupervised new physics detection at 40 MHz: h0\u2192\u03c4\u03c4 signal benchmark dataset. Zenodo.","DOI":"10.1038\/s41597-022-01187-8"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Govorkova, E., Puljak, E., Aarrestad, T., Pierini, M., Wo\u017aniak, K.A., and Ngadiuba, J. (2021). Unsupervised new physics detection at 40 MHz: h+\u2192\u03c4\u03bd signal benchmark dataset. Zenodo.","DOI":"10.1038\/s41597-022-01187-8"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Govorkova, E., Puljak, E., Aarrestad, T., Pierini, M., Wo\u017aniak, K.A., and Ngadiuba, J. (2021). Unsupervised new physics detection at 40 MHz: LQ\u2192b\u03c4 signal benchmark dataset. Zenodo.","DOI":"10.1038\/s41597-022-01187-8"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Govorkova, E., Puljak, E., Aarrestad, T., Pierini, M., Wo\u017aniak, K.A., and Ngadiuba, J. (2021). Unsupervised new physics detection at 40 MHz: A\u21924 leptons signal benchmark dataset. Zenodo.","DOI":"10.1038\/s41597-022-01187-8"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Aarrestad, T., Govorkova, E., Ngadiuba, J., Puljak, E., Pierini, M., and Wo\u017aniak, K. (2021). Unsupervised new physics detection at 40 MHz: Black box dataset. Zenodo.","DOI":"10.1038\/s41597-022-01187-8"},{"key":"ref_55","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the 32nd International Conference on Machine Learning, PMLR, Lille, France."},{"key":"ref_56","unstructured":"Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the ICML Workshop on Deep Learning for Audio, Speech and Language Processing, Atlanta, GA, USA."},{"key":"ref_57","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2015). TensorFlow: Large-scale machine learning on heterogeneous systems. arXiv."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Joyce, J.M. (2011). Kullback-Leibler Divergence, Springer.","DOI":"10.1007\/978-3-642-04898-2_327"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1016\/S0031-3203(96)00142-2","article-title":"The use of the area under the ROC curve in the evaluation of machine learning algorithms","volume":"30","author":"Bradley","year":"1997","journal-title":"Pattern Recognit."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1146\/annurev-nucl-102115-044713","article-title":"Triggering at the LHC","volume":"66","author":"Smith","year":"2016","journal-title":"Annu. Rev. Nucl. Part. Sci."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"2300206","DOI":"10.1002\/aisy.202300206","article-title":"Application of Image Sensing System in Mineral\/Rock Identification: Sensing Mode and Information Process","volume":"5","author":"Shixin","year":"2023","journal-title":"Adv. Intell. Syst."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"104839","DOI":"10.1016\/j.ijrmms.2021.104839","article-title":"A deep learning approach for rock fragmentation analysis","volume":"145","author":"Bamford","year":"2021","journal-title":"Int. J. Rock Mech. Min. Sci."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"7499","DOI":"10.1109\/TNNLS.2022.3229161","article-title":"Deep Neural Networks and Tabular Data: A Survey","volume":"35","author":"Borisov","year":"2024","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1007\/s00778-023-00807-y","article-title":"Tabular data synthesis with generative adversarial networks: Design space and optimizations","volume":"33","author":"Liu","year":"2024","journal-title":"VLDB J."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"045015","DOI":"10.1088\/2632-2153\/ac0ea1","article-title":"Fast convolutional neural networks on FPGAs with hls4ml","volume":"2","author":"Aarrestad","year":"2021","journal-title":"Mach. Learn. Sci. Technol."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Penc, O. (2024, January 24). ATLAS Level-1 Trigger Menu Testing. Proceedings of the 42nd International Conference on High Energy Physics (ICHEP2024), Prague, Czech Republic.","DOI":"10.22323\/1.476.0944"},{"key":"ref_67","unstructured":"Ko\u010dka, J., and Penc, O. (2024, January 24). New Interface for ATLAS L1 Trigger Menu Testing. Proceedings of the 42nd International Conference on High Energy Physics (ICHEP2024), Prague, Czech Republic."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/3\/79\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:39:03Z","timestamp":1760027943000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/3\/79"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,20]]},"references-count":67,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["computers14030079"],"URL":"https:\/\/doi.org\/10.3390\/computers14030079","relation":{},"ISSN":["2073-431X"],"issn-type":[{"type":"electronic","value":"2073-431X"}],"subject":[],"published":{"date-parts":[[2025,2,20]]}}}