{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T23:58:44Z","timestamp":1740182324249,"version":"3.37.3"},"reference-count":43,"publisher":"IOP Publishing","issue":"2","license":[{"start":{"date-parts":[[2021,2,26]],"date-time":"2021-02-26T00:00:00Z","timestamp":1614297600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,2,26]],"date-time":"2021-02-26T00:00:00Z","timestamp":1614297600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"crossref","award":["18-41-06001"],"award-info":[{"award-number":["18-41-06001"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Helmholtz-Gemeinschaft","award":["HRSF-0002"],"award-info":[{"award-number":["HRSF-0002"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2021,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Single particle imaging (SPI) is a promising method of native structure determination, which has undergone fast progress with the development of x-ray free-electron lasers. Large amounts of data are collected during SPI experiments, driving the need for automated data analysis. The necessary data analysis pipeline has a number of steps including binary object classification (single versus non-single hits). Classification and object detection are areas where deep neural networks currently outperform other approaches. In this work, we use the fast object detector networks YOLOv2 and YOLOv3. By exploiting transfer learning, a moderate amount of data is sufficient to train the neural network. We demonstrate here that a convolutional neural network can be successfully used to classify data from SPI experiments. We compare the results of classification for the two different networks, with different depth and architecture, by applying them to the same SPI data with different data representation. The best results are obtained for diffracted intensity represented by color images on a linear scale using YOLOv2 for classification. It shows an accuracy of about 95% with precision and recall of about 50% and 60%, respectively, in comparison to manual data classification.<\/jats:p>","DOI":"10.1088\/2632-2153\/abd916","type":"journal-article","created":{"date-parts":[[2021,1,6]],"date-time":"2021-01-06T22:50:19Z","timestamp":1609973419000},"page":"025014","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Classification of diffraction patterns in single particle imaging experiments performed at x-ray free-electron lasers using a convolutional neural network"],"prefix":"10.1088","volume":"2","author":[{"given":"Alexandr","family":"Ignatenko","sequence":"first","affiliation":[]},{"given":"Dameli","family":"Assalauova","sequence":"additional","affiliation":[]},{"given":"Sergey A","family":"Bobkov","sequence":"additional","affiliation":[]},{"given":"Luca","family":"Gelisio","sequence":"additional","affiliation":[]},{"given":"Anton B","family":"Teslyuk","sequence":"additional","affiliation":[]},{"given":"Viacheslav A","family":"Ilyin","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0340-8234","authenticated-orcid":false,"given":"Ivan A","family":"Vartanyants","sequence":"additional","affiliation":[]}],"member":"266","published-online":{"date-parts":[[2021,2,26]]},"reference":[{"key":"mlstabd916bib1","doi-asserted-by":"publisher","first-page":"752","DOI":"10.1038\/35021099","article-title":"Potential for biomolecular imaging with femtosecond x-ray pulses","volume":"406","author":"Neutze","year":"2000","journal-title":"Nature"},{"key":"mlstabd916bib2","doi-asserted-by":"publisher","first-page":"1444","DOI":"10.1126\/science.1135923","article-title":"Imaging atomic structure and dynamics with ultrafast x-ray scattering","volume":"316","author":"Gaffney","year":"2007","journal-title":"Science"},{"key":"mlstabd916bib3","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1038\/nphoton.2010.176","article-title":"First lasing and operation of an \u00e5ngstrom-wavelength free-electron laser","volume":"4","author":"Emma","year":"2020","journal-title":"Nat. Photonics"},{"key":"mlstabd916bib4","doi-asserted-by":"publisher","first-page":"540","DOI":"10.1038\/nphoton.2012.141","article-title":"A compact x-ray free-electron laser emitting in the sub-\u00e5ngstr\u00f6m region","volume":"6","author":"Ishikawa","year":"2012","journal-title":"Nat. Photonics"},{"key":"mlstabd916bib5","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1038\/s41566-020-0607-z","article-title":"A MHz-repetition-rate hard x-ray free-electron laser driven by a superconducting linear accelerator","volume":"14","author":"Decking","year":"2020","journal-title":"Nat. Photonics"},{"key":"mlstabd916bib6","doi-asserted-by":"publisher","first-page":"839","DOI":"10.1038\/nphys461","article-title":"Femtosecond diffractive imaging with a soft-x-ray free-electron laser","volume":"2","author":"Chapman","year":"2006","journal-title":"Nat. Phys."},{"key":"mlstabd916bib7","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1038\/nature09748","article-title":"Single mimivirus particles intercepted and imaged with an x-ray laser","volume":"470","author":"Seibert","year":"2011","journal-title":"Nature"},{"key":"mlstabd916bib8","doi-asserted-by":"publisher","first-page":"943","DOI":"10.1038\/nphoton.2014.270","article-title":"High-throughput imaging of heterogeneous cell organelles with an x-ray laser","volume":"8","author":"Hantke","year":"2014","journal-title":"Nat. Photonics"},{"key":"mlstabd916bib9","doi-asserted-by":"publisher","first-page":"5704","DOI":"10.1038\/ncomms6704","article-title":"Imaging single cells in a beam of live cyanobacteria with an x-ray laser","volume":"6","author":"van der Schot","year":"2015","journal-title":"Nat. Commun."},{"key":"mlstabd916bib10","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.114.098102","article-title":"Three-dimensional reconstruction of the giant mimivirus particle with an x-ray free-electron laser","volume":"114","author":"Ekeberg","year":"2015","journal-title":"Phys. Rev. Lett."},{"key":"mlstabd916bib11","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1107\/S205225251801120X","article-title":"Single-particle imaging without symmetry constraints at an x-ray free-electron laser","volume":"5","author":"Rose","year":"2018","journal-title":"IUCrJ"},{"key":"mlstabd916bib12","doi-asserted-by":"publisher","first-page":"1102","DOI":"10.1107\/S2052252520012798","article-title":"An advanced workflow for single particle imaging with the limited data at an x-ray free-electron laser","volume":"7","author":"Assalauova","year":"2020","journal-title":"IUCrJ"},{"key":"mlstabd916bib13","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1107\/S1600577515017348","article-title":"Sorting algorithms for single-particle imaging experiments at x-ray free-electron lasers","volume":"22","author":"Bobkov","year":"2015","journal-title":"J. Synchrotron Radiat."},{"key":"mlstabd916bib14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the EM algorithm","volume":"39","author":"Dempster","year":"1977","journal-title":"J. R. Stat. Soc. SeR. B"},{"key":"mlstabd916bib15","first-page":"p 25","article-title":"ImageNet classification with deep convolutional neural networks","author":"Krizhevsky","year":"2012"},{"key":"mlstabd916bib16","first-page":"p 2553","article-title":"Deep neural networks for object detection","author":"Szegedy","year":"2013"},{"key":"mlstabd916bib17","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1107\/S2052252519001854","article-title":"Evaluation of the performance of classification algorithms for XFEL single-particle imaging data","volume":"6","author":"Shi","year":"2019","journal-title":"IUCrJ"},{"key":"mlstabd916bib18","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.99.063309","article-title":"Deep neural networks for classifying complex features in diffraction images","volume":"99","author":"Zimmerman","year":"2019","journal-title":"Phys. Rev. E"},{"key":"mlstabd916bib19","doi-asserted-by":"publisher","first-page":"486","DOI":"10.1107\/s1600577520000831","article-title":"Tomographic reconstruction with a generative adversarial network","volume":"27","author":"Yang","year":"2020","journal-title":"J. Synchrotron Radiat."},{"key":"mlstabd916bib20","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1107\/S1600577515004646","article-title":"The atomic, molecular and optical science instrument at the Linac Coherent Light Source","volume":"22","author":"Ferguson","year":"2015","journal-title":"J. Synchrotron Radiat."},{"key":"mlstabd916bib21","doi-asserted-by":"publisher","DOI":"10.1063\/1.5017727","article-title":"The LAMP instrument at the Linac Coherent Light Source free-electron laser","volume":"89","author":"Osipov","year":"2018","journal-title":"Rev. Sci. Instrum."},{"key":"mlstabd916bib22","doi-asserted-by":"publisher","DOI":"10.1063\/1.4918726","article-title":"The linac coherent light source single particle imaging road map","volume":"2","author":"Aquila","year":"2015","journal-title":"Struct. Dyn."},{"key":"mlstabd916bib23","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1038\/s41597-020-00745-2","article-title":"Diffraction data from aerosolized coliphage PR772 virus particles imaged with the Linac Coherent Light Source","volume":"7","author":"Li","year":"2020","journal-title":"Sci. Data"},{"key":"mlstabd916bib24","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2017.79","article-title":"Coherent soft x-ray diffraction imaging of coliphage PR772 at the Linac Coherent Light Source","volume":"4","author":"Reddy","year":"2017","journal-title":"Sci. Data"},{"key":"mlstabd916bib25","doi-asserted-by":"publisher","DOI":"10.1364\/OE.390131","article-title":"3D printing of gas-dynamic virtual nozzles and optical characterization of high-speed microjets","volume":"28","author":"Nazari","year":"2020","journal-title":"Opt. Express"},{"key":"mlstabd916bib26","doi-asserted-by":"publisher","first-page":"917","DOI":"10.1016\/j.jaerosci.2008.05.008","article-title":"Non-destructive characterization and alignment of aerodynamically focused particle beams using single particle charge detection","volume":"39","author":"Benner","year":"2008","journal-title":"J. Aerosol Sci."},{"key":"mlstabd916bib27","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1016\/j.nima.2009.12.053","article-title":"Large-format, high-speed, x-ray pnCCDs combined with electron and ion imaging spectrometers in a multipurpose chamber for experiments at 4th generation light sources","volume":"614","author":"Str\u00fcder","year":"2010","journal-title":"Nucl. Instrum. Methods Phys. Res. A"},{"key":"mlstabd916bib28","doi-asserted-by":"publisher","first-page":"672","DOI":"10.1107\/S1600576716004349","article-title":"Linac Coherent Light Source data analysis using psana","volume":"49","author":"Damiani","year":"2016","journal-title":"J. Appl. Crystallogr."},{"article-title":"YOLO9000: better, faster, stronger","year":"2016","author":"Redmon","key":"mlstabd916bib29"},{"author":"Redmon","key":"mlstabd916bib30","article-title":"Darknet: open source neural networks in C"},{"article-title":"YOLOv3: an incremental improvement","year":"2018","author":"Redmon","key":"mlstabd916bib31"},{"year":"2016","author":"Goodfellow","key":"mlstabd916bib32"},{"key":"mlstabd916bib33","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal visual object classes (VOC) challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"mlstabd916bib34","doi-asserted-by":"crossref","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet large scale visual recognition challenge","author":"Russakovsky","year":"2015"},{"article-title":"An overview of multi-task learning in deep neural networks","year":"2017","author":"Ruder","key":"mlstabd916bib35"},{"edition":"3rd edn","year":"1984","author":"Kaplan","key":"mlstabd916bib36"},{"article-title":"Layer normalization","year":"2017","author":"Bottou","key":"mlstabd916bib37"},{"article-title":"Accurate, large minibatch SGD: training ImageNet in 1 hour","year":"2017","author":"Goyal","key":"mlstabd916bib38"},{"author":"Fei-Fei","key":"mlstabd916bib39","article-title":"ImageNet"},{"article-title":"Identity mappings in deep residual networks","year":"2015","author":"He","key":"mlstabd916bib40"},{"key":"mlstabd916bib41","doi-asserted-by":"publisher","first-page":"1237","DOI":"10.1364\/OE.26.001237","article-title":"Quantitative ptychographic bio-imaging in the water window","volume":"26","author":"Rose","year":"2018","journal-title":"Opt. Express"},{"volume":"vol 6791","year":"2011","author":"Masci","key":"mlstabd916bib42"},{"key":"mlstabd916bib43","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1038\/s42005-020-0362-y","article-title":"Megahertz single-particle imaging at the European XFEL","volume":"3","author":"Sobolev","year":"2020","journal-title":"Commun. Phys."}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abd916","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abd916\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abd916","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abd916\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abd916\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abd916\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abd916\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abd916\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T00:15:31Z","timestamp":1724285731000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abd916"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,26]]},"references-count":43,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2,26]]},"published-print":{"date-parts":[[2021,6,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/abd916","relation":{},"ISSN":["2632-2153"],"issn-type":[{"type":"electronic","value":"2632-2153"}],"subject":[],"published":{"date-parts":[[2021,2,26]]},"assertion":[{"value":"Classification of diffraction patterns in single particle imaging experiments performed at x-ray free-electron lasers using a convolutional neural network","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2021 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2020-08-14","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2021-01-06","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2021-02-26","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}