{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:18:32Z","timestamp":1750220312464,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,19]],"date-time":"2021-11-19T00:00:00Z","timestamp":1637280000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"the Ministry of Science and Higher Education of the Russian Federation","award":["0852-2020-0019"],"award-info":[{"award-number":["0852-2020-0019"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11,19]]},"DOI":"10.1145\/3501774.3501786","type":"proceedings-article","created":{"date-parts":[[2022,3,26]],"date-time":"2022-03-26T16:12:37Z","timestamp":1648311157000},"page":"78-84","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Safe Reinforcement Learning in Simulated Environment of Self-Driving Laboratory"],"prefix":"10.1145","author":[{"given":"Andrey","family":"V. Chernov","sequence":"first","affiliation":[{"name":"The Smart Materials Research Institute, Southern Federal University, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ilias","family":"K. Savvas","sequence":"additional","affiliation":[{"name":"Dept. of Digital Systems, University of Thessaly, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria","family":"A. Butakova","sequence":"additional","affiliation":[{"name":"The Smart Materials Research Institute, Southern Federal University, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Oleg","family":"O. Kartashov","sequence":"additional","affiliation":[{"name":"The Smart Materials Research Institute, Southern Federal University, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,3,26]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Cyber-physical systems and their security issues. Comput. Ind. 100, (September","author":"Alguliyev Rasim","year":"2018","unstructured":"Rasim Alguliyev , Yadigar Imamverdiyev , and Lyudmila Sukhostat . 2018. Cyber-physical systems and their security issues. Comput. Ind. 100, (September 2018 ), 212\u2013223. DOI:https:\/\/doi.org\/10.1016\/j.compind.2018.04.017 10.1016\/j.compind.2018.04.017 Rasim Alguliyev, Yadigar Imamverdiyev, and Lyudmila Sukhostat. 2018. Cyber-physical systems and their security issues. Comput. Ind. 100, (September 2018), 212\u2013223. DOI:https:\/\/doi.org\/10.1016\/j.compind.2018.04.017"},{"key":"e_1_3_2_1_2_1","volume-title":"Retrieved","author":"Amodei Dario","year":"2016","unstructured":"Dario Amodei , Chris Olah , Jacob Steinhardt , Paul Christiano , John Schulman , and Dan Man\u00e9 . 2016 . Concrete Problems in AI Safety. ArXiv160606565 Cs (July 2016) . Retrieved August 24, 2021 from http:\/\/arxiv.org\/abs\/1606.06565 Dario Amodei, Chris Olah, Jacob Steinhardt, Paul Christiano, John Schulman, and Dan Man\u00e9. 2016. Concrete Problems in AI Safety. ArXiv160606565 Cs (July 2016). Retrieved August 24, 2021 from http:\/\/arxiv.org\/abs\/1606.06565"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/nnano.2010.1"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-020-09492-5"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5937\/telfor1601014C"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12951-016-0169-x"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.trechm.2019.02.007"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-006-0014-y"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-019-09421-1"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.23919\/MIPRO48935.2020.9245153"},{"key":"e_1_3_2_1_11_1","volume-title":"Retrieved","author":"Leike Jan","year":"2017","unstructured":"Jan Leike , Miljan Martic , Victoria Krakovna , Pedro A. Ortega , Tom Everitt , Andrew Lefrancq , Laurent Orseau , and Shane Legg . 2017 . AI Safety Gridworlds. ArXiv171109883 Cs (November 2017) . Retrieved August 25, 2021 from http:\/\/arxiv.org\/abs\/1711.09883 Jan Leike, Miljan Martic, Victoria Krakovna, Pedro A. Ortega, Tom Everitt, Andrew Lefrancq, Laurent Orseau, and Shane Legg. 2017. AI Safety Gridworlds. ArXiv171109883 Cs (November 2017). Retrieved August 25, 2021 from http:\/\/arxiv.org\/abs\/1711.09883"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compchemeng.2016.03.006"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2020.2994747"},{"key":"e_1_3_2_1_14_1","first-page":"20","article-title":"Self-driving laboratory for accelerated discovery of thin-film materials. Sci","volume":"6","author":"MacLeod B. P.","year":"2020","unstructured":"B. P. MacLeod , F. G. L. Parlane , T. D. Morrissey , F. H\u00e4se , L. M. Roch , K. E. Dettelbach , R. Moreira , L. P. E. Yunker , M. B. Rooney , J. R. Deeth , V. Lai , G. J. Ng , H. Situ , R. H. Zhang , M. S. Elliott , T. H. Haley , D. J. Dvorak , A. Aspuru-Guzik , J. E. Hein , and C. P. Berlinguette . 2020 . Self-driving laboratory for accelerated discovery of thin-film materials. Sci . Adv. 6 , 20 (May 2020), eaaz8867. DOI:https:\/\/doi.org\/10.1126\/sciadv.aaz8867 10.1126\/sciadv.aaz8867 B. P. MacLeod, F. G. L. Parlane, T. D. Morrissey, F. H\u00e4se, L. M. Roch, K. E. Dettelbach, R. Moreira, L. P. E. Yunker, M. B. Rooney, J. R. Deeth, V. Lai, G. J. Ng, H. Situ, R. H. Zhang, M. S. Elliott, T. H. Haley, D. J. Dvorak, A. Aspuru-Guzik, J. E. Hein, and C. P. Berlinguette. 2020. Self-driving laboratory for accelerated discovery of thin-film materials. Sci. Adv. 6, 20 (May 2020), eaaz8867. DOI:https:\/\/doi.org\/10.1126\/sciadv.aaz8867","journal-title":"Adv."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1021\/acs.oprd.9b00140"},{"key":"e_1_3_2_1_16_1","volume-title":"Counterfactual state explanations for reinforcement learning agents via generative deep learning. Artif. Intell. 295, (June","author":"Olson Matthew L.","year":"2021","unstructured":"Matthew L. Olson , Roli Khanna , Lawrence Neal , Fuxin Li , and Weng-Keen Wong . 2021. Counterfactual state explanations for reinforcement learning agents via generative deep learning. Artif. Intell. 295, (June 2021 ), 103455. DOI:https:\/\/doi.org\/10.1016\/j.artint.2021.103455 10.1016\/j.artint.2021.103455 Matthew L. Olson, Roli Khanna, Lawrence Neal, Fuxin Li, and Weng-Keen Wong. 2021. Counterfactual state explanations for reinforcement learning agents via generative deep learning. Artif. Intell. 295, (June 2021), 103455. DOI:https:\/\/doi.org\/10.1016\/j.artint.2021.103455"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1021\/acsmedchemlett.7b00165"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3390\/nano11030619"},{"key":"e_1_3_2_1_19_1","volume-title":"A methodology for the design and deployment of distributed cyber\u2013physical systems for smart environments. Future Gener. Comput. Syst. 109, (August","author":"Tanganelli Giacomo","year":"2020","unstructured":"Giacomo Tanganelli , Luca Cassano , Antonio Miele , and Carlo Vallati . 2020. A methodology for the design and deployment of distributed cyber\u2013physical systems for smart environments. Future Gener. Comput. Syst. 109, (August 2020 ), 420\u2013430. DOI:https:\/\/doi.org\/10.1016\/j.future.2020.02.047 10.1016\/j.future.2020.02.047 Giacomo Tanganelli, Luca Cassano, Antonio Miele, and Carlo Vallati. 2020. A methodology for the design and deployment of distributed cyber\u2013physical systems for smart environments. Future Gener. Comput. Syst. 109, (August 2020), 420\u2013430. DOI:https:\/\/doi.org\/10.1016\/j.future.2020.02.047"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-006-9002-5"},{"key":"e_1_3_2_1_21_1","unstructured":"Nano Nature Portfolio Solution. Retrieved from https:\/\/nano.nature.com\/  Nano Nature Portfolio Solution. Retrieved from https:\/\/nano.nature.com\/"},{"key":"e_1_3_2_1_22_1","unstructured":"A European approach to Artificial intelligence. Retrieved from https:\/\/digital-strategy.ec.europa.eu\/en\/policies\/european-approach-artificial-intelligence  A European approach to Artificial intelligence. Retrieved from https:\/\/digital-strategy.ec.europa.eu\/en\/policies\/european-approach-artificial-intelligence"}],"event":{"name":"ESSE 2021: 2021 2nd European Symposium on Software Engineering","acronym":"ESSE 2021","location":"Larissa Greece"},"container-title":["2021 2nd European Symposium on Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501774.3501786","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3501774.3501786","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:45Z","timestamp":1750191105000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501774.3501786"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,19]]},"references-count":22,"alternative-id":["10.1145\/3501774.3501786","10.1145\/3501774"],"URL":"https:\/\/doi.org\/10.1145\/3501774.3501786","relation":{},"subject":[],"published":{"date-parts":[[2021,11,19]]},"assertion":[{"value":"2022-03-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}