{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T11:22:39Z","timestamp":1770549759095,"version":"3.49.0"},"publisher-location":"Cham","reference-count":46,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031460012","type":"print"},{"value":"9783031460029","type":"electronic"}],"license":[{"start":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T00:00:00Z","timestamp":1702512000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T00:00:00Z","timestamp":1702512000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Learning-enabled autonomous systems (LEAS) use machine learning (ML) components for essential functions of autonomous operation, such as perception and control. LEAS are often safety-critical. The development and integration of trustworthy ML components present new challenges that extend beyond the boundaries of system\u2019s design to the system\u2019s operation in its real environment. This paper introduces the methodology and tools developed within the frame of the FOCETA European project towards the continuous engineering of trustworthy LEAS. Continuous engineering includes iterations between two alternating phases, namely: (i) design and virtual testing, and (ii) deployment and operation. Phase (i) encompasses the design of trustworthy ML components and the system\u2019s validation with respect to formal specifications of its requirements via modeling and simulation. An integral part of both the simulation-based testing and the operation of LEAS is the monitoring and enforcement of safety, security and performance properties and the acquisition of information for the system\u2019s operation in its environment. Finally, we show how the FOCETA approach has been applied to realistic continuous engineering workflowsfor three different LEAS from automotive and medical application domains.<\/jats:p>","DOI":"10.1007\/978-3-031-46002-9_15","type":"book-chapter","created":{"date-parts":[[2023,12,13]],"date-time":"2023-12-13T16:02:36Z","timestamp":1702483356000},"page":"256-278","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Continuous Engineering for\u00a0Trustworthy Learning-Enabled Autonomous Systems"],"prefix":"10.1007","author":[{"given":"Saddek","family":"Bensalem","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Panagiotis","family":"Katsaros","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dejan","family":"Ni\u010dkovi\u0107","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian Hsuan-Cheng","family":"Liao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ricardo Ruiz","family":"Nolasco","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohamed Abd El Salam","family":"Ahmed","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tewodros A.","family":"Beyene","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Filip","family":"Cano","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antoine","family":"Delacourt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hasan","family":"Esen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandru","family":"Forrai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weicheng","family":"He","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaowei","family":"Huang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nikolaos","family":"Kekatos","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bettina","family":"K\u00f6nighofer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Paulitsch","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Doron","family":"Peled","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthieu","family":"Ponchant","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lev","family":"Sorokin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Son","family":"Tong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Changshun","family":"Wu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,12,14]]},"reference":[{"key":"15_CR1","unstructured":"Aguilar, E.A., Berducci, L., Brunnbauer, A., Grosu, R., Nickovic, D.: From STL rulebooks to rewards. CoRR, abs\/ arXiv: 2110.02792 (2021)"},{"key":"15_CR2","doi-asserted-by":"crossref","unstructured":"Bartocci, E., Mateis, C., Nesterini, E., Nickovic, D.: Survey on mining signal temporal logic specifications. Inform. Comput., 104957 (2022)","DOI":"10.1016\/j.ic.2022.104957"},{"key":"15_CR3","doi-asserted-by":"crossref","unstructured":"Bartocci, E., Mateis, C., Nesterini, E., Ni\u010dkovi\u0107, D.: Mining hyperproperties using temporal logics. ACM Trans. Embed. Comput. Syst. (2023)","DOI":"10.1145\/3609394"},{"key":"15_CR4","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-642-25929-6_1","volume-title":"Mathematical and Engineering Methods in Computer Science","author":"A Basu","year":"2012","unstructured":"Basu, A., Bensalem, S., Bozga, M., Bourgos, P., Sifakis, J.: Rigorous system design: the BIP approach. In: Kot\u00e1sek, Z., Bouda, J., \u010cern\u00e1, I., Sekanina, L., Vojnar, T., Anto\u0161, D. (eds.) MEMICS 2011. LNCS, vol. 7119, pp. 1\u201319. Springer, Heidelberg (2012). https:\/\/doi.org\/10.1007\/978-3-642-25929-6_1"},{"key":"15_CR5","doi-asserted-by":"publisher","unstructured":"Bensalem, S., et al.: Formal specification for learning-enabled autonomous systems. In: Software Verification and Formal Methods for ML-Enabled Autonomous Systems, pp. 131\u2013143. Springer International Publishing, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-031-21222-2_8","DOI":"10.1007\/978-3-031-21222-2_8"},{"key":"15_CR6","unstructured":"Berducci, L., Aguilar, E.A., Ni\u010dkovi\u0107, D., Grosu, R.: Hierarchical potential-based reward shaping from task specifications (2021)"},{"key":"15_CR7","doi-asserted-by":"crossref","unstructured":"Chen, Y., Cheng, C.-H., Yan, J., Yan, R.: Monitoring object detection abnormalities via data-label and post-algorithm abstractions. In: 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 6688\u20136693 (2021)","DOI":"10.1109\/IROS51168.2021.9636713"},{"key":"15_CR8","doi-asserted-by":"crossref","unstructured":"Cheng, C., Yan, R.: Testing autonomous systems with believed equivalence refinement. In: 2021 IEEE International Conference On Artificial Intelligence Testing (AITest), pp. 49\u201356. IEEE Computer Society (2021)","DOI":"10.1109\/AITEST52744.2021.00020"},{"key":"15_CR9","doi-asserted-by":"crossref","unstructured":"Cheng, C.-H.: Provably-robust runtime monitoring of neuron activation patterns. In: IEEE DATE (2021)","DOI":"10.23919\/DATE51398.2021.9473957"},{"key":"15_CR10","doi-asserted-by":"crossref","unstructured":"Cruanes, S., Hamon, G., Owre, S., Shankar, N.: Tool integration with the evidential tool bus. In: Verification, Model Checking, and Abstract Interpretation, 14th International Conference, VMCAI 2013, Rome, Italy, 20\u201322 January 2013. Proceedings, pp. 275\u2013294 (2013)","DOI":"10.1007\/978-3-642-35873-9_18"},{"issue":"2","key":"15_CR11","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1109\/4235.996017","volume":"6","author":"K Deb","year":"2002","unstructured":"Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans. Evol. Comput. 6(2), 182\u2013197 (2002)","journal-title":"IEEE Trans. Evol. Comput."},{"key":"15_CR12","doi-asserted-by":"publisher","unstructured":"Eleftheriadis, C., Kekatos, N., Katsaros, P., Tripakis, S.: On neural network equivalence checking using smt solvers. In: Bogomolov, S., Parker, D. (eds.) Formal Modeling and Analysis of Timed Systems, pp. 237\u2013257. Springer International Publishing, Cham (2022) https:\/\/doi.org\/10.1007\/978-3-031-15839-1_14","DOI":"10.1007\/978-3-031-15839-1_14"},{"key":"15_CR13","doi-asserted-by":"crossref","unstructured":"Fogler, R., Cohen, I., Peled, D.: Accelerating black box testing with light-weight learning. In: Model Checking Software - 29th International Symposium, SPIN 2023, Paris, France, 26\u201327 April 2023, Proceedings, pp. 103\u2013120 (2023)","DOI":"10.1007\/978-3-031-32157-3_6"},{"key":"15_CR14","doi-asserted-by":"crossref","unstructured":"Geissler, F., Qutub, S., Paulitsch, M., Pattabiraman, K.: A low-cost strategic monitoring approach for scalable and interpretable error detection in deep neural networks. In: Computer Safety, Reliability, and Security - 42nd International Conference, SAFECOMP 2023, Toulouse, France, 19\u201322 September 2023, Proceedings (2023)","DOI":"10.1007\/978-3-031-40923-3_7"},{"key":"15_CR15","unstructured":"Geissler, F., et al.: Towards a safety case for hardware fault tolerance in convolutional neural networks using activation range supervision. CoRR, abs\/ arXiv: 2108.07019 (2021)"},{"key":"15_CR16","doi-asserted-by":"crossref","unstructured":"Gr\u00e4fe, R., Sha, Q.S., Geissler, F., Paulitsch, M.: Large-scale application of fault injection into pytorch models -an extension to pytorchfi for validation efficiency. In: 2023 53rd Annual IEEE\/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S), pp. 56\u201362 (2023)","DOI":"10.1109\/DSN-S58398.2023.00025"},{"key":"15_CR17","doi-asserted-by":"crossref","unstructured":"Havelund, K., Peled, D., Ulus, D.: Dejavu: a monitoring tool for first-order temporal logic. In: 3rd Workshop on Monitoring and Testing of Cyber-Physical Systems, MT@CPSWeek 2018, Porto, Portugal, 10 April 2018, pp. 12\u201313 (2018)","DOI":"10.1109\/MT-CPS.2018.00013"},{"key":"15_CR18","unstructured":"Henzinger, T.A., Lukina, A., Schilling, C.: Outside the box: abstraction-based monitoring of neural networks. In: ECAI 2020, pp. 2433\u20132440. IOS Press (2020)"},{"issue":"3","key":"15_CR19","doi-asserted-by":"publisher","first-page":"1191","DOI":"10.1109\/TR.2021.3080664","volume":"71","author":"W Huang","year":"2022","unstructured":"Huang, W., et al.: Coverage-guided testing for recurrent neural networks. IEEE Trans. Reliab. 71(3), 1191\u20131206 (2022)","journal-title":"IEEE Trans. Reliab."},{"key":"15_CR20","doi-asserted-by":"crossref","unstructured":"Huang, W., Zhao, X., Cox, V., Huang, X.: Hierarchical distribution-aware testing of deep learning, Alec Banks (2022)","DOI":"10.1145\/3625290"},{"key":"15_CR21","doi-asserted-by":"crossref","unstructured":"Huang, W., Zhao, X., Jin, G., Huang, X.: Safari: versatile and efficient evaluations for robustness of interpretability. arXiv preprint arXiv:2208.09418 (2022)","DOI":"10.1109\/ICCV51070.2023.00190"},{"key":"15_CR22","doi-asserted-by":"crossref","unstructured":"Jin, G., Yi, X., Huang, W., Schewe, S., Huang, X.: Enhancing adversarial training with second-order statistics of weights. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 15273\u201315283 (June 2022)","DOI":"10.1109\/CVPR52688.2022.01484"},{"key":"15_CR23","first-page":"21346","volume":"33","author":"G Jin","year":"2020","unstructured":"Jin, G., Yi, X., Zhang, L., Zhang, L., Schewe, S., Huang, X.: How does weight correlation affect generalisation ability of deep neural networks? Adv. Neural Inf. Proc. Syst. 33, 21346\u201321356 (2020)","journal-title":"Adv. Neural Inf. Proc. Syst."},{"key":"15_CR24","doi-asserted-by":"crossref","unstructured":"K\u00f6nighofer, B., Rudolf, J., Palmisano, A., Tappler, M., Bloem, R.: Online shielding for reinforcement learning. CoRR, abs\/ arXiv: 2212.01861 (2022)","DOI":"10.1007\/s11334-022-00480-4"},{"key":"15_CR25","doi-asserted-by":"publisher","unstructured":"Kose, N., Krishnan, R., Dhamasia, A., Tickoo, O., Paulitsch, M.: Reliable multimodal trajectory prediction via error aligned uncertainty optimization. In Computer Vision - ECCV 2022 Workshops - Tel Aviv, Israel, 23\u201327 October 2022, Proceedings, Part V, pp. 443\u2013458 (2022). https:\/\/doi.org\/10.1007\/978-3-031-25072-9_31","DOI":"10.1007\/978-3-031-25072-9_31"},{"key":"15_CR26","doi-asserted-by":"crossref","unstructured":"Liao, B.H.-C., Cheng, C.-H., Esen, H., Knoll, A.: Are transformers more robust? Towards exact robustness verification for transformers. In: SafeComp (2023)","DOI":"10.1007\/978-3-031-40923-3_8"},{"key":"15_CR27","unstructured":"Liao, B.H.-C., Cheng, C.-H., Esen, H., Knoll, A.: Improving the safety of 3D object detectors in autonomous driving using IoGT and distance measures. abs\/ arXiv: 2209.10368 (2023)"},{"key":"15_CR28","doi-asserted-by":"crossref","unstructured":"Maderbacher, B., Schupp, S., Bartocci, E., Bloem,R., Nickovic, D., K\u00f6nighofer, B.: Provable correct and adaptive simplex architecture for bounded-liveness properties. In: Model Checking Software - 29th International Symposium, SPIN 2023, Paris, France, 26\u201327April 2023, Proceedings, pp. 141\u2013160 (2023)","DOI":"10.1007\/978-3-031-32157-3_8"},{"key":"15_CR29","doi-asserted-by":"crossref","unstructured":"Mahmoud, A., et al.: Pytorchfi: a runtime perturbation tool for dnns. In: 2020 50th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W), pp. 25\u201331 (2020)","DOI":"10.1109\/DSN-W50199.2020.00014"},{"key":"15_CR30","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1007\/978-3-540-30206-3_12","volume-title":"Formal Techniques, Modelling and Analysis of Timed and Fault-Tolerant Systems","author":"O Maler","year":"2004","unstructured":"Maler, O., Nickovic, D.: Monitoring temporal properties of continuous signals. In: Lakhnech, Y., Yovine, S. (eds.) FORMATS\/FTRTFT -2004. LNCS, vol. 3253, pp. 152\u2013166. Springer, Heidelberg (2004). https:\/\/doi.org\/10.1007\/978-3-540-30206-3_12"},{"key":"15_CR31","doi-asserted-by":"publisher","first-page":"84094","DOI":"10.1109\/ACCESS.2022.3197281","volume":"10","author":"K Mokos","year":"2022","unstructured":"Mokos, K., Nestoridis, T., Katsaros, P., Bassiliades, N.: Semantic modeling and analysis of natural language system requirements. IEEE Access 10, 84094\u201384119 (2022)","journal-title":"IEEE Access"},{"key":"15_CR32","doi-asserted-by":"crossref","unstructured":"Nickovic, D., Yamaguchi, T.: RTAMT: online robustness monitors from STL. In: Automated Technology for Verification and Analysis - 18th International Symposium, ATVA 2020, Hanoi, Vietnam, 19\u201323 October 2020, Proceedings, pp. 564\u2013571 (2020)","DOI":"10.1007\/978-3-030-59152-6_34"},{"key":"15_CR33","unstructured":"OpenAI. Gpt-4 technical report (2023)"},{"key":"15_CR34","doi-asserted-by":"publisher","unstructured":"Qutub, S., Geissler, F., Peng, Y., Gr\u00e4fe, R., Paulitsch, M., Hinz, G., Knoll, A.: Hardware faults that matter: understanding and estimating the safety impact of hardware faults on object detection DNNs. LNCS, pp. 298\u2013318. Springer International Publishing (2022). https:\/\/doi.org\/10.1007\/978-3-031-14835-4_20","DOI":"10.1007\/978-3-031-14835-4_20"},{"key":"15_CR35","unstructured":"SAE. J3016: Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles"},{"key":"15_CR36","doi-asserted-by":"crossref","unstructured":"Sorokin, L., Munaro, T., Safin, D., Liao, B.H.-C., Molin, A.: A modular framework for search-based testing of automated driving systems, Opensbt (2023)","DOI":"10.1145\/3639478.3640027"},{"key":"15_CR37","doi-asserted-by":"crossref","unstructured":"Su, J., Vargas, D.V., Sakurai, K.: One pixel attack for fooling deep neural networks. IEEE Trans. Evolut. Comput. 23(5), 828\u2013841 (2019)","DOI":"10.1109\/TEVC.2019.2890858"},{"key":"15_CR38","doi-asserted-by":"publisher","unstructured":"Temperekidis, A., Kekatos, N., Katsaros, P.: Runtime verification for fmi-based co-simulation. In: Dang, T., Stolz, V. (eds.) Runtime Verification, pp. 304\u2013313. Springer International Publishing, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-031-17196-3_19","DOI":"10.1007\/978-3-031-17196-3_19"},{"key":"15_CR39","doi-asserted-by":"publisher","unstructured":"Temperekidis, A., et al.: Towards a digital twin architecture with formal analysis capabilities for learning-enabled autonomous systems. In: Modelling and Simulation for Autonomous Systems, pp. 163\u2013181. Springer International Publishing, Cham (2023). https:\/\/doi.org\/10.1007\/978-3-031-31268-7_10","DOI":"10.1007\/978-3-031-31268-7_10"},{"key":"15_CR40","doi-asserted-by":"crossref","unstructured":"Tripakis, S.: Bridging the semantic gap between heterogeneous modeling formalisms and FMI. In: 2015 International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation (SAMOS), pp. 60\u201369. IEEE (2015)","DOI":"10.1109\/SAMOS.2015.7363660"},{"key":"15_CR41","unstructured":"Wu, C., Falcone, Y., Bensalem, S.: Customizable reference runtime monitoring of neural networks using resolution boxes (2021)"},{"key":"15_CR42","unstructured":"Zuxuan, W., Lim, S.-N., Davis, L., Goldstein, T.: Real world adversarial attacks on object detectors, Making an invisibility cloak (2019)"},{"key":"15_CR43","doi-asserted-by":"crossref","unstructured":"Xu, P., Wang, F., Ruan, W., Zhang, C., Huang, X.: Sora: scalable black-box reachability analyser on neural networks. In: ICASSP 2023\u20132023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1\u20135. IEEE (2023)","DOI":"10.1109\/ICASSP49357.2023.10097180"},{"key":"15_CR44","unstructured":"Zhao, X., et al.: Assessing the reliability of deep learning classifiers through robustness evaluation and operational profiles. In: Proceedings of the Workshop on Artificial Intelligence Safety 2021 (co-located with IJCAI 2021), vol. 2916. CEUR Workshop Proceedings (2021)"},{"key":"15_CR45","unstructured":"Zhao, X.: Reliability assessment and safety arguments for machine learning components in assuring learning-enabled autonomous systems. ACM Trans. Embedded Comput. Syst. (2022)"},{"key":"15_CR46","unstructured":"Zhao, X., Huang, W., Huang, X., Robu, V., Flynn, D.: Baylime: bayesian local interpretable model-agnostic explanations. In: Proceedings of 37th Conference on Uncertainty in Artificial Intelligence, 27\u201330 Jul, vol. 161, pp. 887\u2013896. PMLR (2021)"}],"container-title":["Lecture Notes in Computer Science","Bridging the Gap Between AI and Reality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-46002-9_15","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T22:10:00Z","timestamp":1730844600000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-46002-9_15"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,14]]},"ISBN":["9783031460012","9783031460029"],"references-count":46,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-46002-9_15","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,14]]},"assertion":[{"value":"14 December 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"AISoLA","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Bridging the Gap between AI and Reality","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Crete","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Greece","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2023","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"23 October 2023","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"28 October 2023","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"1","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"aisola2023","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/2023-aisola.isola-conference.org\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}