{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T18:18:33Z","timestamp":1788459513147,"version":"build-2803163510"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,7,24]],"date-time":"2024-07-24T00:00:00Z","timestamp":1721779200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,24]],"date-time":"2024-07-24T00:00:00Z","timestamp":1721779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["861211"],"award-info":[{"award-number":["861211"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Robot Syst"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Future autonomous Unmanned Aerial Vehicles (UAV) missions will take place in highly cluttered urban environments. As a result, the UAV must be able to autonomously evaluate risks and react to unforeseen hazards. The current regulatory framework for missions implements SORA guidelines for hazard detection, but its application to air-to-air collision is limited. This research defined a rigorous verification and validation framework (V&amp;V) for digital twins for use in future autonomous UAV missions. The researchers designed a sentry mission for a UAV to evaluate its capacity to detect small uncooperative flying objects. A digital twin of the DJI M300 vision system was built using a game engine and a V&amp;V framework was developed to assure the quality of results in both virtual and real-world scenarios. The results showed the capability of the digital twin to identify vulnerabilities and worst-case scenarios in UAV mission operations, and how it can assist remote pilots in identifying air-to-air collision hazards. Furthermore, the probability of air-to-air collision was calculated for three sentry patterns, and the results were validated in the field. This research demonstrated the capability to identify vulnerabilities and worst-case scenarios in UAV mission operations. We present how the digital twin of an operational theatre can be exploited to assist remote pilots with the identification of air-to-air collision hazards of small uncooperative objects. Furthermore, we discuss how these results can be used to enhance current SORA-based risk assessment practices.<\/jats:p>","DOI":"10.1007\/s10846-024-02136-w","type":"journal-article","created":{"date-parts":[[2024,7,24]],"date-time":"2024-07-24T14:03:11Z","timestamp":1721829791000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Verification and Validation for a Digital Twin for Augmenting Current SORA Practices with Air-to-Air Collision Hazards Prediction from Small Uncooperative Flying Objects"],"prefix":"10.1007","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5429-2449","authenticated-orcid":false,"given":"Santiago","family":"Matalonga","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8544-541X","authenticated-orcid":false,"given":"Julie","family":"Black","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6516-9446","authenticated-orcid":false,"given":"James","family":"Riordan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,7,24]]},"reference":[{"key":"2136_CR1","unstructured":"BIS Research: Global UAV market value in 2018 and 2029 (in billion U.S. dollars) [Graph] (2029). https:\/\/www.statista.com\/statistics\/1052890\/global-uav-market-value\/"},{"key":"2136_CR2","doi-asserted-by":"publisher","first-page":"115","DOI":"10.15826\/recon.2018.4.3.016","volume":"4","author":"H Kitonsa","year":"2018","unstructured":"Kitonsa, H., Kruglikov, S.V.: Significance of drone technology for achievement of the United Nations sustainable development goals. R-Economy. 4, 115\u2013120 (2018). https:\/\/doi.org\/10.15826\/recon.2018.4.3.016","journal-title":"R-Economy."},{"key":"2136_CR3","doi-asserted-by":"publisher","unstructured":"Hartman, J., Jueptner, E., Matalonga, S., Riordan, J., White, S.: Artificial intelligence, autonomous drones and legal uncertainties. Eur. J. Risk Regul. 1\u201318 (2022). https:\/\/doi.org\/10.1017\/err.2022.15","DOI":"10.1017\/err.2022.15"},{"key":"2136_CR4","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-022-01682-5","volume-title":"A review of the legal, regulatory and practical aspects needed to unlock autonomous beyond visual line of sight unmanned aircraft systems operations","author":"S Matalonga","year":"2022","unstructured":"Matalonga, S., White, S., Hartman, J., Riordan, J.: A review of the legal, regulatory and practical aspects needed to unlock autonomous beyond visual line of sight unmanned aircraft systems operations. In Press, Intelligent and Robotic Systems (2022)"},{"key":"2136_CR5","unstructured":"easa_artificia: Artificial Intelligence roadmap: a human-centric approach to AI in aviation (2020). https:\/\/www.easa.europa.eu\/document-library\/general-publications\/easa-artificial-intelligence-roadmap-10#group-easa-downloads"},{"key":"2136_CR6","unstructured":"DJI Enterprises: Matrice M300 downloads (2022). https:\/\/www.dji.com\/uk\/matrice-300\/downloads. Accessed 9 May 2022"},{"key":"2136_CR7","unstructured":"uk_caa_flying: Flying in the specific category (2020). https:\/\/www.caa.co.uk\/Commercial-industry\/Aircraft\/Unmanned-aircraft\/Small-drones\/Flying-in-the-specific-category\/. Accessed 6 May 2021"},{"key":"2136_CR8","unstructured":"JARUS WG: JARUS guidelines on Specific Operations Risk Assessment SORA, vol. 6 (2017). http:\/\/jarus-rpas.org\/sites\/jarus-rpas.org\/files\/jar_doc_06_jarus_sora_v2.0.pdf"},{"key":"2136_CR9","doi-asserted-by":"publisher","first-page":"3563","DOI":"10.1007\/s00170-017-0233-1","volume":"94","author":"F Tao","year":"2018","unstructured":"Tao, F., Cheng, J., Qi, Q., Zhang, M., Zhang, H., Sui, F.: Digital twin-driven product design, manufacturing and service with big data. Int J Adv Manufact Technol 94, 3563\u20133576 (2018). https:\/\/doi.org\/10.1007\/s00170-017-0233-1","journal-title":"Int J Adv Manufact Technol"},{"key":"2136_CR10","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1016\/j.jmsy.2020.06.017","volume":"58","author":"M Liu","year":"2021","unstructured":"Liu, M., Fang, S., Dong, H., Xu, C.: Review of digital twin about concepts, technologies, and industrial applications. J. Manuf. Syst. 58, 346\u2013361 (2021). https:\/\/doi.org\/10.1016\/j.jmsy.2020.06.017","journal-title":"J. Manuf. Syst."},{"key":"2136_CR11","doi-asserted-by":"crossref","unstructured":"Abdallah, A., Primas, M., Turcin, I., Traussnigg, U.: The potential of game development platforms for digital twins and virtual labs, pp. 117\u2013121 (2020). http:\/\/link.springer.com\/10.1007\/978-3-030-57997-5_14","DOI":"10.1007\/978-3-030-57997-5_14"},{"key":"2136_CR12","doi-asserted-by":"publisher","first-page":"101297","DOI":"10.1016\/j.aei.2021.101297","volume":"48","author":"CK Lo","year":"2021","unstructured":"Lo, C.K., Chen, C.H., Zhong, R.Y.: A review of digital twin in product design and development. Adv. Eng. Inform. 48, 101297 (2021). https:\/\/doi.org\/10.1016\/j.aei.2021.101297","journal-title":"Adv. Eng. Inform."},{"key":"2136_CR13","doi-asserted-by":"publisher","first-page":"1141","DOI":"10.1007\/s12652-018-0911-3","volume":"10","author":"Y Zheng","year":"2019","unstructured":"Zheng, Y., Yang, S., Cheng, H.: An application framework of digital twin and its case study, Journal of Ambient Intelligence and Humanized. Computing 10, 1141\u20131153 (2019). https:\/\/doi.org\/10.1007\/s12652-018-0911-3","journal-title":"Computing"},{"key":"2136_CR14","doi-asserted-by":"publisher","first-page":"103130","DOI":"10.1016\/j.compind.2019.103130","volume":"113","author":"C Cimino","year":"2019","unstructured":"Cimino, C., Negri, E., Fumagalli, L.: Review of digital twin applications in manufacturing. Comput. Ind. 113, 103130 (2019). https:\/\/doi.org\/10.1016\/j.compind.2019.103130","journal-title":"Comput. Ind."},{"key":"2136_CR15","doi-asserted-by":"publisher","unstructured":"Wang, Z., Gupta, R., Han, K., Wang, H., Ganlath, A., Ammar, N., Tiwari, P.: Mobility digital twin: concept, architecture, case study, and future challenges. IEEE Internet Things J. 9(18), 17452\u201317467 (2022). https:\/\/doi.org\/10.1109\/JIOT.2022.3156028","DOI":"10.1109\/JIOT.2022.3156028"},{"key":"2136_CR16","doi-asserted-by":"publisher","unstructured":"Ximing, C., Eunsuk, K., Shinichi, S., Preciado Victor, M., Zhihao, J.: Digital behavioral twins for safe connected cars. In: Proceedings of the 21st ACM\/IEEE international conference on model driven engineering languages and systems, pp. 144\u2013153, New York (2018). https:\/\/doi.org\/10.1145\/3239372.3239401","DOI":"10.1145\/3239372.3239401"},{"key":"2136_CR17","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1007\/s40860-018-0069-y","volume":"4","author":"SAP Kumar","year":"2018","unstructured":"Kumar, S.A.P., Madhumathi, R., Chelliah, P.R., Tao, L., Wang, S.: A novel digital twin-centric approach for driver intention prediction and traffic congestion avoidance, Journal of Reliable Intelligent. Environments 4, 199\u2013209 (2018). https:\/\/doi.org\/10.1007\/s40860-018-0069-y","journal-title":"Environments"},{"key":"2136_CR18","unstructured":"Lv, Z., Chen, D., Feng, H., Zhu, H., Lv, H.: Digital twins in unmanned aerial vehicles for rapid medical resource delivery in epidemics. IEEE Trans. Intell. Transp. Syst. 1\u20139 (2021). https:\/\/ieeexplore.ieee.org\/document\/9552619\/"},{"key":"2136_CR19","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1109\/MNET.011.2000388","volume":"35","author":"L Lei","year":"2021","unstructured":"Lei, L., Shen, G., Zhang, L., Li, Z.: Toward Intelligent Cooperation of UAV Swarms: When Machine Learning Meets Digital Twin. IEEE Network 35, 386\u2013392 (2021). https:\/\/doi.org\/10.1109\/MNET.011.2000388","journal-title":"IEEE Network"},{"key":"2136_CR20","doi-asserted-by":"crossref","unstructured":"Grigoropoulos, N., Lalis, S.: Simulation and digital twin support for managed drone applications. In: 2020 IEEE\/ACM 24th international symposium on distributed simulation and real time applications (DS-RT), pp. 1\u20138 (2020). https:\/\/ieeexplore.ieee.org\/document\/9213676\/","DOI":"10.1109\/DS-RT50469.2020.9213676"},{"key":"2136_CR21","unstructured":"EASA: EASA concept of operations for Drones (2015)"},{"key":"2136_CR22","unstructured":"easa_amc: AMC 20-115D airborne software development assurance using EUROCAE ED-12 and RTCA DO-178 (2017). https:\/\/www.easa.europa.eu\/document-library\/easy-access-rules\/online-publications\/easy-access-rules-acceptable-means?"},{"key":"2136_CR23","unstructured":"easa_design: Design verification of UAS operated in the \u2018specific\u2019 category and classified in SAIL III and IV (2021). https:\/\/skybrary.aero\/sites\/default\/files\/bookshelf\/6044.pdf"},{"key":"2136_CR24","unstructured":"Rodr\u00edguez, M., Piattini, M.: Experiencias en la industria del software: Certificaci\u00f3n del producto con ISO\/IEC 25000. In: CIBSE 2015 - XVIII Ibero-American Conference on Software Engineering (2015)"},{"key":"2136_CR25","unstructured":"Walter, B., Suchy, N.: Concept of use for the airborne collision avoidance system Xu for smaller UAS (ACAS sXu. 38) (2020)"},{"key":"2136_CR26","doi-asserted-by":"publisher","unstructured":"Fredericks, E.M., DeVries, B., Cheng, B.H.C.: Towards run-time adaptation of test cases for self-adaptive systems in the face of uncertainty. In: Proceedings of the 9th international symposium on software engineering for adaptive and self-managing systems - SEAMS, pp. 17\u201326. ACM Press, New York (2014). http:\/\/dl.acm.org\/citation.cfm?id=2593929.2593937, https:\/\/doi.org\/10.1145\/2593929.2593937","DOI":"10.1145\/2593929.2593937"},{"key":"2136_CR27","unstructured":"Matalonga, S., Rodrigues, F., Travassos, G.H.: Challenges in testing context aware software systems. In: Systematic and automated software testing. editor SBQS. Bello Horizonte (2015). http:\/\/cbsoft.org\/cbsoft2015\/sast"},{"key":"2136_CR28","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1145\/390016.808473","volume":"10","author":"JB Goodenough","year":"1975","unstructured":"Goodenough, J.B., Gerhart, S.L.: Toward a theory of test data selection. ACM SIGPLAN Notices. 10, 493\u2013510 (1975). https:\/\/doi.org\/10.1145\/390016.808473","journal-title":"ACM SIGPLAN Notices."},{"key":"2136_CR29","doi-asserted-by":"publisher","unstructured":"Wang, Y., Plataniotis, K.N., Kwong, S., Leung, H., Yanushkevich, S., Karray, F., Hou, M., Howard, N., Fiorini, R.A., Soda, P., Tunstel, E., Wang, J., Patel, S.: On autonomous systems: from reflexive, imperative and adaptive intelligence to autonomous and cognitive. Intelligence. 7\u201312 (2019). https:\/\/doi.org\/10.1109\/ICCICC46617.2019.9146038","DOI":"10.1109\/ICCICC46617.2019.9146038"},{"key":"2136_CR30","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/MC.2004.48","volume":"37","author":"PK McKinley","year":"2004","unstructured":"McKinley, P.K., Sadjadi, S.M., Kasten, E.P., Cheng, B.H.C.: Composing adaptive software. IEEE Comput. 37, 56\u201364 (2004). https:\/\/doi.org\/10.1109\/MC.2004.48","journal-title":"IEEE Comput."},{"key":"2136_CR31","doi-asserted-by":"crossref","unstructured":"Abowd, G.D., Dey, A.K., Brown, P.J., Davies, N., Smith, M., Steggles, P.: Towards a better understanding of context and context-awareness. In: Proceedings of the CHI 2000 workshop on the what, who, where, when and how of context awareness 4 (1999). http:\/\/link.springer.com\/10.1007\/3-540-48157-5_29","DOI":"10.1007\/3-540-48157-5_29"},{"key":"2136_CR32","doi-asserted-by":"publisher","unstructured":"Matalonga, S., Travassos, G.H.: Testing context-aware software systems: unchain the context, set it free! In: Proceedings of the 31st Brazilian symposium on software engineering, New York (2017). https:\/\/doi.org\/10.1145\/3131151.3131190","DOI":"10.1145\/3131151.3131190"},{"key":"2136_CR33","doi-asserted-by":"publisher","unstructured":"Chillarege, R., Bhandari, I.S., Chaar, J.K., Moebus, D.S., Ray, B.K.: Orthogonal defect classification - a concept for in-process measurements. IEEE Comput. 18(11), (1992). https:\/\/doi.org\/10.1109\/32.177364","DOI":"10.1109\/32.177364"},{"key":"2136_CR34","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1147\/sj.423.0462","volume":"42","author":"CF Kurtz","year":"2003","unstructured":"Kurtz, C.F., Snowden, D.J.: The new dynamics of strategy: Sense-making in a complex and complicated world. IBM Syst. J. 42, 462\u2013483 (2003). https:\/\/doi.org\/10.1147\/sj.423.0462","journal-title":"IBM Syst. J."},{"key":"2136_CR35","first-page":"19","volume":"26","author":"D Snowden","year":"2013","unstructured":"Snowden, D.: Cooks in a messy kitchen. Cutter IT J. 26, 19\u201322 (2013)","journal-title":"Cutter IT J."},{"key":"2136_CR36","unstructured":"Unity Technologies: About unity test framework (2022). https:\/\/docs.unity3d.com\/Packages\/com.unity.test-framework@1.1\/manual\/index.html.\u00a0 Accessed 9 May 2022"},{"key":"2136_CR37","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1109\/32.879815","volume":"26","author":"NE Fenton","year":"2000","unstructured":"Fenton, N.E., Ohlsson, N.: Quantitative analysis of faults and failures in a complex software system. IEEE Trans. Software Eng. 26, 797\u2013814 (2000). https:\/\/doi.org\/10.1109\/32.879815","journal-title":"IEEE Trans. Software Eng."},{"key":"2136_CR38","unstructured":"Ishikawa, K.: Guide to quality control. Asian Productivity Organization, Tokyo (1986)"},{"key":"2136_CR39","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1093\/carcin\/bgs084","volume":"206","author":"E Gamma","year":"1995","unstructured":"Gamma, E., Helm, R., Johnson, R.E., Vlissides, J.: Design patterns: elements of reusable object-oriented software. Design. 206, 395 (1995). https:\/\/doi.org\/10.1093\/carcin\/bgs084","journal-title":"Design."},{"key":"2136_CR40","unstructured":"Creswell, J.W.: Research design: Qualitative, quantitative, and mixed methods approaches. Sage (2013)"},{"key":"2136_CR41","doi-asserted-by":"publisher","unstructured":"James, R., Manduhu, M., Julie, B., Alexander, D., Dooly, G., Santiago, M.: LiDAR simulation for performance evaluation of drone detect and avoid. Unmanned Aircraft Systems (ICUAS), Piscataway, NJ (2021). https:\/\/doi.org\/10.1109\/ICUAS51884.2021.9476817","DOI":"10.1109\/ICUAS51884.2021.9476817"},{"key":"2136_CR42","unstructured":"ISO\/TC 20\/SC 14: Space systems - definition of the technology readiness levels (TRLs) and their criteria of assessment, vol. 49, p. 140. ICS (2013)"},{"key":"2136_CR43","unstructured":"UK CAA: CAP 382 - guidance on mandatory occurrence reports (MORS) and voluntary occurrence report (VORs) (2018)"}],"container-title":["Journal of Intelligent &amp; Robotic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-024-02136-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10846-024-02136-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-024-02136-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T13:12:31Z","timestamp":1727356351000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10846-024-02136-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,24]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["2136"],"URL":"https:\/\/doi.org\/10.1007\/s10846-024-02136-w","relation":{},"ISSN":["1573-0409"],"issn-type":[{"value":"1573-0409","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,24]]},"assertion":[{"value":"3 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 June 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interest"}},{"value":"Not applicable to the research described in this manuscript.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"Not applicable to the research described in this manuscript. No human participants were involved in the research described in this manuscript.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"Not applicable to the research described in this manuscript. No human participants were involved in the research described in this manuscript.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Publish"}}],"article-number":"109"}}