{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T01:34:21Z","timestamp":1789608861523,"version":"build-2803163510"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2019,9,13]],"date-time":"2019-09-13T00:00:00Z","timestamp":1568332800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"General Motors and NSERC Canada"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2020,9,30]]},"abstract":"<jats:p>Systems deployed in regulated safety-critical domains (e.g., the medical, nuclear, and automotive domains) are often required to undergo a stringent safety assessment procedure, as prescribed by a certification body, to demonstrate their compliance to one or more certification standards. Assurance cases are an emerging way of communicating safety, security, and dependability, as well as other properties of safety-critical systems in a structured and comprehensive manner. The significant size and complexity of these documents, however, makes the process of evaluating and assessing their validity a non-trivial task and an active area of research. Due to this, efforts have been made to develop and utilize software tools for the purpose of aiding developers and third party assessors in the act of assessing and analyzing assurance cases. This article presents a survey of the various assurance case assessment features contained in 10 assurance case software tools, all of which identified and selected by us via a previously conducted systematic literature review. We describe the various assessment techniques implemented, discuss their strengths and weaknesses, and identify possible areas in need of further research.<\/jats:p>","DOI":"10.1145\/3342481","type":"journal-article","created":{"date-parts":[[2019,9,13]],"date-time":"2019-09-13T12:28:56Z","timestamp":1568377736000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["A Survey of Tool-supported Assurance Case Assessment Techniques"],"prefix":"10.1145","volume":"52","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8145-9486","authenticated-orcid":false,"given":"Mike","family":"Maksimov","sequence":"first","affiliation":[{"name":"University of Toronto, Toronto, ON , Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sahar","family":"Kokaly","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, ON , Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marsha","family":"Chechik","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, ON , Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,9,13]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"{n.d.}. Agda wiki page. http:\/\/wiki.portal.chalmers.se\/agda\/pmwiki.php.  {n.d.}. Agda wiki page. http:\/\/wiki.portal.chalmers.se\/agda\/pmwiki.php."},{"key":"e_1_2_1_2_1","unstructured":"2008. AFI RVSM PRE-IMPLEMENTATION SAFETY CASE. Retrieved from: https:\/\/www.icao.int\/ESAF\/Documents\/RVSM\/AFI_RVSM_PISC_Core_Document_FEB2008.pdf.  2008. AFI RVSM PRE-IMPLEMENTATION SAFETY CASE. Retrieved from: https:\/\/www.icao.int\/ESAF\/Documents\/RVSM\/AFI_RVSM_PISC_Core_Document_FEB2008.pdf."},{"key":"e_1_2_1_3_1","unstructured":"2010. AFI RVSM Post-Implementation Safety Case. Retrieved from: goo.gl\/wD64FT.  2010. AFI RVSM Post-Implementation Safety Case. Retrieved from: goo.gl\/wD64FT."},{"key":"e_1_2_1_4_1","unstructured":"2011. Preliminary Safety Case for an ADS-B Airport Surface Surveillance Application. Retrieved from: goo.gl\/2VMJzu.  2011. Preliminary Safety Case for an ADS-B Airport Surface Surveillance Application. Retrieved from: goo.gl\/2VMJzu."},{"key":"e_1_2_1_5_1","unstructured":"RTCA\/DO-178C: Software Considerations in Airborne Systems and Equipment Certification (RTCA'11). Retrieved from: https:\/\/my.rtca.org\/NC__Product?id&equals;a1B36000001IcmqEAC.  RTCA\/DO-178C: Software Considerations in Airborne Systems and Equipment Certification (RTCA'11). Retrieved from: https:\/\/my.rtca.org\/NC__Product?id&equals;a1B36000001IcmqEAC."},{"key":"e_1_2_1_6_1","unstructured":"2015. Generic Infusion Pump Research Project. Retrieved from: https:\/\/rtg.cis.upenn.edu\/gip\/.  2015. Generic Infusion Pump Research Project. Retrieved from: https:\/\/rtg.cis.upenn.edu\/gip\/."},{"key":"e_1_2_1_7_1","unstructured":"2018. Goal Structuring Notation Working Group \u201cGSN Community Standard Version 2.\u201d Retrieved from: http:\/\/www.goalstructuringnotation.info\/.  2018. Goal Structuring Notation Working Group \u201cGSN Community Standard Version 2.\u201d Retrieved from: http:\/\/www.goalstructuringnotation.info\/."},{"key":"e_1_2_1_8_1","unstructured":"2018. Object Management Group: Structured Assurance Case Metamodel (SACM) version 2.1. Retrieved from: https:\/\/www.omg.org\/spec\/SACM\/About-SACM\/.  2018. Object Management Group: Structured Assurance Case Metamodel (SACM) version 2.1. Retrieved from: https:\/\/www.omg.org\/spec\/SACM\/About-SACM\/."},{"key":"e_1_2_1_9_1","unstructured":"University of California. Automated Reasoning Group. {n.d.}. Sensitivity Analysis and Inference engine: SamIam. Retrieved from: http:\/\/reasoning.cs.ucla.edu\/samiam\/.  University of California. Automated Reasoning Group. {n.d.}. Sensitivity Analysis and Inference engine: SamIam. Retrieved from: http:\/\/reasoning.cs.ucla.edu\/samiam\/."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84996-086-1_4"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2010.06.027"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2553032"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the International Working Conference on Requirements Engineering: Foundation for Software Quality. Springer, 124--131","author":"Jose","unstructured":"Jose Luis de la Vara, Gabriel Jim\u00e9nez, Roy Mendieta, and Eugenio Parra. 2019. Assessment of the quality of safety cases: A research preview . In Proceedings of the International Working Conference on Requirements Engineering: Foundation for Software Quality. Springer, 124--131 . Jose Luis de la Vara, Gabriel Jim\u00e9nez, Roy Mendieta, and Eugenio Parra. 2019. Assessment of the quality of safety cases: A research preview. In Proceedings of the International Working Conference on Requirements Engineering: Foundation for Software Quality. Springer, 124--131."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177698950"},{"key":"e_1_2_1_15_1","volume-title":"Software Engineering in Health Care","author":"Duan Lian","unstructured":"Lian Duan , Sanjai Rayadurgam , Mats P. E. Heimdahl , Anaheed Ayoub , Oleg Sokolsky , and Insup Lee . 2017. Reasoning about confidence and uncertainty in assurance cases: A survey . In Software Engineering in Health Care . Springer International Publishing , 64--80. Lian Duan, Sanjai Rayadurgam, Mats P. E. Heimdahl, Anaheed Ayoub, Oleg Sokolsky, and Insup Lee. 2017. Reasoning about confidence and uncertainty in assurance cases: A survey. In Software Engineering in Health Care. Springer International Publishing, 64--80."},{"key":"e_1_2_1_16_1","volume-title":"ISO 26262: Road Vehicles\u2014Functional Safety","author":"International Organization for Standardization. {n.d.}.","year":"2011","unstructured":"International Organization for Standardization. {n.d.}. ISO 26262: Road Vehicles\u2014Functional Safety ( 2011 ), 1st version. Retrieved from https:\/\/www.iso.org\/standard\/43464.html. International Organization for Standardization. {n.d.}. ISO 26262: Road Vehicles\u2014Functional Safety (2011), 1st version. Retrieved from https:\/\/www.iso.org\/standard\/43464.html."},{"key":"e_1_2_1_17_1","unstructured":"Goal Structuring Notation Working Group \u201cGSN Community Standard Version 2\u201d. 2018. Creative Commons Attribution 4.0 International License. Retrieved from: http:\/\/creativecommons.org\/licenses\/by\/4.0\/. http:\/\/www.goalstructuringnotation.info\/.  Goal Structuring Notation Working Group \u201cGSN Community Standard Version 2\u201d. 2018. Creative Commons Attribution 4.0 International License. Retrieved from: http:\/\/creativecommons.org\/licenses\/by\/4.0\/. http:\/\/www.goalstructuringnotation.info\/."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33675-1_39"},{"key":"e_1_2_1_19_1","volume-title":"Bayesian Networks and Decision Graphs","author":"Jensen Finn V.","unstructured":"Finn V. Jensen . 2001. Bayesian Networks and Decision Graphs . Springer-Verlag . Finn V. Jensen. 2001. Bayesian Networks and Decision Graphs. Springer-Verlag."},{"key":"e_1_2_1_20_1","volume-title":"Weaver","author":"Rangarajan Murali","year":"2015","unstructured":"Murali Rangarajan , John Rushby , Xidong Xu , and Thomas L . Weaver . 2015 . Understanding and Evaluating Assurance Cases. Technical Report. NASA. https:\/\/ntrs.nasa.gov\/search.jsp?R&equals;20160000772. Murali Rangarajan, John Rushby, Xidong Xu, and Thomas L. Weaver. 2015. Understanding and Evaluating Assurance Cases. Technical Report. NASA. https:\/\/ntrs.nasa.gov\/search.jsp?R&equals;20160000772."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 6th International Conference of Information Fusion","volume":"1","author":"Josang A.","unstructured":"A. Josang and T. Grandison . 2003. Conditional inference in subjective logic . In Proceedings of the 6th International Conference of Information Fusion , Vol. 1 . 471--478. A. Josang and T. Grandison. 2003. Conditional inference in subjective logic. In Proceedings of the 6th International Conference of Information Fusion, Vol. 1. 471--478."},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the IEEE Colloquium on Understanding Patterns and Their Application to Systems Engineering (Digest No. 1998\/308)","author":"Kelly T.","unstructured":"T. Kelly and J. McDermid . 1998. Safety case patterns\u2014Reusing successful arguments . In Proceedings of the IEEE Colloquium on Understanding Patterns and Their Application to Systems Engineering (Digest No. 1998\/308) . 3\/1--3\/9. T. Kelly and J. McDermid. 1998. Safety case patterns\u2014Reusing successful arguments. In Proceedings of the IEEE Colloquium on Understanding Patterns and Their Application to Systems Engineering (Digest No. 1998\/308). 3\/1--3\/9."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 1st International Workshop on Assurance Cases for Software-Intensive Systems (ASSURE\u201913)","author":"Langari Z.","unstructured":"Z. Langari and T. Maibaum . 2013. Safety cases: A review of challenges . In Proceedings of the 1st International Workshop on Assurance Cases for Software-Intensive Systems (ASSURE\u201913) . 1--6. Z. Langari and T. Maibaum. 2013. Safety cases: A review of challenges. In Proceedings of the 1st International Workshop on Assurance Cases for Software-Intensive Systems (ASSURE\u201913). 1--6."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84882-349-5_12"},{"key":"e_1_2_1_25_1","volume-title":"Structured Safety Case Tools for Nuclear Facility Automation. Master\u2019s thesis","author":"Linnosmaa Joonas","unstructured":"Joonas Linnosmaa . 2016. Structured Safety Case Tools for Nuclear Facility Automation. Master\u2019s thesis . Tampere University of Technology , Finland . Joonas Linnosmaa. 2016. Structured Safety Case Tools for Nuclear Facility Automation. Master\u2019s thesis. Tampere University of Technology, Finland."},{"key":"e_1_2_1_26_1","unstructured":"Kestrel Technology LLC. 2011. CertWare website. Retrieved from: https:\/\/nasa.github.io\/CertWare\/index.html.  Kestrel Technology LLC. 2011. CertWare website. Retrieved from: https:\/\/nasa.github.io\/CertWare\/index.html."},{"key":"e_1_2_1_27_1","volume-title":"Foundations of Logic Programming","author":"Lloyd J. W.","unstructured":"J. W. Lloyd . 1984. Foundations of Logic Programming . Springer-Verlag , Berlin . J. W. Lloyd. 1984. Foundations of Logic Programming. Springer-Verlag, Berlin."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2017.04.001"},{"key":"e_1_2_1_29_1","volume-title":"Computer Safety, Reliability, and Security","author":"Maksimov Mike","unstructured":"Mike Maksimov , Nick L. S. Fung , Sahar Kokaly , and Marsha Chechik . 2018. Two decades of assurance case tools: A survey . In Computer Safety, Reliability, and Security . Springer International Publishing , 49--59. Mike Maksimov, Nick L. S. Fung, Sahar Kokaly, and Marsha Chechik. 2018. Two decades of assurance case tools: A survey. In Computer Safety, Reliability, and Security. Springer International Publishing, 49--59."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSN.2014.97"},{"key":"e_1_2_1_31_1","volume-title":"Design and implementation of GSN patterns: A step toward assurance case language. IPSJ Online Trans. 7 (01","author":"Matsuno Yutaka","year":"2014","unstructured":"Yutaka Matsuno . 2014. Design and implementation of GSN patterns: A step toward assurance case language. IPSJ Online Trans. 7 (01 2014 ), 59--68. Yutaka Matsuno. 2014. Design and implementation of GSN patterns: A step toward assurance case language. IPSJ Online Trans. 7 (01 2014), 59--68."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/QSIC.2011.35"},{"key":"e_1_2_1_33_1","volume-title":"Types and Programming Languages","author":"Pierce Benjamin C.","unstructured":"Benjamin C. Pierce . 2002. Types and Programming Languages ( 1 st ed.). The MIT Press . Benjamin C. Pierce. 2002. Types and Programming Languages (1st ed.). The MIT Press.","edition":"1"},{"key":"e_1_2_1_35_1","volume-title":"The Foundations of Statistics","author":"Savage Leonard J.","unstructured":"Leonard J. Savage . 1954. The Foundations of Statistics . Wiley Publications in Statistics. Leonard J. Savage. 1954. The Foundations of Statistics. Wiley Publications in Statistics."},{"key":"e_1_2_1_36_1","volume-title":"A Mathematical Theory of Evidence","author":"Shafer Glenn","unstructured":"Glenn Shafer . 1976. A Mathematical Theory of Evidence . Princeton University Press . Glenn Shafer. 1976. A Mathematical Theory of Evidence. Princeton University Press."},{"key":"e_1_2_1_37_1","volume-title":"Software Engineering Institute","author":"Carnegie Mellon University","year":"2011","unstructured":"Carnegie Mellon University . Software Engineering Institute . 2011 . OSATE. Retrieved from: http:\/\/www.aadl.info\/aadl\/currentsite\/tool\/osate.html. Carnegie Mellon University. Software Engineering Institute. 2011. OSATE. Retrieved from: http:\/\/www.aadl.info\/aadl\/currentsite\/tool\/osate.html."},{"key":"e_1_2_1_38_1","unstructured":"Makato Takeyama. 2011. A brief introduction to D-Case\/Agda *(draft ver. 0.2). Retrieved from: http:\/\/wiki.portal.chalmers.se\/agda\/uploads\/D-Case-Agda.D-Case-Agda\/D-Case-Agda-HomePage-Data.html.  Makato Takeyama. 2011. A brief introduction to D-Case\/Agda *(draft ver. 0.2). Retrieved from: http:\/\/wiki.portal.chalmers.se\/agda\/uploads\/D-Case-Agda.D-Case-Agda\/D-Case-Agda-HomePage-Data.html."},{"key":"e_1_2_1_39_1","volume-title":"The Uses of Argument","author":"Toulmin Stephen E.","unstructured":"Stephen E. Toulmin . 1958. The Uses of Argument . Cambridge University Press . Stephen E. Toulmin. 1958. The Uses of Argument. Cambridge University Press."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2002.802746"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2010.12.010"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3342481","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3342481","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:00Z","timestamp":1750202580000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3342481"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,13]]},"references-count":40,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2020,9,30]]}},"alternative-id":["10.1145\/3342481"],"URL":"https:\/\/doi.org\/10.1145\/3342481","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,13]]},"assertion":[{"value":"2019-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-09-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}