{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T19:31:34Z","timestamp":1765827094500,"version":"3.41.0"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2013,7,1]],"date-time":"2013-07-01T00:00:00Z","timestamp":1372636800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2013,7]]},"abstract":"<jats:p>A complete and detailed (full) Design Rationale Documentation (DRD) could support many software development activities, such as an impact analysis or a major redesign. However, this is typically too onerous for systematic industrial use as it is not cost effective to write, maintain, or read. The key idea investigated in this article is that DRD should be developed only to the extent required to support activities particularly difficult to execute or in need of significant improvement in a particular context. The aim of this article is to empirically investigate the customization of the DRD by documenting only the information items that will probably be required for executing an activity. This customization strategy relies on the hypothesis that the value of a specific DRD information item depends on its category (e.g., assumptions, related requirements, etc.) and on the activity it is meant to support. We investigate this hypothesis through two controlled experiments involving a total of 75 master students as experimental subjects. Results show that the value of a DRD information item significantly depends on its category and, within a given category, on the activity it supports. Furthermore, on average among activities, documenting only the information items that have been required at least half of the time (i.e., the information that will probably be required in the future) leads to a customized DRD containing about half the information items of a full documentation. We expect that such a significant reduction in DRD information should mitigate the effects of some inhibitors that currently prevent practitioners from documenting design decision rationale.<\/jats:p>","DOI":"10.1145\/2491509.2491515","type":"journal-article","created":{"date-parts":[[2013,7,30]],"date-time":"2013-07-30T13:35:22Z","timestamp":1375191322000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":38,"title":["The value of design rationale information"],"prefix":"10.1145","volume":"22","author":[{"given":"Davide","family":"Falessi","sequence":"first","affiliation":[{"name":"University of Rome Tor Vergata and Simula Research Laboratory, Norway"}]},{"given":"Lionel C.","family":"Briand","sequence":"additional","affiliation":[{"name":"University of Luxembourg"}]},{"given":"Giovanni","family":"Cantone","sequence":"additional","affiliation":[{"name":"University of Rome Tor Vergata, Italy"}]},{"given":"Rafael","family":"Capilla","sequence":"additional","affiliation":[{"name":"Rey Juan Carlos University, Sapin"}]},{"given":"Philippe","family":"Kruchten","sequence":"additional","affiliation":[{"name":"University of British Columbia, Canada"}]}],"member":"320","published-online":{"date-parts":[[2013,7,30]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Ambler S. W. 2007. The tagri (they aren't gonna read it) principle of software development. http:\/\/www.agilemodeling.com\/essays\/tagri.htm.  Ambler S. W. 2007. The tagri (they aren't gonna read it) principle of software development. http:\/\/www.agilemodeling.com\/essays\/tagri.htm."},{"key":"e_1_2_1_2_1","volume-title":"Agile Modeling: Effective Practices for Extreme Programming and the Unified Process","author":"Ambler S. W.","year":"2002","unstructured":"Ambler , S. W. and Jeffries , R . 2002 . Agile Modeling: Effective Practices for Extreme Programming and the Unified Process . Wiley . Ambler, S. W. and Jeffries, R. 2002. Agile Modeling: Effective Practices for Extreme Programming and the Unified Process. Wiley."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/RE.2006.63"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1049\/sej.1991.0032"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.799939"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Biffl S. Aurum A. Bohem B. Erdogmus H. and Gr\u00fcnbacher P. 2005. Value-Based Software Engineering. Springer.   Biffl S. Aurum A. Bohem B. Erdogmus H. and Gr\u00fcnbacher P. 2005. Value-Based Software Engineering. Springer.","DOI":"10.1007\/3-540-29263-2"},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Biffl S. Aurum A. Bohem B. Erdogmus H. and Gr\u00fcnbacher P. 2006. Value-Based Software Engineering. Springer.   Biffl S. Aurum A. Bohem B. Erdogmus H. and Gr\u00fcnbacher P. 2006. Value-Based Software Engineering. Springer.","DOI":"10.1007\/3-540-29263-2"},{"key":"e_1_2_1_8_1","unstructured":"Boehm B. Rombach D. and Zelkowitz M. 2010. Foundations of Empirical Software Engineering: The Legacy of Victor R. Basili. Springer.   Boehm B. Rombach D. and Zelkowitz M. 2010. Foundations of Empirical Software Engineering: The Legacy of Victor R. Basili. Springer."},{"volume-title":"Software Engineering Economics","author":"Boehm B. W.","key":"e_1_2_1_9_1","unstructured":"Boehm , B. W. 1981. Software Engineering Economics . Prentice Hall PTR. Boehm, B. W. 1981. Software Engineering Economics. Prentice Hall PTR."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/336512.336584"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24769-2_14"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/646970.713240"},{"key":"e_1_2_1_13_1","unstructured":"Burge J. and Brown D. 1998. Design rationale types and tools ai in design group. http:\/\/web.cs.wpi.edu\/Research\/aidg\/DR-Rpt98.html.  Burge J. and Brown D. 1998. Design rationale types and tools ai in design group. http:\/\/web.cs.wpi.edu\/Research\/aidg\/DR-Rpt98.html."},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Burge J. E. Carroll J. M. Mccall R. and Mistrk I. 2008. Rationale-Based Software Engineering. Springer.   Burge J. E. Carroll J. M. Mccall R. and Mistrk I. 2008. Rationale-Based Software Engineering. Springer.","DOI":"10.1007\/978-3-540-77583-6"},{"key":"e_1_2_1_15_1","volume-title":"ESERNET: Empirical Methods and Studies on Software Engineering.","author":"Cantone G.","year":"2003","unstructured":"Cantone , G. , Colasanti , L. , Abdulnabi , Z. , Lomartire , A. , and Calavaro , G . 2003 . Evaluating checklist-based and use-case-driven reading techniques as applied to software analysis and design uml artifacts. In Experiences from ESERNET: Empirical Methods and Studies on Software Engineering. Cantone, G., Colasanti, L., Abdulnabi, Z., Lomartire, A., and Calavaro, G. 2003. Evaluating checklist-based and use-case-driven reading techniques as applied to software analysis and design uml artifacts. In Experiences from ESERNET: Empirical Methods and Studies on Software Engineering."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/1260984.1261232"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2008.31"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2006.57"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/RE.2006.57"},{"key":"e_1_2_1_20_1","unstructured":"Clements P. Mcgregor J. D. and Cohen S. G. 2005. The structured intuitive model for product line economics (simple). Tech. rep. CMU\/SEI-2005-TR-003 Carnegie Mellon University.  Clements P. Mcgregor J. D. and Cohen S. G. 2005. The structured intuitive model for product line economics (simple). Tech. rep. CMU\/SEI-2005-TR-003 Carnegie Mellon University."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/62266.62278"},{"volume-title":"The Concise Guide to Economics","author":"Cox J.","key":"e_1_2_1_22_1","unstructured":"Cox , J. 1997. The Concise Guide to Economics . Laissez Faire Books . Cox, J. 1997. The Concise Guide to Economics. Laissez Faire Books."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1370062.1370080"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.15"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101908.1101970"},{"volume-title":"Proceedings of the 15th IEEE International Requirements Engineering Conference (RE'07)","author":"Egyed A.","key":"e_1_2_1_26_1","unstructured":"Egyed , A. , Grunbacher , P. , Heindl , M. , and Biffl , S . 2007. Value-based requirements traceability: Lessons learned . In Proceedings of the 15th IEEE International Requirements Engineering Conference (RE'07) . Egyed, A., Grunbacher, P., Heindl, M., and Biffl, S. 2007. Value-based requirements traceability: Lessons learned. In Proceedings of the 15th IEEE International Requirements Engineering Conference (RE'07)."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-009-9121-0"},{"key":"e_1_2_1_28_1","unstructured":"Falessi D. and Cantone G. 2006. Exploring feasibility of software defects orthogonal classification. In Software and Data Technologies Springer.  Falessi D. and Cantone G. 2006. Exploring feasibility of software defects orthogonal classification. In Software and Data Technologies Springer."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1159733.1159755"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.122"},{"volume-title":"Proceedings of the International Conference on Software and Data Technologies.","author":"Falessi D.","key":"e_1_2_1_31_1","unstructured":"Falessi , D. , Cantone , G. , and Grande , C . 2007. A comparison of structured analysis and object oriented analysis: An experimental study . In Proceedings of the International Conference on Software and Data Technologies. Falessi, D., Cantone, G., and Grande, C. 2007. A comparison of structured analysis and object oriented analysis: An experimental study. In Proceedings of the International Conference on Software and Data Technologies."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978802.1978812"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2010.49"},{"volume-title":"What architects do and what they need to share knowledge. Tech. rep. IR-IMSE-003","author":"Farenhorst R.","key":"e_1_2_1_34_1","unstructured":"Farenhorst , R. , Hoorn , J. F. , Lago , P. , and Van Vliet , H. 2009. What architects do and what they need to share knowledge. Tech. rep. IR-IMSE-003 , VU University Amsterdam . Farenhorst, R., Hoorn, J. F., Lago, P., and Van Vliet, H. 2009. What architects do and what they need to share knowledge. Tech. rep. IR-IMSE-003, VU University Amsterdam."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/590631.590643"},{"key":"e_1_2_1_36_1","unstructured":"Fowler M. 2005. The new methodology. http:\/\/martinfowler.com\/articles\/newMethodology.html.  Fowler M. 2005. The new methodology. http:\/\/martinfowler.com\/articles\/newMethodology.html."},{"volume-title":"Essential Software Architecture","author":"Gorton I.","key":"e_1_2_1_37_1","unstructured":"Gorton , I. 2006. Essential Software Architecture . Springer . Gorton, I. 2006. Essential Software Architecture. Springer."},{"volume-title":"Correspondence Analysis in Practice","author":"Greenacre M.","key":"e_1_2_1_38_1","unstructured":"Greenacre , M. 2007. Correspondence Analysis in Practice . Chapman and Hall\/CRC. Greenacre, M. 2007. Correspondence Analysis in Practice. Chapman and Hall\/CRC."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.13"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1081706.1081717"},{"volume-title":"Proceedings of the Empirical Studies of Programmers, 2nd Workshop. Ablex Publishing.","author":"Holt R.","key":"e_1_2_1_41_1","unstructured":"Holt , R. , Boehm-Davis , D. , and Shultz , A . 1987. Mental representations of programs for student and professional programmers . In Proceedings of the Empirical Studies of Programmers, 2nd Workshop. Ablex Publishing. Holt, R., Boehm-Davis, D., and Shultz, A. 1987. Mental representations of programs for student and professional programmers. In Proceedings of the Empirical Studies of Programmers, 2nd Workshop. Ablex Publishing."},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Hosmer D. and Lemeshow S. 2000. Applied Logistic Regression. Wiley-Interscience.  Hosmer D. and Lemeshow S. 2000. Applied Logistic Regression. Wiley-Interscience.","DOI":"10.1002\/0471722146"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026586415054"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/WICSA.2005.61"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2007.08.025"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Jedlitschka A. Ciolkowski M. and Pfahl D. 2008. Reporting experiments in software engineering. In Guide to Advanced Empirical Software Engineering Springer.  Jedlitschka A. Ciolkowski M. and Pfahl D. 2008. Reporting experiments in software engineering. In Guide to Advanced Empirical Software Engineering Springer.","DOI":"10.1007\/978-1-84800-044-5_8"},{"volume-title":"Proceedings of the 10th International Software Product Line Conference.","author":"John I.","key":"e_1_2_1_47_1","unstructured":"John , I. , Knodel , J. , Lehner , T. , and Muthig , D . 2006. A practical guide to product line scoping . In Proceedings of the 10th International Software Product Line Conference. John, I., Knodel, J., Lehner, T., and Muthig, D. 2006. A practical guide to product line scoping. In Proceedings of the 10th International Software Product Line Conference."},{"key":"e_1_2_1_48_1","unstructured":"Juristo N. and Moreno A. M. 2006. Basics of Software Engineering Experimentation. Springer.   Juristo N. and Moreno A. M. 2006. Basics of Software Engineering Experimentation. Springer."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/238386.238462"},{"key":"e_1_2_1_50_1","volume-title":"The Rational Unified Process: An Introduction","author":"Kruchten P.","unstructured":"Kruchten , P. 2003. The Rational Unified Process: An Introduction 3 rd Ed. Addison-Wesley Professional . Kruchten, P. 2003. The Rational Unified Process: An Introduction 3rd Ed. Addison-Wesley Professional.","edition":"3"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2009.52"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/11921998_8"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/WICSA.2008.25"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/64.592267"},{"volume-title":"Proceedings of the Canadian Conference on Electrical and Computer Engineering (CCECE'07)","author":"Lee L.","key":"e_1_2_1_55_1","unstructured":"Lee , L. and Kruchten , P . 2007. Capturing software architectural design decisions . In Proceedings of the Canadian Conference on Electrical and Computer Engineering (CCECE'07) . Lee, L. and Kruchten, P. 2007. Capturing software architectural design decisions. In Proceedings of the Canadian Conference on Electrical and Computer Engineering (CCECE'07)."},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Maclean A. Young R. M. Bellotti V. M. E. and Moran T. P. 1996. Questions options and criteria: Elements of design space analysis. In Design Rationale: Concepts Techniques and Use. Lawrence Erlbaum Associates 53--105.   Maclean A. Young R. M. Bellotti V. M. E. and Moran T. P. 1996. Questions options and criteria: Elements of design space analysis. In Design Rationale: Concepts Techniques and Use. Lawrence Erlbaum Associates 53--105.","DOI":"10.1201\/9781003064053-4"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134293"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.5555\/1032663.1034391"},{"volume-title":"The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies","author":"Ragin C. C.","key":"e_1_2_1_59_1","unstructured":"Ragin , C. C. 1989. The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies . University of California Press. Ragin, C. C. 1989. The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies. University of California Press."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-008-9060-1"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2006.33"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1994.1029"},{"volume-title":"Proceedings of the International Symposium on Empirical Software Engineering. IEEE Computer Society.","author":"Sj\u00f8berg D.","key":"e_1_2_1_63_1","unstructured":"Sj\u00f8berg , D. , Anda , B. , Arisholm , E. , Tore , D. , J\u00f8rgensen , M. , Karahasanovic , A. , Koren , E. , and Marek , V . 2002. Conducting realistic experiments in software engineering . In Proceedings of the International Symposium on Empirical Software Engineering. IEEE Computer Society. Sj\u00f8berg, D., Anda, B., Arisholm, E., Tore, D., J\u00f8rgensen, M., Karahasanovic, A., Koren, E., and Marek, V. 2002. Conducting realistic experiments in software engineering. In Proceedings of the International Symposium on Empirical Software Engineering. IEEE Computer Society."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/602461.602493"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1414004.1414055"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1988676.1988678"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2006.04.029"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2005.27"},{"volume-title":"Proceedings of the 2nd International Conference on the Quality of Software Architectures.","author":"Van Der Ven J. S.","key":"e_1_2_1_69_1","unstructured":"Van Der Ven , J. S. , Jansen , A. , Avgeriou , P. , and Hammer , D. K . 2006. Using architectural decisions . In Proceedings of the 2nd International Conference on the Quality of Software Architectures. Van Der Ven, J. S., Jansen, A., Avgeriou, P., and Hammer, D. K. 2006. Using architectural decisions. In Proceedings of the 2nd International Conference on the Quality of Software Architectures."},{"key":"e_1_2_1_70_1","volume-title":"Software Engineering: An Introduction","author":"Wohlin C.","year":"2000","unstructured":"Wohlin , C. , Runeson , P. , H\u00f6st , M. , Ohlsson , M. C. , Regnell , B. , and Wesslen , A . 2000 . Experimentation in Software Engineering: An Introduction , Springer . Wohlin, C., Runeson, P., H\u00f6st, M., Ohlsson, M. C., Regnell, B., and Wesslen, A. 2000. Experimentation in Software Engineering: An Introduction, Springer."},{"key":"e_1_2_1_71_1","volume-title":"Proceedings of the 3rd Quality of Software Architectures International Conference on Software Architectures, Components, and Applications (QoSA'07)","volume":"4880","author":"Zimmermann O.","unstructured":"Zimmermann , O. , Gschwind , T. , K\u00fcster , J. , Leymann , F. , and Schuster , N . 2007. Reusable architectural decision models for enterprise application development . In Proceedings of the 3rd Quality of Software Architectures International Conference on Software Architectures, Components, and Applications (QoSA'07) . Lecture Notes in Computer Science , vol. 4880 . Springer, 15--32. Zimmermann, O., Gschwind, T., K\u00fcster, J., Leymann, F., and Schuster, N. 2007. Reusable architectural decision models for enterprise application development. In Proceedings of the 3rd Quality of Software Architectures International Conference on Software Architectures, Components, and Applications (QoSA'07). Lecture Notes in Computer Science, vol. 4880. Springer, 15--32."}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2491509.2491515","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2491509.2491515","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:28:50Z","timestamp":1750231730000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2491509.2491515"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,7]]},"references-count":71,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2013,7]]}},"alternative-id":["10.1145\/2491509.2491515"],"URL":"https:\/\/doi.org\/10.1145\/2491509.2491515","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"type":"print","value":"1049-331X"},{"type":"electronic","value":"1557-7392"}],"subject":[],"published":{"date-parts":[[2013,7]]},"assertion":[{"value":"2011-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}