{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T15:46:27Z","timestamp":1762271187052},"publisher-location":"London","reference-count":28,"publisher":"Springer London","isbn-type":[{"type":"print","value":"9781848000438"},{"type":"electronic","value":"9781848000445"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2008]]},"DOI":"10.1007\/978-1-84800-044-5_13","type":"book-chapter","created":{"date-parts":[[2007,11,21]],"date-time":"2007-11-21T01:18:55Z","timestamp":1195607935000},"page":"337-364","source":"Crossref","is-referenced-by-count":6,"title":["Building Theories from Multiple Evidence Sources"],"prefix":"10.1007","author":[{"given":"Forrest","family":"Shull","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raimund L.","family":"Feldmann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","reference":[{"issue":"7","key":"13_CR1","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1109\/TSE.1986.6312975","volume":"12","author":"V.R. Basili","year":"1986","unstructured":"Basili, V.R., Selby, R., and Hutchens, D., (1986) Experimentation in software engineering. IEEE Transactions on Software Engineering, 12(7): 733\u2013743.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"13_CR2","first-page":"469","volume-title":"Encyclopedia of Software Engineering","author":"V.R. Basili","year":"1994","unstructured":"Basili, V.R., Caldiera, G., and Rombach, H.D., (1994a) Experience factory. In Encyclopedia of Software Engineering, John, J. Marciniak, (ed.) Vol. 1, Wiley, New York, pp. 469\u2013476."},{"key":"13_CR3","first-page":"528","volume-title":"Encyclopedia of Software Engineering","author":"V.R. Basili","year":"1994","unstructured":"Basili, V.R.,. Caldiera, G., and Rombach, H.D., (1994b) Goal question metric paradigm. In Encyclopedia of Software Engineering, John, J. Marciniak, (ed.) Vol. 1, Wiley, New York, pp. 528\u2013532."},{"issue":"4","key":"13_CR4","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1109\/32.799939","volume":"25","author":"V.R. Basili","year":"1999","unstructured":"Basili, V.R., Shull, F., and Lanubile, F., (1999) Building knowledge through families of experiments. IEEE Transactions on Software Engineering, 25(4): 456\u2013474.","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"5","key":"13_CR5","first-page":"4","volume":"18","author":"K. Dangle","year":"2005","unstructured":"Dangle, K., Dwinnell, L., Hickok, J., and Turner, R., (2005) Introducing the department of defense acquisition best practices clearinghouse. CrossTalk, 18(5): 4\u20135.","journal-title":"CrossTalk"},{"key":"13_CR6","first-page":"33","volume-title":"Building decision support in an imperfect world. Proceedings of International Symposium on Empirical Software Engineering (ISESE)","author":"R. Feldmann","year":"2006","unstructured":"Feldmann, R., Shull F., and Shaw, M., (2006) Building decision support in an imperfect world. Proceedings of International Symposium on Empirical Software Engineering (ISESE), Vol. II, Rio de Janeiro, Brazil, pp. 33\u201335."},{"key":"13_CR7","first-page":"95","volume-title":"Do SQA programs work\u2013CMM work. A meta analysis. Proceedings of IEEE International Conference on Software\u2013Science, Technology and Engineering (SwSTE05)","author":"D. Galin","year":"2005","unstructured":"Galin D. and Avrahami, M., (2005) Do SQA programs work\u2013CMM work. A meta analysis. Proceedings of IEEE International Conference on Software\u2013Science, Technology and Engineering (SwSTE05), Herzelia, Israel, pp. 95\u2013100."},{"key":"13_CR8","first-page":"143","volume-title":"Research synthesis in software engineering: a case for meta-analysis. Proceedings of the Sixth International Software Metrics Symposium (METRICS\u201999)","author":"W. Hayes","year":"1999","unstructured":"Hayes, W., (1999) Research synthesis in software engineering: a case for meta-analysis. Proceedings of the Sixth International Software Metrics Symposium (METRICS\u201999), Boca Raton, FL, p. 143."},{"issue":"1\u20132","key":"13_CR9","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/S0164-1212(02)00156-5","volume":"70","author":"M. J\u00f8rgensen","year":"2004","unstructured":"J\u00f8rgensen, M., (2004) A review of studies on expert estimation of software development effort. Journal of Systems and Software, 70(1\u20132): 37\u201360.","journal-title":"Journal of Systems and Software"},{"issue":"4","key":"13_CR10","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1016\/j.infsof.2005.07.002","volume":"48","author":"M. J\u00f8rgensen","year":"2006","unstructured":"J\u00f8rgensen, M., and Mol\u00f8kken-\u00d8stvold, K. J., (2006) How large are software cost overruns? Critical comments on the Standish group\u2019s CHAOS reports. Information and Software Technology, 48(4): 297\u2013301.","journal-title":"Information and Software Technology"},{"key":"13_CR11","unstructured":"Kitchenham, B. (2004) Procedures for Performing Systematic Reviews, Joint Technical Report, Keele University TR\/SE-0401 and NICTA 0400011T.1."},{"key":"13_CR12","first-page":"273","volume-title":"Evidence-based software engineering. Proceedings of the International Conference on Software Engineering","author":"B. Kitchenham","year":"2004","unstructured":"Kitchenham, B., Dyb\u00e5, T., and J\u00f8rgensen, M., (2004) Evidence-based software engineering. Proceedings of the International Conference on Software Engineering, Edinburgh, UK, pp. 273\u2013281."},{"key":"13_CR13","unstructured":"Kitchenham, B., Mendes, E., and Travassos, G. H., (2006) Systematic review of cross- vs. within-company cost estimation studies. Proceedings of the Evaluation & Assessment in Software Engineering (EASE), pp. 89\u201398."},{"key":"13_CR14","unstructured":"Koyani, S.J., Bailey, R.W., and Nall, J.R., (2003) Research based web design and usability guidelines. National Cancer Institute. Available for download at \n                  http:\/\/usability.gov\/pdfs\/guidelines.html\n                  \n                ."},{"key":"13_CR15","first-page":"408","volume-title":"A systematic review of web engineering research. Proceedings of the ACM\/IEEE International Symposium on Empirical Software Engineering","author":"E. Mendes","year":"2005","unstructured":"Mendes, E., (2005) A systematic review of web engineering research. Proceedings of the ACM\/IEEE International Symposium on Empirical Software Engineering, Noosa Heads, Australia, pp. 408\u2013418."},{"key":"13_CR16","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/S0164-1212(00)00024-8","volume":"54","author":"J. Miller","year":"2000","unstructured":"Miller, J., (2000) Applying meta-analytical procedures to software engineering experiments. Journal of Systems and Software, 54: 29\u201339.","journal-title":"Journal of Systems and Software"},{"key":"13_CR17","first-page":"24","volume-title":"Vote-counting for combining quantitative evidence from empirical studies\u2013An example. Proceedings of International Symposium on Empirical Software Engineering (ISESE)","author":"P. Mohagheghi","year":"2006","unstructured":"Mohagheghi, P., and Conradi, R., (2006) Vote-counting for combining quantitative evidence from empirical studies\u2013An example. Proceedings of International Symposium on Empirical Software Engineering (ISESE), Vol. II, Rio de Janeiro, Brazil, pp. 24\u201326."},{"key":"13_CR18","doi-asserted-by":"crossref","DOI":"10.4135\/9781412985000","volume-title":"Meta-Ethnography: Synthesizing Qualitative Studies (Qualitative Research Methods)","author":"G.W. Noblitt","year":"1988","unstructured":"Noblitt, G.W., and Hare, R.D, (1988) Meta-Ethnography: Synthesizing Qualitative Studies (Qualitative Research Methods), Sage Publications Ltd., Thousand Oaks, CA."},{"key":"13_CR19","doi-asserted-by":"crossref","DOI":"10.4135\/9781412985017","volume-title":"Meta-Study of Qualitative Health Research: A Practical Guide to Meta-Analysis and Meta-Synthesis","author":"B. Paterson","year":"2001","unstructured":"Paterson, B., Thorne, S., Canam, C., and Jillings, C., (2001) Meta-Study of Qualitative Health Research: A Practical Guide to Meta-Analysis and Meta-Synthesis, Sage Publications Inc, Thousand Oaks, CA."},{"key":"13_CR20","doi-asserted-by":"crossref","unstructured":"Perry, D., Porter, A., and Votta, L., (2000) Empirical studies of software engineering: a roadmap. Proceedings of International Conference on Software Engineering, Limerick, Ireland.","DOI":"10.1145\/336512.336586"},{"key":"13_CR21","doi-asserted-by":"publisher","DOI":"10.1002\/9780470754887","volume-title":"Systematic Reviews in the Social Sciences. A Practical Guide","author":"M. Petticrew","year":"2006","unstructured":"Petticrew, M. and Roberts, H., (2006) Systematic Reviews in the Social Sciences. A Practical Guide, Blackwell Publishing, Oxford."},{"key":"13_CR22","first-page":"27","volume-title":"Investigating a constructive scorecard model for creating meaningful quantitative data from qualitative inputs. Proceedings of International Symposium on Empirical Software Engineering (ISESE)","author":"D. Port","year":"2006","unstructured":"Port, D., Kazman, R., Nakao, H., Hoshino, N., and Miyamoto, Y., (2006) Investigating a constructive scorecard model for creating meaningful quantitative data from qualitative inputs. Proceedings of International Symposium on Empirical Software Engineering (ISESE), Vol. II, Rio de Janeiro, Brazil, pp. 27\u201329."},{"key":"13_CR23","first-page":"133","volume-title":"An empirical approach to best practice identification and selection: the US department of defense acquisition best practices clearinghouse. Proceedings of International Symposium on Empirical Software Engineering (ISESE)","author":"F. Shull","year":"2005","unstructured":"Shull, F. and Turner, R., (2005) An empirical approach to best practice identification and selection: the US department of defense acquisition best practices clearinghouse. Proceedings of International Symposium on Empirical Software Engineering (ISESE), Noosa Heads, Australia, pp. 133\u2013140."},{"key":"13_CR24","volume-title":"Advanced Topics in Empirical Software Engineering: A Handbook","author":"D.I.K Sj\u00f8berg","year":"2007","unstructured":"Sj\u00f8berg, D.I.K, Dyb\u00e5, T., Anda, B.C.D., and Hannay, J.E., (2007a) Building theories in software engineering. In Advanced Topics in Empirical Software Engineering: A Handbook, Shull, F., Singer, J., and Sj\u00f8berg, D.I.K (eds.), Springer, Berlin."},{"key":"13_CR25","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1007\/978-3-540-71301-2_31","volume-title":"Experimental Software Engineering Issues: Assessment and Future","author":"D.I.K. Sj\u00f8berg","year":"2007","unstructured":"Sj\u00f8berg, D.I.K., (2007b) Documenting theories. In Experimental Software Engineering Issues: Assessment and Future, Basili, V.R., Rombach, D., Schneider, K., Kitchenham, B., Pfahl, D. and Selby, R, (eds.), Springer-Verlag, Berlin Heidelberg, pp. 111\u2013114."},{"key":"13_CR26","volume-title":"The Goal\/Question\/Metric Method","author":"R. Solingen van","year":"1999","unstructured":"van Solingen, R. and Berghout, E., (1999) The Goal\/Question\/Metric Method, McGraw-Hill Education, New York."},{"key":"13_CR27","unstructured":"Zelkowitz, M., (2001) Models for industrial validation of new technology. ISERN workshop at Strathclyde University. Available via \n                  http:\/\/isern.iese.de\/network\/ISERN\/pub\/meetings\/Glasgow2001\/Agenda.htm\n                  \n                ."},{"issue":"5","key":"13_CR28","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1109\/2.675630","volume":"31","author":"M. Zelkowitz","year":"1998","unstructured":"Zelkowitz, M. and Wallace, D., (1998) Experimental models for validating technology. IEEE Computer, 31(5), pp. 23\u201331.","journal-title":"IEEE Computer"}],"container-title":["Guide to Advanced Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/978-1-84800-044-5_13.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,1]],"date-time":"2021-05-01T22:20:03Z","timestamp":1619907603000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/978-1-84800-044-5_13"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008]]},"ISBN":["9781848000438","9781848000445"],"references-count":28,"URL":"https:\/\/doi.org\/10.1007\/978-1-84800-044-5_13","relation":{},"subject":[],"published":{"date-parts":[[2008]]}}}