{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T21:17:52Z","timestamp":1773868672555,"version":"3.50.1"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2014,1,1]],"date-time":"2014-01-01T00:00:00Z","timestamp":1388534400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2014,1]]},"abstract":"<jats:p>This article is devoted to the survey, analysis, and classification of operational profiles (OP) that characterize the type and frequency of software inputs and are used in software testing techniques. The survey follows a mixed method based on systematic maps and qualitative analysis. This article is articulated around a main dimension, that is, OP classes, which are a characterization of the OP model and the basis for generating test cases. The classes are organized as a taxonomy composed of common OP features (e.g., profiles, structure, and scenarios), software boundaries (which define the scope of the OP), OP dependencies (such as those of the code or in the field of interest), and OP development (which specifies when and how an OP is developed). To facilitate understanding of the relationships between OP classes and their elements, a meta-model was developed that can be used to support OP standardization. Many open research questions related to OP definition and development are identified based on the survey and classification.<\/jats:p>","DOI":"10.1145\/2518106","type":"journal-article","created":{"date-parts":[[2014,3,4]],"date-time":"2014-03-04T13:24:59Z","timestamp":1393939499000},"page":"1-39","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Software testing with an operational profile"],"prefix":"10.1145","volume":"46","author":[{"given":"Carol","family":"Smidts","sequence":"first","affiliation":[{"name":"The Ohio State University, Columbus, OH"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chetan","family":"Mutha","sequence":"additional","affiliation":[{"name":"The Ohio State University, Columbus, OH"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manuel","family":"Rodr\u00edguez","sequence":"additional","affiliation":[{"name":"The Ohio State University, Columbus, OH"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew J.","family":"Gerber","sequence":"additional","affiliation":[{"name":"The Ohio State University, Columbus, OH"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,2]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proc. of the 53rd Annual Reliability and Maintainability Symposium. 621--627","author":"Arora S."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/851015.856165"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1321631.1321681"},{"key":"e_1_2_1_4_1","volume-title":"Constructing Grounded Theory: A Practical Guide through Qualitative Analysis","author":"Charmaz K."},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"J. Corbin and A. Strauss. 2008. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory 3rd Ed. Sage Thousand Oaks CA.  J. Corbin and A. Strauss. 2008. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory 3rd Ed. Sage Thousand Oaks CA.","DOI":"10.4135\/9781452230153"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","volume-title":"Basic Statistics for Social Research: Step-by-Step Calculations and Computer Techniques Using Minitab","author":"Cramer D.","DOI":"10.4324\/9780203430897"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.602"},{"key":"e_1_2_1_8_1","volume-title":"Proc. of the 3rd International Conference on Quality Software. 336--342","author":"Dulz W."},{"key":"e_1_2_1_9_1","volume-title":"Proc. of the 2001 Annual Reliability and Maintainability Symposium (RAMS\u201901)","author":"Elbaum S."},{"key":"e_1_2_1_10_1","first-page":"1","article-title":"Human reliability analysis: A review of the state of the art","volume":"2","author":"Fabio D. F.","year":"2012","journal-title":"International Journal of Research in Management and Technology"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2004.8"},{"key":"e_1_2_1_12_1","unstructured":"B. G. Glaser and A. L. Strauss. 2009. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine de Gruyter New York.  B. G. Glaser and A. L. Strauss. 2009. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine de Gruyter New York."},{"key":"e_1_2_1_13_1","unstructured":"K. Gwet. 2002. Kappa statistic is not satisfactory for assessing the extent of agreement between raters. Statistical Methods for Inter-rater Reliability Assessment 1--6.  K. Gwet. 2002. Kappa statistic is not satisfactory for assessing the extent of agreement between raters. Statistical Methods for Inter-rater Reliability Assessment 1--6."},{"key":"e_1_2_1_14_1","volume-title":"Proc. of the 11th Annual Workshop on Software Test and Reliability Estimation Process at Software Technology and Engineering Practice (STEP\u201903)","author":"Guen H. L."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2004.33"},{"key":"e_1_2_1_16_1","volume-title":"Proc. of the 23rd International Conference on Software Engineering (ICSE\u201901)","author":"Hamlet D."},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"J. M. Hammersley and D. C. Handscomb. 1964. Monte Carlo Methods (Methuen's Monographs on Applied Probability and Statistics). Methuen London.  J. M. Hammersley and D. C. Handscomb. 1964. Monte Carlo Methods (Methuen's Monographs on Applied Probability and Statistics). Methuen London.","DOI":"10.1007\/978-94-009-5819-7"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-6423(87)90035-9"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2011.2161699"},{"key":"e_1_2_1_20_1","volume-title":"Proc. of the 53nd Annual Reliability and Maintainability Symposium (RAMS\u201907)","author":"Huang B."},{"key":"e_1_2_1_21_1","unstructured":"IEEE\/ISO\/IEC 24765. 2010. System and Software Engineering Vocabulary. Standards.  IEEE\/ISO\/IEC 24765. 2010. System and Software Engineering Vocabulary. Standards."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2007.3"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.1992.285896"},{"key":"e_1_2_1_25_1","volume-title":"Proc. of the 29th IEEE International Symposium on Fault-Tolerant Computing. 30--37","author":"Koopman P."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218539308003234"},{"key":"e_1_2_1_27_1","unstructured":"T. Muhr and S. Friese. 2004. User's Manual for ATLAS. ti 6.0. ATLAS. ti Scientific Software Development GmbH Berline.  T. Muhr and S. Friese. 2004. User's Manual for ATLAS. ti 6.0. ATLAS. ti Scientific Software Development GmbH Berline."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.1992.285850"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.199724"},{"key":"e_1_2_1_30_1","volume-title":"Proc. of the 6th International Symposium on Software Reliability Engineering (ISSRE\u201995)","author":"Ouabdesselam F."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering. 71--80","author":"Petersen K."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/820756.821809"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ECBS.2007.13"},{"key":"e_1_2_1_34_1","volume-title":"Proc. of HLT-NAACL 2004: Short Papers. Association for Computational Linguistics, 77--80","author":"Rosenberg A."},{"key":"e_1_2_1_35_1","volume-title":"Proc. of the 1st European International Conference on Software Testing, Analysis and Review (EuroSTAR\u201993)","author":"Runeson P."},{"key":"e_1_2_1_36_1","series-title":"No. 14","volume-title":"The Coding Manual for Qualitative Researchers","author":"Saldana J."},{"key":"e_1_2_1_37_1","volume-title":"User Interface: Strategies for Effective Human Interaction","author":"Shneideman B.","year":"2010"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/APSEC.2004.95"},{"key":"e_1_2_1_39_1","volume-title":"Proc. of the 7th International Symposium on Component-based Software Engineering (CBSE7). 272--279","author":"Shukla R. Y."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1093\/ptj\/85.3.257"},{"key":"e_1_2_1_41_1","unstructured":"C. Taylor T. C. Gibbs and A. Lewins. 2005. Quality of Qualitative Analysis. Retrieved from http:\/\/onlineqda.hud.ac.uk\/Intro_QDA\/qualitative_analysis.php.  C. Taylor T. C. Gibbs and A. Lewins. 2005. Quality of Qualitative Analysis. Retrieved from http:\/\/onlineqda.hud.ac.uk\/Intro_QDA\/qualitative_analysis.php."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.4380250106"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1243\/1748006XJRR241"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.714817"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.889091"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/151299.151326"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.328991"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/154183.154187"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.5555\/1018442.1022052"},{"key":"e_1_2_1_50_1","volume-title":"Proc. of the 8th International Conference on Computer Supported Cooperative Work in Design (CSCWD","author":"Zhen F.","year":"2004"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2518106","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2518106","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:14:13Z","timestamp":1750277653000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2518106"}},"subtitle":["OP definition"],"short-title":[],"issued":{"date-parts":[[2014,1]]},"references-count":49,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,1]]}},"alternative-id":["10.1145\/2518106"],"URL":"https:\/\/doi.org\/10.1145\/2518106","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,1]]},"assertion":[{"value":"2011-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-02-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}