{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,4,5]],"date-time":"2022-04-05T15:48:18Z","timestamp":1649173698040},"reference-count":25,"publisher":"Walter de Gruyter GmbH","issue":"2","license":[{"start":{"date-parts":[[2011,1,1]],"date-time":"2011-01-01T00:00:00Z","timestamp":1293840000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2011,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Effective validation of distributed real-time and embedded (DRE) system quality-of-service (QoS) properties (e.g., event prioritization, latency, and throughput) requires testing system capabilities in representative execution environments. Unfortunately, evaluating the correctness of such tests is hard since it requires validating many states dispersed across many hardware and software components. To address this problem, this article presents a method called Test Execution (TE) Score for validating execution correctness of DRE system tests and empirically evaluates TE Score in the context of a representative DRE system. Results from this evaluation show that TE Score can determine the percentage correctness in test execution, and facilitate trade-off analysis of execution states, thereby increasing confidence in QoS assurance and improving test quality.<\/jats:p>","DOI":"10.2478\/s13537-011-0012-2","type":"journal-article","created":{"date-parts":[[2011,6,27]],"date-time":"2011-06-27T23:43:15Z","timestamp":1309218195000},"source":"Crossref","is-referenced-by-count":1,"title":["Evaluating distributed real-time and embedded system test correctness using system execution traces"],"prefix":"10.2478","volume":"1","author":[{"given":"James","family":"Hill","sequence":"first","affiliation":[]},{"given":"Pooja","family":"Varshneya","sequence":"additional","affiliation":[]},{"given":"Douglas","family":"Schmidt","sequence":"additional","affiliation":[]}],"member":"374","reference":[{"key":"12_CR1","volume-title":"Ultra-Large-Scale Systems: Software Challenge of the Future","author":"S. E. Institute","year":"2006","unstructured":"S. E. Institute, Ultra-Large-Scale Systems: Software Challenge of the Future, Technical report, Carnegie Mellon University, Pittsburgh, PA, USA, June 2006"},{"key":"12_CR2","unstructured":"Snow A., Keil M., The Challenges of Accurate Project Status Reporting, Proceedings of the 34th Annual Hawaii International Conference on System Sciences (3\u20136 January 2001, Maui Hawaii), IEEE Computer Society, 2001, 8043"},{"key":"12_CR3","volume-title":"The Role of Project Escalation in Explaining Runaway Information Systems Development Projects: A Field Study","author":"J. Mann","year":"1996","unstructured":"Mann J., The Role of Project Escalation in Explaining Runaway Information Systems Development Projects: A Field Study, PhD thesis, Georgia State University, Atlanta, GA, 1996"},{"key":"12_CR4","volume-title":"Performance Solutions: A Practical Guide to Creating Responsive","author":"C. Smith","year":"2001","unstructured":"Smith C., Williams L., Performance Solutions: A Practical Guide to Creating Responsive, Scalable Software, Addison-Wesley Professional, Boston, MA, USA, 2001"},{"key":"12_CR5","unstructured":"Technical I.M., Majzik I., Software Monitoring and Debugging Using Compressed Signature Sequences, In: Milligan P., Kuchcinski K. (Eds.), Proceedings of the 22nd EUROMICRO Conference (2\u20135 September 1996, Prague, Czech Republic), IEEE Computer Society, 1996, 311\u2013318"},{"key":"12_CR6","doi-asserted-by":"crossref","unstructured":"Cheon Y., Leavens G.T., A Simple and Practical Approach to Unit Testing: The JML and JUnit Way, In: Magnusson B. (Ed.), Proceedings of the 16th European Conference on Object-Oriented Programming (10\u201314 June 2002, Malaga, Spain), Springer-Verlag, 2002, 231\u2013255","DOI":"10.1007\/3-540-47993-7_10"},{"key":"12_CR7","unstructured":"Chang F., Ren J., Validating system properties exhibited in execution traces, In: Stirewalt K., Egyed A., Fischer B. (Eds.), ASE\u2019 07: Proceedings of the twenty-second IEEE\/ACM international conference on Automated software engineering (5\u20139 November, New York, NY, USA), ACM, 2007, 517\u2013520"},{"key":"12_CR8","doi-asserted-by":"crossref","unstructured":"Loyall J.P., Gillen M., Paulos A., Bunch L., Carvalho M., Edmondson J., Varshneya P., Schmidt D.C., Martignoni A., Dynamic Policy-Driven Quality of Service in Service-Oriented Systems, Proceedings of the 13th International Symposium on Object\/Component\/Service-oriented Real-time Distributed Computing (5\u20136 May 2010, Parador of Carmona, Spain), IEEE Computer Society, 2010","DOI":"10.1109\/ISORC.2010.13"},{"key":"12_CR9","unstructured":"T. N. S. Agency, Global Information Grid, The National Security Agency, www.nsa.gov\/ia\/industry\/gig.cfm?MenuID=10.3.2.2 ."},{"key":"12_CR10","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/BF01405730","volume":"4","author":"H. Rittel","year":"1973","unstructured":"Rittel H., Webber M., Dilemmas in a General Theory of Planning, POLICY SCI, 1973, 4, 155\u2013169","journal-title":"POLICY SCI"},{"key":"12_CR11","doi-asserted-by":"crossref","unstructured":"Hill J.H., Turner H.A., Edmondson J.R., Schmidt D.C., Unit Testing Non-functional Concerns of Component-based Distributed Systems, Proceedings of the 2nd International Conference on Software Testing, Verification, and Validation (1\u20134 April 2009, Denver, Colorado, USA) IEEE Computer Society, 2009, 406\u2013415","DOI":"10.1109\/ICST.2009.44"},{"key":"12_CR12","doi-asserted-by":"crossref","unstructured":"Hill J.H., Slaby J., Baker S., Schmidt D.C., Applying System Execution Modeling Tools to Evaluate Enterprise Distributed Real-time and Embedded System QoS, Proceedings of the 12th International Conference on Embedded and Real-Time Computing Systems and Applications (August 2006 Sydney, Australia) IEEE Computer Society, 2006, 350\u2013362","DOI":"10.1109\/RTCSA.2006.17"},{"key":"12_CR13","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/2.963443","volume":"34","author":"L\u00e9deczi","year":"2001","unstructured":"L\u00e9deczi \u00c1., Bakay \u00c1., Mar\u00f3ti M., V\u00f6lgyesi P., Nordstrom G., Sprinkle J., Karsai G., Composing Domain-Specific Design Environments, COMPUTER, 2001, 34, 44\u201351","journal-title":"COMPUTER"},{"key":"12_CR14","volume-title":"Generative Programming: Methods, Tools, and Applications","author":"K. Czarnecki","year":"2000","unstructured":"Czarnecki K., Eisenecker U.W., Generative Programming: Methods, Tools, and Applications, Addison-Wesley, Reading, Massachusetts, 2000"},{"key":"12_CR15","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1002\/dac.652","volume":"17","author":"N.X. Liu","year":"2004","unstructured":"Liu N.X., Baras J.S., Modelling multi-dimensional QoS: Some fundamental constraints: Research articles, INT J COMMUN SYST, 2004, 17, 193\u2013215","journal-title":"INT J COMMUN SYST"},{"key":"12_CR16","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/MS.2009.197","volume":"27","author":"J.H. Hill","year":"2010","unstructured":"Hill J.H., Schmidt D.C., Edmondson J., Gokhale A., Tools for Continuously Evaluating Distributed System Qualities, IEEE SOFTWARE, 2010, 27, 65\u201371","journal-title":"IEEE SOFTWARE"},{"key":"12_CR17","volume-title":"Structured Systems Analysis and Design Method: Application and Context","author":"E. Downs","year":"1988","unstructured":"Downs E., Clare P., Coe I., Structured Systems Analysis and Design Method: Application and Context, Prentice Hall International (UK) Ltd., Hertfordshire, UK, 1988"},{"key":"12_CR18","volume-title":"Advanced Concepts in Operating Systems","author":"M. Singhal","year":"1994","unstructured":"Singhal M., Shivaratri N.G., Advanced Concepts in Operating Systems, McGraw-Hill, Inc., New York, NY, USA, 1994"},{"key":"12_CR19","first-page":"9","volume":"2","author":"J.H. Hill","year":"2007","unstructured":"Hill J.H., Gokhale A.S., Model-driven engineering for early QoS validation of component-based software systems, J SOFTW, 2007, 2, 9\u201318","journal-title":"J SOFTW"},{"key":"12_CR20","unstructured":"Moe J., Carr D.A., Understanding Distributed Systems via Execution Trace Data, The Proceedings of the Ninth International Workshop on Program Comprehension (12\u201313 May 2001, Toronto, Canada) IEEE Computer Society, 2001, 60\u201367"},{"key":"12_CR21","unstructured":"Baker B.S., Parameterized Pattern Matching by Boyer-Moore-type Algorithms, Proceedings of the sixth annual ACM-SIAM symposium on Discrete algorithms (22\u201324 January 1995, San Francisco, California) Society for Industrial and Applied Mathematics, 1995, 541\u2013550"},{"key":"12_CR22","unstructured":"Fowler M., Continuous Integration, www.martinfowler.com\/articles\/continuousIntegration.html"},{"key":"12_CR23","volume-title":"JUnit in Action","author":"V. Massol","year":"2003","unstructured":"Massol V., Husted T., JUnit in Action, Manning Publications Co., Greenwich, CT, USA, 2003"},{"key":"12_CR24","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1109\/32.387470","volume":"21","author":"J. Tian","year":"1995","unstructured":"Tian J., Lu P., Palma J., Test-execution-based reliability measurement and modeling for large commercial software, IEEE T SOFTWARE ENG, 1995, 21, 405\u2013414","journal-title":"IEEE T SOFTWARE ENG"},{"key":"12_CR25","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1109\/69.706056","volume":"10","author":"J. Lee","year":"1998","unstructured":"Lee J., Kuo J.-Y., New Approach to Requirements Trade-Off Analysis for Complex Systems, IEEE T KNOWL DATA EN, 1998, 10, 551\u2013562","journal-title":"IEEE T KNOWL DATA EN"}],"container-title":["Open Computer Science"],"original-title":[],"link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.2478\/s13537-011-0012-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.2478\/s13537-011-0012-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.2478\/s13537-011-0012-2","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,28]],"date-time":"2021-02-28T16:19:04Z","timestamp":1614529144000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.2478\/s13537-011-0012-2\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,1,1]]},"references-count":25,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.2478\/s13537-011-0012-2","relation":{},"ISSN":["2299-1093"],"issn-type":[{"value":"2299-1093","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,1,1]]}}}