{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,30]],"date-time":"2025-12-30T20:07:25Z","timestamp":1767125245937,"version":"build-2065373602"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2013,12,1]],"date-time":"2013-12-01T00:00:00Z","timestamp":1385856000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Hum. Cent. Comput. Inf. Sci."],"published-print":{"date-parts":[[2013,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The production of software systems with specific demand on reliability, availability, maintenance, and performance (RAMP) is one of the greatest challenges facing software engineers at all levels of the development cycle. Most requirements specification tools are more suited for functional requirements than for non-functional RAMP requirements. RAMP requirements are left unspecified, specified at a later stage, or at best vaguely specified, which makes requirements specifications more of an art than a science. Furthermore, the cost of testing for RAMP requirements is quite often prohibitive. In many cases, it is difficult to test for some of the RAMP specifications such as maintainability, reliability, and high availability. Even the test for performance is quite often workload dependent and as such the performance numbers provided at test time or at system commissioning time may not be achievable during actual system workload. What makes the subject matter more difficult is the absence of a clear set of rules or practices, which, if followed closely, produce a system with acceptable RAMP specifications. As such, and until the design of RAMP software systems becomes a well understood theme, the development of such systems will be a fine art, where the tools and capabilities of developing such systems will depend on the particular system to be developed, the environment in which it will run, and the level of expertise and knowledge deployed. Just like no two pieces of art produced by the same artist are the same, no two software systems will have the same RAMP characteristics.<\/jats:p><jats:p>This paper will focus on the paradigms involved in the production of RAMP software systems through several case studies. The purpose is to promote the interest of researchers to develop more specific guidelines for the production of SW systems with well defined RAMP qualities.<\/jats:p>","DOI":"10.1186\/2192-1962-3-22","type":"journal-article","created":{"date-parts":[[2013,12,21]],"date-time":"2013-12-21T02:01:27Z","timestamp":1387591287000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["The art of software systems development: Reliability, Availability, Maintainability, Performance (RAMP)"],"prefix":"10.1186","volume":"3","author":[{"given":"Mohammad Isam","family":"Malkawi","sequence":"first","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2013,12,21]]},"reference":[{"key":"44_CR1","volume-title":"Requirements and Specifications","author":"T Eushiuan","year":"1999","unstructured":"Eushiuan T: Requirements and Specifications. : Carnegie Mellon University, 18\u2013849b Dependable Embedded Systems; 1999."},{"key":"44_CR2","unstructured":"Ascent\u00ae Logic website http:\/\/www.alc.com"},{"key":"44_CR3","unstructured":"Nu Thena\u00ae Systems website http:\/\/www.lynuxworks.com\/"},{"key":"44_CR4","unstructured":"Rational\u00ae Software website http:\/\/www-01.ibm.com\/software\/rational\/"},{"key":"44_CR5","unstructured":"Scientific and Engineering Software\u00ae website https:\/\/www.ece.cmu.edu\/~koopman\/des_s99\/requirements_specs\/"},{"key":"44_CR6","volume-title":"Requirements & Specifications","author":"T Eushiuan","year":"1999","unstructured":"Eushiuan T: Requirements & Specifications. : Dependable Embedded Systems. Spring; 1999. http:\/\/www.ece.cmu.edu\/~koopman\/des_s99\/requirements_specs\/"},{"key":"44_CR7","first-page":"183","volume-title":"Proceedings of the First IEEE International Conference on Formal Engineering Methods, ISBN 0-8186-8002-4; Nov. 12\u201314, 1997","author":"F Lattemann","year":"1997","unstructured":"Lattemann F, Lehmann E: A methodological Approach to the Requirement Specification of Embedded Systems. In Proceedings of the First IEEE International Conference on Formal Engineering Methods, ISBN 0\u20138186\u20138002\u20134; Nov. 12\u201314, 1997. Hiroshima, Japan: ; 1997:183\u2013191."},{"key":"44_CR8","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1007\/978-1-4471-3003-1_17","volume-title":"Achievement and Assurance of Safety - Proceedings of the Third Safety-Critical Systems Symposium","author":"D Patridge","year":"1995","unstructured":"Patridge D: Where do Specifications Come From? In Achievement and Assurance of Safety - Proceedings of the Third Safety-Critical Systems Symposium. Brighton, United Kingdom: ; 1995:302\u2013310."},{"key":"44_CR9","isbn-type":"print","volume-title":"The Art of Computer Programming, Volume I: Fundamental Algorithms","author":"K Donald Ervin","year":"1974","unstructured":"Donald Ervin K: The Art of Computer Programming, Volume I: Fundamental Algorithms. 3rd edition. : Addison-Wesley International; 1974.","ISBN":"https:\/\/id.crossref.org\/isbn\/0201896834","edition":"3"},{"key":"44_CR10","volume-title":"Art and Science of Software Engineering","author":"C John","year":"2012","unstructured":"John C: Art and Science of Software Engineering. : University of Washington Blogs; 2012. http:\/\/blogs.uw.edu\/ajko\/2012\/08\/22\/john-carmack-discusses-the-art-and-science-of-software-engineering\/"},{"key":"44_CR11","doi-asserted-by":"crossref","unstructured":"Ko AJ, et al.: The State of the Art in End-User Software Engineering. ACM Surveys Vol. 43, No. 3, Article 21, April 2011; http:\/\/faculty.washington.edu\/ajko\/papers\/Ko2011EndUserSoftwareEngineering.pdf","DOI":"10.1145\/1922649.1922658"},{"issue":"2","key":"44_CR12","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1109\/MC.2007.73","volume":"40","author":"RR Loka","year":"2007","unstructured":"Loka RR: Software Development: What Is the Problem? Computer 2007, 40(2):110\u2013112.","journal-title":"Computer"},{"key":"44_CR13","volume-title":"Software Engineering: Art or Science","author":"R Victoria","year":"2011","unstructured":"Victoria R: Software Engineering: Art or Science. 2011.http:\/\/sdt.bz\/content\/article.aspx?ArticleID=36088&page=1 SD Times, Nov. 8, 2011;"},{"issue":"1","key":"44_CR14","first-page":"118","volume":"15","author":"MC Steve","year":"1998","unstructured":"Steve MC: The Art, Science, and Engineering of Software Development. IEEE Softw 1998, 15(1):118\u2013120.","journal-title":"IEEE Softw"},{"key":"44_CR15","volume-title":"Art of Software Engineering, Function Point Analysis Examined","author":"G Naveen","year":"2006","unstructured":"Naveen G: Art of Software Engineering, Function Point Analysis Examined. : Avenue Razorfish; 2006. http:\/\/people.eecs.ku.edu\/~saiedian\/Teaching\/Sp13\/811\/Papers\/fun-point-analysis-explained.pdf"},{"key":"44_CR16","isbn-type":"print","volume-title":"Software Conflict 2.0: The Art and Science of Software Development","author":"R Glass","year":"2006","unstructured":"Glass R: Software Conflict 2.0: The Art and Science of Software Development. : Books International; 2006.","ISBN":"https:\/\/id.crossref.org\/isbn\/0977213307"},{"key":"44_CR17","volume-title":"DSP Laboratory for Real-Time Systems Design and Implementation: Software Engineering and the Art of Design. Proceedings of the 2001 American Society for Engineering and Education Annual Conference; session 1526","author":"J Waldo","year":"2001","unstructured":"Waldo J: DSP Laboratory for Real-Time Systems Design and Implementation: Software Engineering and the Art of Design. Proceedings of the 2001 American Society for Engineering and Education Annual Conference; session 1526. 2001. http:\/\/www.artima.com\/weblogs\/viewpost.jsp?thread=7600"},{"issue":"4","key":"44_CR18","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1177\/1094342004048539","volume":"18","author":"L Votta","year":"2004","unstructured":"Votta L, et al.: Measuring High Performance Computing Productivity. Int J High Perform Comput Appl 2004, 18(4):459\u2013473. 10.1177\/1094342004048539","journal-title":"Int J High Perform Comput Appl"},{"key":"44_CR19","volume-title":"The Bathtub Curve and Product Failure Behavior","author":"D Wilkins","year":"2002","unstructured":"Wilkins D: The Bathtub Curve and Product Failure Behavior. : The Reliability HotWire in Weibull.com; 2002. issue 21, November 2002; http:\/\/www.weibull.com\/hotwire\/issue21\/hottopics21.htm issue 21, November 2002;"},{"issue":"8","key":"44_CR20","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1109\/MC.2003.1220580","volume":"36","author":"A Wood","year":"2003","unstructured":"Wood A: Software Reliability from the Customer View. IEEE Comp Soc 2003, 36(8):37\u201342. 10.1109\/MC.2003.1220580","journal-title":"IEEE Comp Soc"},{"issue":"12","key":"44_CR21","doi-asserted-by":"publisher","first-page":"1438","DOI":"10.1109\/TSE.1985.232180","volume":"SE-11","author":"RK Iyer","year":"1985","unstructured":"Iyer RK, Rossetti DJ: Effect of System Workload on Operating System Reliability: A Study on IBM 3081. IEEE Trans Software Eng 1985, SE-11(12):1438\u20131448.","journal-title":"IEEE Trans Software Eng"},{"key":"44_CR22","volume-title":"Proceedings of IEEE Pacific Rim Intl\u2019 Symp. Dependable Computing (PRDC)","author":"X Jun","year":"1999","unstructured":"Jun X, Zbigniew K, Ravishankar KI: Networked Windows NT System Field Failure Data Analysis. In Proceedings of IEEE Pacific Rim Intl\u2019 Symp. Dependable Computing (PRDC). Hong Kong, China: ; 1999."},{"key":"44_CR23","volume-title":"Availability Work Products \u2013 A Strategic Approach","author":"M Malkawi","year":"2001","unstructured":"Malkawi M, Votta L, Ignatius G, Moore B: Availability Work Products \u2013 A Strategic Approach. Crete: IEEE Signal Processing Society 5th WSES International Conference; 2001."},{"key":"44_CR24","first-page":"687","volume-title":"Proceedings of the International Conference on Dependable Systems and Networks (DSN)","author":"M Malkawi","year":"2002","unstructured":"Malkawi M, et al.: Analysis of Failure and Recovery Rates in a Wireless Telecommunications System. Proceedings of the International Conference on Dependable Systems and Networks (DSN) 2002, 687\u2013693."},{"key":"44_CR25","volume-title":"Software Systems Availability Modeling and Analysis. Motorola Report and Motorola Symposium on Software Engineering","author":"M Malkawi","year":"2000","unstructured":"Malkawi M, Votta L: Software Systems Availability Modeling and Analysis. Motorola Report and Motorola Symposium on Software Engineering. Phoenix, AZ: ; 2000."},{"key":"44_CR26","volume-title":"High Availability Models for Common Platform BTS","author":"M Malkawi","year":"1999","unstructured":"Malkawi M: High Availability Models for Common Platform BTS. : Motorola Inc. Internal Report #R1999HAM01; 1999."},{"key":"44_CR27","isbn-type":"print","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-2367-3","volume-title":"Performance and Reliability Analysis of Computer Systems: An Example-Based Approach Using the SHARPE Software Package","author":"RA Sahner","year":"1996","unstructured":"Sahner RA, Trivedi KS, Antonio P: Performance and Reliability Analysis of Computer Systems: An Example-Based Approach Using the SHARPE Software Package. Netherlands: Kluwer Academic Publishers; 1996.","ISBN":"https:\/\/id.crossref.org\/isbn\/0792396502"},{"key":"44_CR28","first-page":"34","volume-title":"Tools of the 2003 Illinois International Multiconference on Measurement, Modeling, and Evaluation of Computer-Communication Systems","author":"T Courtney","year":"2003","unstructured":"Courtney T, Daly D, Derisavi S, Lam V, Sanders WH: The M\u00f6bius Modeling Environment. In Tools of the 2003 Illinois International Multiconference on Measurement, Modeling, and Evaluation of Computer-Communication Systems. Germany: Universit\u00e4t Dortmund Fachbereich Informatik; 2003:34\u201337. research report no. 781\/2003 research report no. 781\/2003"},{"key":"44_CR29","volume-title":"Mobile Radio Technology (MRT) J","author":"M Malkawi","year":"2005","unstructured":"Malkawi M, Malkawi A: Spectrum Management and Rebanding. Mobile Radio Technology (MRT) J 2005. June 2005 June 2005"},{"key":"44_CR30","volume-title":"A Comprehensive Analysis of External Interference","author":"M Malkawi","year":"2002","unstructured":"Malkawi M, Malkawi A: A Comprehensive Analysis of External Interference. 2002. white paper published at http:\/\/www.glob-tel.com\/index.html white paper published at"},{"issue":"1","key":"44_CR31","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1002\/j.1538-7305.1953.tb01422.x","volume":"32","author":"WC Babcock","year":"1953","unstructured":"Babcock WC: Intermodulation Interference in Radio Systems. Bell Syst Tech J 1953, 32(1):63\u201373. 10.1002\/j.1538-7305.1953.tb01422.x","journal-title":"Bell Syst Tech J"},{"key":"44_CR32","volume-title":"Mobile Radio Technology","author":"JM Jacobsmeyer","year":"2007","unstructured":"Jacobsmeyer JM: Solving Inermodulation Interference in Radio Systems. Mobile Radio Technology 2007. (MRT) J; July 1, 2007"},{"key":"44_CR33","unstructured":"Lucent Technologies User manual Document 401\u2013610\u2013133 Issue 28- Flexnet\/Autoplex Wirless Networks Executve Cellular Processor (ECP) Release 24 4\u2013125\u20134\u2013127."},{"key":"44_CR34","unstructured":"Williams S: Analysis of the SSH Key Exchange Protocol. Cryptology ePrint Archive, Report 2011\/276. , 2011 http:\/\/eprint.iacr.org\/2011\/276 , 2011"},{"key":"44_CR35","unstructured":"Patrick T: Buggy software costs users, vendors nearly $60B annually. : Computerworld; June 25 2002; http:\/\/www.computerworld.com\/s\/article\/72245\/Study_Buggy_software_costs_users_vendors_nearly_60B_annually June 25 2002;"},{"key":"44_CR36","unstructured":"Fiorenza B: Cambridge University Study States Software Bugs Cost Economy $312 Billion Per Year. Cambridge Judge Business School: PRWeb Online Visibility from Focus; http:\/\/www.prweb.com\/releases\/2013\/1\/prweb10298185.htm"},{"key":"44_CR37","unstructured":"U.S.-Canada Power System Outage Task Force: August 14th, 2003 Blackout: Causes and Recommendations. http:\/\/energy.gov\/sites\/prod\/files\/oeprod\/DocumentsandMedia\/BlackoutFinal-Web.pdf"},{"key":"44_CR38","first-page":"16","volume-title":"Mars Climate Orbiter Mishap Investigation Board, Phase I Report on Project Management in NASA","author":"A Stephenson","year":"1999","unstructured":"Stephenson A, et al.: Mars Climate Orbiter Mishap Investigation Board, Phase I Report on Project Management in NASA. 1999, 16\u201322. http:\/\/science.ksc.nasa.gov\/mars\/msp98\/misc\/MCO_MIB_Report.pdf"},{"key":"44_CR39","unstructured":"Lions JL: Arian 5 flight 501 Failure, Report by the Inquiry Board. http:\/\/www.ima.umn.edu\/~arnold\/disasters\/ariane5rep.html"},{"key":"44_CR40","volume-title":"GoAhead Stress Test Definition; Motorola Internal Report; Rep. ##R2001ALT01","author":"S Matz","year":"2001","unstructured":"Matz S: GoAhead Stress Test Definition; Motorola Internal Report; Rep. ##R2001ALT01. 2001."},{"issue":"1","key":"44_CR41","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1147\/sj.171.0039","volume":"17","author":"TC Jones","year":"1978","unstructured":"Jones TC: Measuring Programming Quality and Productivity. IBM Syst J 1978, 17(1):39.","journal-title":"IBM Syst J"},{"key":"44_CR42","unstructured":"Information Management and Technology Division, GAO\/IMTEC-92\u201326 Patriot Missile Software Problem, B-247094, February 4, 1992 http:\/\/www.fas.org\/spp\/starwars\/gao\/im92026.htm"},{"key":"44_CR43","volume-title":"Two disasters caused by computer arithmetic errors","author":"A Douglas","year":"1992","unstructured":"Douglas A: Two disasters caused by computer arithmetic errors. : Institute of Mathematical Applications, University of Minnesota; 1992. http:\/\/www.ima.umn.edu\/~arnold\/455.f96\/disasters.html"},{"issue":"2","key":"44_CR44","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1177\/028072700402200202","volume":"22","author":"GC Dominik","year":"2004","unstructured":"Dominik GC, Pangan Oliver I: Cultural Influences on Disaster Management: ACase Study of the Mt. Pinatubo Eruption. Int J Mass Emergencies Disasters 2004, 22(2):31\u201358.","journal-title":"Int J Mass Emergencies Disasters"},{"issue":"7","key":"44_CR45","doi-asserted-by":"publisher","first-page":"638","DOI":"10.1109\/TSE.2002.1019479","volume":"28","author":"L Dobrica","year":"2002","unstructured":"Dobrica L, Niemela E: A survey on software architecture analysis methods. IEEE Trans Software Eng 2002, 28(7):638\u2013654. 10.1109\/TSE.2002.1019479","journal-title":"IEEE Trans Software Eng"}],"container-title":["Human-centric Computing and Information Sciences"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/2192-1962-3-22.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/2192-1962-3-22\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/2192-1962-3-22.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,9]],"date-time":"2023-07-09T07:24:58Z","timestamp":1688887498000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/2192-1962-3-22"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,12]]},"references-count":45,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,12]]}},"alternative-id":["44"],"URL":"https:\/\/doi.org\/10.1186\/2192-1962-3-22","relation":{},"ISSN":["2192-1962"],"issn-type":[{"type":"electronic","value":"2192-1962"}],"subject":[],"published":{"date-parts":[[2013,12]]},"assertion":[{"value":"16 May 2013","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 December 2013","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 December 2013","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"22"}}