{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T22:59:36Z","timestamp":1775084376912,"version":"3.50.1"},"publisher-location":"Cham","reference-count":40,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783032223746","type":"print"},{"value":"9783032223753","type":"electronic"}],"license":[{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T00:00:00Z","timestamp":1775001600000},"content-version":"vor","delay-in-days":90,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>User involvement is essential for aligning software systems with organizational needs in agile development; however, achieving meaningful engagement becomes challenging in large-scale settings. Large organizations may contain distributed teams and diverse user groups whose limited availability and unfamiliarity with agile practices hinder sustained involvement. Although participatory and user-centered approaches work in smaller contexts, they are challenging to scale, leaving a gap in how to organize user involvement across dispersed organizations and multiple development teams. To address this gap, the present study examines pilot testing in a large-scale agile environment. Drawing on a qualitative case study of a Norwegian public organization, based on interviews with 35 participants from development and user groups, the study defines iterative pilot testing as a scalable practice in which unfinished yet operational solutions are refined gradually through user involvement when functionality is novel or complex. The study demonstrates how this practice can make development work more visible, enable development teams to be closer to their users and their work practices, and facilitate teams in navigating cultural and functional differences, thereby strengthening user involvement in large-scale agile software development.<\/jats:p>","DOI":"10.1007\/978-3-032-22375-3_14","type":"book-chapter","created":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T04:16:17Z","timestamp":1774930577000},"page":"228-243","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Iterative Pilot Testing as a Scalable User Involvement Practice in Large-Scale Agile Software Development"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7489-4583","authenticated-orcid":false,"given":"Morteza","family":"Moalagh","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,4,1]]},"reference":[{"issue":"5","key":"14_CR1","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1016\/j.infsof.2010.10.009","volume":"53","author":"R Hoda","year":"2011","unstructured":"Hoda, R., Noble, J., Marshall, S.: The impact of inadequate customer collaboration on self-organizing Agile teams. Inf. Softw. Technol. 53(5), 521\u2013534 (2011). https:\/\/doi.org\/10.1016\/j.infsof.2010.10.009","journal-title":"Inf. Softw. Technol."},{"key":"14_CR2","doi-asserted-by":"publisher","unstructured":"Schon, E.M., Winter, D., Escalona, M.J., Thomaschewski, J. (eds.): Key challenges in agile requirements engineering. Presented at the Agile Processes in Software Engineering and Extreme Programming (XP 2017), Cologne, Germany. Springer (2017). https:\/\/doi.org\/10.1007\/978-3-319-57633-6","DOI":"10.1007\/978-3-319-57633-6"},{"key":"14_CR3","doi-asserted-by":"crossref","unstructured":"Hansson, C., Dittrich, Y., Randall, D.: Agile processes enhancing user participation for small providers of off-the-shelf software. In: Eckstein, J., Baumeister, H., LINK (Online service) (eds.) Extreme programming and agile processes in software engineering: 5th international conference, XP 2004, Garmisch-Partenkirchen, Germany. LNCS, vol. 3092. Springer (2004)","DOI":"10.1007\/978-3-540-24853-8_20"},{"key":"14_CR4","unstructured":"Mikalsen, M., Moe, N.B., Wong, S.I., Stray, V.: Agile information system development organizations transforming to large-scale collaboration. In: Proceedings of the Forty-Second International Conference on Information Systems (ICIS 2021), Austin, USA (2021)"},{"key":"14_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2024.107432","volume":"170","author":"L Barros","year":"2024","unstructured":"Barros, L., Tam, C., Varaj\u00e3o, J.: Agile software development projects\u2013Unveiling the human-related critical success factors. Inf. Softw. Technol. 170, 107432 (2024). https:\/\/doi.org\/10.1016\/j.infsof.2024.107432","journal-title":"Inf. Softw. Technol."},{"key":"14_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2021.106718","volume":"141","author":"M Zorzetti","year":"2022","unstructured":"Zorzetti, M., Signoretti, I., Salerno, L., Marczak, S., Bastos, R.: Improving agile software development using user-centered design and lean startup. Inf. Softw. Technol. 141, 106718 (2022). https:\/\/doi.org\/10.1016\/j.infsof.2021.106718","journal-title":"Inf. Softw. Technol."},{"key":"14_CR7","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/j.jss.2016.06.013","volume":"119","author":"K Dikert","year":"2016","unstructured":"Dikert, K., Paasivaara, M., Lassenius, C.: Challenges and success factors for large-scale agile transformations: a systematic literature review. J. Syst. Softw. 119, 87\u2013108 (2016). https:\/\/doi.org\/10.1016\/j.jss.2016.06.013","journal-title":"J. Syst. Softw."},{"issue":"3","key":"14_CR8","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/j.ijproman.2020.02.001","volume":"38","author":"C Tam","year":"2020","unstructured":"Tam, C., Moura, E.J.D.C., Oliveira, T., Varaj\u00e3o, J.: The factors influencing the success of on-going agile software development projects. Int. J. Project Manage. 38(3), 165\u2013176 (2020). https:\/\/doi.org\/10.1016\/j.ijproman.2020.02.001","journal-title":"Int. J. Project Manage."},{"key":"14_CR9","doi-asserted-by":"publisher","unstructured":"Moalagh, M., Svesengen, V., Farshchian, B.A., Mikalsen, M.: user involvement in relational digital transformation: a case study of agile software development practices in a large organization. Presented at the 33rd International Conference on Information Systems Development (ISD 2025), Belgrade, Serbia. AIS (2025). https:\/\/doi.org\/10.62036\/ISD.2025.30","DOI":"10.62036\/ISD.2025.30"},{"key":"14_CR10","doi-asserted-by":"publisher","unstructured":"Hertzum, M., Bansler, J.P., Havn, E.C., Simonsen, J.: Pilot implementation: learning from field tests in is development. In: CAIS, vol. 30 (2012). https:\/\/doi.org\/10.17705\/1CAIS.03020","DOI":"10.17705\/1CAIS.03020"},{"issue":"4","key":"14_CR11","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1007\/s10606-019-09369-6","volume":"29","author":"T M\u00f8nsted","year":"2020","unstructured":"M\u00f8nsted, T., Hertzum, M., S\u00f8ndergaard, J.: A socio-temporal perspective on pilot implementation: bootstrapping preventive care. Comput. Support. Coop. Work (CSCW) 29(4), 419\u2013449 (2020). https:\/\/doi.org\/10.1007\/s10606-019-09369-6","journal-title":"Comput. Support. Coop. Work (CSCW)"},{"issue":"12","key":"14_CR12","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1145\/1323688.1323694","volume":"50","author":"EL Wagner","year":"2007","unstructured":"Wagner, E.L., Piccoli, G.: Moving beyond user participation to achieve successful IS design. Commun. ACM 50(12), 51\u201355 (2007). https:\/\/doi.org\/10.1145\/1323688.1323694","journal-title":"Commun. ACM"},{"issue":"2","key":"14_CR13","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1177\/1460458217712058","volume":"25","author":"M Hertzum","year":"2019","unstructured":"Hertzum, M., Manikas, M.I., Torkilsheyggi, A.\u00c1.: Grappling with the future: the messiness of pilot implementation in information systems design. Health Informatics J. 25(2), 372\u2013388 (2019). https:\/\/doi.org\/10.1177\/1460458217712058","journal-title":"Health Informatics J."},{"key":"14_CR14","doi-asserted-by":"crossref","unstructured":"Bakke, S., Bratteteig, T.: The closer the better: effects of developer-user proximity for mutual learning. In: 17th International Conference, HCI International 2015, Los Angeles, CA, USA. Springer (2015)","DOI":"10.1007\/978-3-319-20901-2_2"},{"key":"14_CR15","doi-asserted-by":"publisher","unstructured":"Chakraborty, S., Sarker, S., Sarker, S.: An exploration into the process of requirements elicitation: a grounded approach. JAIS 11(4), 212\u2013249 (2010). https:\/\/doi.org\/10.17705\/1jais.00225","DOI":"10.17705\/1jais.00225"},{"key":"14_CR16","doi-asserted-by":"publisher","unstructured":"Alahyari, H., Berntsson Svensson, R., Gorschek, T.: A study of value in agile software development organizations. J. Syst. Soft. 125, 271\u2013288 (2017). https:\/\/doi.org\/10.1016\/j.jss.2016.12.007","DOI":"10.1016\/j.jss.2016.12.007"},{"issue":"1","key":"14_CR17","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1109\/TEM.2020.3030172","volume":"69","author":"E Kim","year":"2022","unstructured":"Kim, E., et al.: User-centered design roadmapping: anchoring roadmapping in customer value before technology selection. IEEE Trans. Eng. Manage. 69(1), 109\u2013126 (2022). https:\/\/doi.org\/10.1109\/TEM.2020.3030172","journal-title":"IEEE Trans. Eng. Manage."},{"issue":"10","key":"14_CR18","doi-asserted-by":"publisher","first-page":"16","DOI":"10.5120\/21262-3533","volume":"120","author":"P Pandit","year":"2015","unstructured":"Pandit, P., Tahiliani, S.: AgileUAT: a framework for user acceptance testing based on user stories and acceptance criteria. IJCA 120(10), 16\u201321 (2015). https:\/\/doi.org\/10.5120\/21262-3533","journal-title":"IJCA"},{"key":"14_CR19","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1016\/j.jss.2017.01.002","volume":"133","author":"I Otaduy","year":"2017","unstructured":"Otaduy, I., Diaz, O.: User acceptance testing for Agile-developed web-based applications: empowering customers through wikis and mind maps. J. Syst. Softw. 133, 212\u2013229 (2017). https:\/\/doi.org\/10.1016\/j.jss.2017.01.002","journal-title":"J. Syst. Softw."},{"key":"14_CR20","doi-asserted-by":"publisher","unstructured":"Obermueller, M., Eckhardt, A., Reibenspiess, V., Blossey, G., Kollmer, T.: How the perception of agile software development affects beta users\u2019 stress and satisfaction. Presented at the Hawaii International Conference on System Sciences (2023). https:\/\/doi.org\/10.24251\/HICSS.2023.787","DOI":"10.24251\/HICSS.2023.787"},{"key":"14_CR21","doi-asserted-by":"publisher","unstructured":"Berntzen, M., Alette Engdal, S., Gellein, M., Brede Moe, N. (eds.): Coordination in agile product areas: a case study from a large FinTech organization. In: Proceedings of the 25th International Conference on Agile Software Development XP 2024. LNBI, Bolzano, Italy, vol. 512. Springer, Cham (2024). https:\/\/doi.org\/10.1007\/978-3-031-61154-4_3","DOI":"10.1007\/978-3-031-61154-4_3"},{"issue":"3","key":"14_CR22","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1007\/s10664-024-10557-2","volume":"30","author":"A Tkalich","year":"2025","unstructured":"Tkalich, A., Klotins, E., Sporsem, T., Stray, V., Moe, N.B., Barbala, A.: User feedback in continuous software engineering: revealing the state-of-practice. Empir. Software Eng. 30(3), 79 (2025). https:\/\/doi.org\/10.1007\/s10664-024-10557-2","journal-title":"Empir. Software Eng."},{"issue":"2","key":"14_CR23","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1109\/MS.2018.2884884","volume":"36","author":"T Dingsoeyr","year":"2019","unstructured":"Dingsoeyr, T., Falessi, D., Power, K.: Agile development at scale: the next frontier. IEEE Softw. 36(2), 30\u201338 (2019). https:\/\/doi.org\/10.1109\/MS.2018.2884884","journal-title":"IEEE Softw."},{"issue":"5","key":"14_CR24","doi-asserted-by":"publisher","first-page":"2550","DOI":"10.1007\/s10664-017-9555-8","volume":"23","author":"M Paasivaara","year":"2018","unstructured":"Paasivaara, M., Behm, B., Lassenius, C., Hallikainen, M.: Large-scale agile transformation at Ericsson: a case study. Empir. Software Eng. 23(5), 2550\u20132596 (2018). https:\/\/doi.org\/10.1007\/s10664-017-9555-8","journal-title":"Empir. Software Eng."},{"key":"14_CR25","doi-asserted-by":"publisher","unstructured":"Edison, H., Wang, X., Conboy, K.: Comparing methods for large-scale agile software development: a systematic literature review. IEEE Trans. Softw. Eng. 1 (2021). https:\/\/doi.org\/10.1109\/TSE.2021.3069039","DOI":"10.1109\/TSE.2021.3069039"},{"key":"14_CR26","doi-asserted-by":"publisher","unstructured":"Moalagh, M., Svesengen, V., Farshchian, B.A.: Investigating user-side representatives in large-scale agile software development. In: Agile Processes in Software Engineering and Extreme Programming: 26th International Conference on Agile Software Development, XP 2025, Brugg-Windisch, Switzerland, June 2\u20135, 2025, Proceedings. LNBIP, vol. 545. Springer, Cham (2025). https:\/\/doi.org\/10.1007\/978-3-031-94544-1","DOI":"10.1007\/978-3-031-94544-1"},{"key":"14_CR27","doi-asserted-by":"publisher","unstructured":"Moalagh, M., Dahl-J\u00f8rgensen, T.C., Svesengen, V., Farshchian, B.A.: User representatives as boundary spanners: case study of large-scale agile software development. In: Proceedings of the 23rd EUSSET Conference on Computer Supported Cooperative Work, Newcastle upon Tyne, United Kingdom, June 30th \u2013 July 4th, 2025. European Society for Socially Embedded Technologies (EUSSET) (2025). https:\/\/doi.org\/10.48340\/ecscw2025_cp06","DOI":"10.48340\/ecscw2025_cp06"},{"issue":"1","key":"14_CR28","doi-asserted-by":"publisher","first-page":"16","DOI":"10.31284\/j.jasmet.2021.v2i1.1832","volume":"2","author":"F Almeida","year":"2021","unstructured":"Almeida, F., Espinheira, E.: Large-scale agile frameworks: a comparative review. JASMET 2(1), 16\u201329 (2021). https:\/\/doi.org\/10.31284\/j.jasmet.2021.v2i1.1832","journal-title":"JASMET"},{"key":"14_CR29","unstructured":"Savola, R.M., Fr\u00fchwirth, C., Pietik\u00e4inen, A.: Risk-Driven Security Metrics in Agile Software Development \u2013 An Industrial Pilot Study"},{"key":"14_CR30","first-page":"49","volume":"22","author":"BR Winthereik","year":"2010","unstructured":"Winthereik, B.R.: Enactments of systems development. Scand. J. Inf. Syst. 22, 49\u201364 (2010)","journal-title":"Scand. J. Inf. Syst."},{"key":"14_CR31","unstructured":"Yin, R.K.: Designing case studies. In: Qualitative Research Methods, vol. 14 (2003)"},{"key":"14_CR32","doi-asserted-by":"crossref","unstructured":"Oates, B.J., Marie, G., Rachel, M.: Researching Information Systems and Computing. SAGE Publications, London (2022)","DOI":"10.4135\/9781036231330"},{"key":"14_CR33","doi-asserted-by":"publisher","DOI":"10.46743\/2160-3715\/2014.1008","author":"S Ba\u0161karada","year":"2014","unstructured":"Ba\u0161karada, S.: Qualitative case study guidelines. TQR (2014). https:\/\/doi.org\/10.46743\/2160-3715\/2014.1008","journal-title":"TQR"},{"key":"14_CR34","unstructured":"NAV: What is NAV? (2025). https:\/\/www.nav.no\/hva-er-nav\/en"},{"key":"14_CR35","unstructured":"NAV IT: NAV IT. https:\/\/www.detsombetyrnoe.no\/"},{"key":"14_CR36","doi-asserted-by":"publisher","unstructured":"Bernhardt, H.B.: Digital transformation in NAV IT 2016\u20132020: key factors for the journey of change. In: Digital Transformation in Norwegian Enterprises, 1st edn, pp. 115\u2013134. Springer (2022). https:\/\/doi.org\/10.1007\/978-3-031-05276-7","DOI":"10.1007\/978-3-031-05276-7"},{"key":"14_CR37","doi-asserted-by":"publisher","unstructured":"Mohagheghi, P., Lassenius, C.: Organizational implications of agile adoption: a case study from the public sector. In: Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Athens, Greece, pp. 1444\u20131454. ACM (2021). https:\/\/doi.org\/10.1145\/3468264.3473937","DOI":"10.1145\/3468264.3473937"},{"key":"14_CR38","doi-asserted-by":"publisher","unstructured":"Moalagh, M., Mikalsen, M., Farshchian, B.A.: Are team autonomy and flexibility enough for agile transformation? A review of transformed practices in a public sector organization. In: Proceedings of ECSCW 2023, Trondheim, Norway. EUSSET Digital Library (2023). https:\/\/doi.org\/10.48340\/ECSCW2023_EP08","DOI":"10.48340\/ECSCW2023_EP08"},{"key":"14_CR39","unstructured":"Urquhart, C.: Grounded Theory for Qualitative Research: A Practical Guide. SAGE Publications (2022)"},{"key":"14_CR40","unstructured":"Strauss, A.L., Corbin, J.: Open coding. Social research methods: a reader. In: Social Research Methods: A Reader, pp. 303\u2013306. Routledge, New York (2004)"}],"container-title":["Lecture Notes in Business Information Processing","Agile Processes in Software Engineering and Extreme Programming"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-032-22375-3_14","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T22:07:47Z","timestamp":1775081267000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-032-22375-3_14"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026]]},"ISBN":["9783032223746","9783032223753"],"references-count":40,"URL":"https:\/\/doi.org\/10.1007\/978-3-032-22375-3_14","relation":{},"ISSN":["1865-1348","1865-1356"],"issn-type":[{"value":"1865-1348","type":"print"},{"value":"1865-1356","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026]]},"assertion":[{"value":"1 April 2026","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"XP","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Agile Software Development","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"S\u00e3o Paulo","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Brazil","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2026","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"8 April 2026","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"11 April 2026","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"27","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"xpu2026","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/agilealliance.org\/event\/xp-2026\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}