{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T23:48:01Z","timestamp":1773186481388,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,4,16]],"date-time":"2024-04-16T00:00:00Z","timestamp":1713225600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,4,16]]},"DOI":"10.1145\/3643664.3648212","type":"proceedings-article","created":{"date-parts":[[2024,8,9]],"date-time":"2024-08-09T15:48:13Z","timestamp":1723218493000},"page":"58-63","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Hidden Populations in Software Engineering: Challenges, Lessons Learned, and Opportunities"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3235-6530","authenticated-orcid":false,"given":"Ronnie","family":"De Souza Santos","sequence":"first","affiliation":[{"name":"University of Calgary, Calgary, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1508-6196","authenticated-orcid":false,"given":"Kiev","family":"Gama","sequence":"additional","affiliation":[{"name":"UFPE, Recife, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2024,8,9]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Understanding Women's Entrepreneurship in a Gendered Context","author":"Al-Dajani Haya","unstructured":"Haya Al-Dajani, Hammad Akbar, Sara Carter, and Eleanor Shaw. 2021. Defying contextual embeddedness: evidence from displaced women entrepreneurs in Jordan. In Understanding Women's Entrepreneurship in a Gendered Context. Routledge, 32--46."},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the 40th international conference on software engineering: companion proceeedings. 344--345","author":"Amir Bilal","year":"2018","unstructured":"Bilal Amir and Paul Ralph. 2018. There is no random sampling in software engineering research. In Proceedings of the 40th international conference on software engineering: companion proceeedings. 344--345."},{"key":"e_1_3_2_1_3_1","volume-title":"Accessing hidden and hard-to-reach populations: Snowball research strategies. Social research update 33, 1","author":"Atkinson Rowland","year":"2001","unstructured":"Rowland Atkinson and John Flint. 2001. Accessing hidden and hard-to-reach populations: Snowball research strategies. Social research update 33, 1 (2001), 1--4."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1007\/s10664-021-10072-8","article-title":"Sampling in software engineering research: A critical review and guidelines","volume":"27","author":"Baltes Sebastian","year":"2022","unstructured":"Sebastian Baltes and Paul Ralph. 2022. Sampling in software engineering research: A critical review and guidelines. Empirical Software Engineering 27, 4 (2022), 94.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_2_1_5_1","volume-title":"Hidden populations, online purposive sampling, and external validity: Taking off the blindfold. Field methods 27, 1","author":"Barratt Monica J","year":"2015","unstructured":"Monica J Barratt, Jason A Ferris, and Simon Lenton. 2015. Hidden populations, online purposive sampling, and external validity: Taking off the blindfold. Field methods 27, 1 (2015), 3--21."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1177\/0022343311405698","article-title":"Field research in conflict environments: Methodological challenges and snowball sampling","volume":"48","author":"Cohen Nissim","year":"2011","unstructured":"Nissim Cohen and Tamar Arieli. 2011. Field research in conflict environments: Methodological challenges and snowball sampling. Journal of peace research 48, 4 (2011), 423--435.","journal-title":"Journal of peace research"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1080\/01621459.2017.1285775","article-title":"Hidden population size estimation from respondent-driven sampling: a network approach","volume":"113","author":"Crawford Forrest W","year":"2018","unstructured":"Forrest W Crawford, Jiacheng Wu, and Robert Heimer. 2018. Hidden population size estimation from respondent-driven sampling: a network approach. J. Amer. Statist. Assoc. 113, 522 (2018), 755--766.","journal-title":"J. Amer. Statist. Assoc."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/her\/cyp062","article-title":"Balancing rigor against the inherent limitations of investigating hard-to-reach populations","volume":"25","author":"Crosby Richard A","year":"2010","unstructured":"Richard A Crosby, Laura F Salazar, Ralph J DiClemente, and Delia L Lang. 2010. Balancing rigor against the inherent limitations of investigating hard-to-reach populations. Health Education Research 25, 1 (2010), 1--5.","journal-title":"Health Education Research"},{"key":"e_1_3_2_1_9_1","volume-title":"Sampling rare populations. Nurse researcher 15, 4","author":"Dawood Mary","year":"2008","unstructured":"Mary Dawood. 2008. Sampling rare populations. Nurse researcher 15, 4 (2008)."},{"key":"e_1_3_2_1_10_1","first-page":"1","article-title":"Investigating probabilistic sampling approaches for large-scale surveys in software engineering","volume":"3","author":"de Mello Rafael Maiani","year":"2015","unstructured":"Rafael Maiani de Mello, Pedro Corr\u011ba Da Silva, and Guilherme Horta Travassos. 2015. Investigating probabilistic sampling approaches for large-scale surveys in software engineering. Journal of Software Engineering Research and Development 3, 1 (2015), 1--26.","journal-title":"Journal of Software Engineering Research and Development"},{"key":"e_1_3_2_1_11_1","volume-title":"Cleyton Magalh\u00e3es, and Rodrigo Souza.","author":"de Souza Santos Ronnie","year":"2023","unstructured":"Ronnie de Souza Santos, Luiz Fernando Capretz, Cleyton Magalh\u00e3es, and Rodrigo Souza. 2023. Myths and Facts about a Career in Software Testing: A Comparison between Students' Beliefs and Professionals' Experience. IEEE Software (2023)."},{"key":"e_1_3_2_1_12_1","volume-title":"2023 IEEE\/ACM 45th International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS). IEEE, 48--57","author":"de Souza Santos Ronnie","year":"2023","unstructured":"Ronnie de Souza Santos, Cleyton VC de Magalhaes, and Paul Ralph. 2023. Benefits and limitations of remote work to LGBTQIA+ software professionals. In 2023 IEEE\/ACM 45th International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS). IEEE, 48--57."},{"key":"e_1_3_2_1_13_1","volume-title":"What do Transgender Software Professionals say about a Career in the Software Industry? IEEE Software","author":"de Souza Santos Ronnie","year":"2023","unstructured":"Ronnie de Souza Santos, Brody Stuart-Verner, and Cleyton Magalh\u00e3es. 2023. What do Transgender Software Professionals say about a Career in the Software Industry? IEEE Software (2023)."},{"key":"e_1_3_2_1_14_1","volume-title":"Whistleblowing and Tech on Twitter. In 2023 IEEE\/ACM 20th International Conference on Mining Software Repositories (MSR). IEEE, 296--308","author":"Duits Laura","year":"2023","unstructured":"Laura Duits, Isha Kashyap, Joey Bekkink, Kousar Aslam, and Emitz\u00e1 Guzm\u00e1n. 2023. Whistleblowing and Tech on Twitter. In 2023 IEEE\/ACM 20th International Conference on Mining Software Repositories (MSR). IEEE, 296--308."},{"key":"e_1_3_2_1_15_1","volume-title":"Selecting empirical methods for software engineering research. Guide to advanced empirical software engineering","author":"Easterbrook Steve","year":"2008","unstructured":"Steve Easterbrook, Janice Singer, Margaret-Anne Storey, and Daniela Damian. 2008. Selecting empirical methods for software engineering research. Guide to advanced empirical software engineering (2008), 285--311."},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the 44th International Conference on Software Engineering. 1107--1119","author":"Endres Madeline","year":"2022","unstructured":"Madeline Endres, Kevin Boehnke, and Westley Weimer. 2022. Hashing it out: a survey of programmers' cannabis usage, perception, and motivation. In Proceedings of the 44th International Conference on Software Engineering. 1107--1119."},{"key":"e_1_3_2_1_17_1","volume-title":"Non-binary and Genderqueer Genders","author":"Fiani Chassitty N","unstructured":"Chassitty N Fiani and Heather J Han. 2020. Navigating identity: Experiences of binary and non-binary transgender and gender non-conforming (TGNC) adults. In Non-binary and Genderqueer Genders. Routledge, 63--76."},{"key":"e_1_3_2_1_18_1","volume-title":"2019 IEEE\/ACM 2nd International Workshop on Gender Equality in Software Engineering (GE). IEEE, 9--12","author":"Ford Denae","year":"2019","unstructured":"Denae Ford, Reed Milewicz, and Alexander Serebrenik. 2019. How remote work can foster a more inclusive environment for transgender developers. In 2019 IEEE\/ACM 2nd International Workshop on Gender Equality in Software Engineering (GE). IEEE, 9--12."},{"key":"e_1_3_2_1_19_1","volume-title":"2023 IEEE\/ACM 45th International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS). IEEE, 58--70","author":"Gama Kiev","year":"2023","unstructured":"Kiev Gama, George Valen\u00e7a, Candy Estelle Marques Laurendon, \u00c1j\u00f3 Nasidi Marques, Lu\u00eds Eduardo Ramos, Ravena Amaral, Clarissa Maria Dubeux Lopes Barros, and Guilherme Xavier. 2023. Hackathons as Inclusive Spaces for Prototyping Software in Open Social Innovation with NGOs. In 2023 IEEE\/ACM 45th International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS). IEEE, 58--70."},{"key":"e_1_3_2_1_20_1","unstructured":"Michael Gold. 2018. The ABCs of L.G.B.T.Q.I.A.+ . (2018). https:\/\/www.nytimes.com\/2018\/06\/21\/style\/lgbtq-gender-language.html"},{"key":"e_1_3_2_1_21_1","volume-title":"Estimating hidden population size using respondent-driven sampling data. Electronic journal of statistics 8, 1","author":"Handcock Mark S","year":"2014","unstructured":"Mark S Handcock, Krista J Gile, and Corinne M Mar. 2014. Estimating hidden population size using respondent-driven sampling data. Electronic journal of statistics 8, 1 (2014), 1491."},{"key":"e_1_3_2_1_22_1","volume-title":"Respondent-driven sampling: a new approach to the study of hidden populations. Social problems 44, 2","author":"Heckathorn Douglas D","year":"1997","unstructured":"Douglas D Heckathorn. 1997. Respondent-driven sampling: a new approach to the study of hidden populations. Social problems 44, 2 (1997), 174--199."},{"key":"e_1_3_2_1_23_1","volume-title":"Respondent-driven sampling II: deriving valid population estimates from chain-referral samples of hidden populations. Social problems 49, 1","author":"Heckathorn Douglas D","year":"2002","unstructured":"Douglas D Heckathorn. 2002. Respondent-driven sampling II: deriving valid population estimates from chain-referral samples of hidden populations. Social problems 49, 1 (2002), 11--34."},{"key":"e_1_3_2_1_24_1","volume-title":"Sample sizes for saturation in qualitative research: A systematic review of empirical tests. Social science & medicine 292","author":"Hennink Monique","year":"2022","unstructured":"Monique Hennink and Bonnie N Kaiser. 2022. Sample sizes for saturation in qualitative research: A systematic review of empirical tests. Social science & medicine 292 (2022), 114523."},{"key":"e_1_3_2_1_25_1","volume-title":"Practical sampling","author":"Henry Gary T","unstructured":"Gary T Henry. 1990. Practical sampling. Vol. 21. Sage."},{"key":"e_1_3_2_1_27_1","first-page":"1","article-title":"Decision tree Thompson sampling for mining hidden populations through attributed search","volume":"12","author":"Kumar Suhansanu","year":"2022","unstructured":"Suhansanu Kumar, Heting Gao, Changyu Wang, Kevin Chen-Chuan Chang, and Hari Sundaram. 2022. Decision tree Thompson sampling for mining hidden populations through attributed search. Social Network Analysis and Mining 12 (2022), 1--21.","journal-title":"Social Network Analysis and Mining"},{"key":"e_1_3_2_1_28_1","article-title":"Balancing Efficiency and Flexibility in Software Project: The Role of Team Collective Improvisation, behavioral integration, and member diversity","volume":"16","author":"Lee Young-Joo","year":"2017","unstructured":"Young-Joo Lee, Jung-Hoon Lee, and Kyung Sun Ham. 2017. Balancing Efficiency and Flexibility in Software Project: The Role of Team Collective Improvisation, behavioral integration, and member diversity. Journal of Contemporary Eastern Asia 16, 1 (2017).","journal-title":"Journal of Contemporary Eastern Asia"},{"key":"e_1_3_2_1_29_1","volume-title":"Guilherme Pires Garcia, Sildemir S da Silva, Cesar Franca, and Luiz Fernando Capretz.","author":"Lima Danilo Leandro","year":"2023","unstructured":"Danilo Leandro Lima, Ronnie de Souza Santos, Guilherme Pires Garcia, Sildemir S da Silva, Cesar Franca, and Luiz Fernando Capretz. 2023. Software Testing and Code Refactoring: A Survey with Practitioners. (2023)."},{"key":"e_1_3_2_1_30_1","volume-title":"Proceedings of the 38th international conference on software engineering. 237--248","author":"Manotas Irene","year":"2016","unstructured":"Irene Manotas, Christian Bird, Rui Zhang, David Shepherd, Ciera Jaspan, Caitlin Sadowski, Lori Pollock, and James Clause. 2016. An empirical study of practitioners' perspectives on green software engineering. In Proceedings of the 38th international conference on software engineering. 237--248."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1016\/S0140-6736(21)02806-3","article-title":"Research on transgender people must benefit transgender people","volume":"399","author":"Minalga Brian","year":"2022","unstructured":"Brian Minalga, Cecilia Chung, JD Davids, Aleks Martin, Nicole Lynn Perry, and Alic Shook. 2022. Research on transgender people must benefit transgender people. The Lancet 399, 10325 (2022), 628.","journal-title":"The Lancet"},{"key":"e_1_3_2_1_33_1","volume-title":"2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). IEEE, 665--677","author":"Newman Kaia","year":"2023","unstructured":"Kaia Newman, Madeline Endres, Westley Weimer, and Brittany Johnson. 2023. From Organizations to Individuals: Psychoactive Substance Use By Professional Programmers. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). IEEE, 665--677."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MS.2020.3044205","article-title":"How trans-inclusive are hackathons","volume":"38","author":"Prado Rafa","year":"2020","unstructured":"Rafa Prado, Wendy Mendes, Kiev S Gama, and Gustavo Pinto. 2020. How trans-inclusive are hackathons? IEEE Software 38, 2 (2020), 26--31.","journal-title":"IEEE Software"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1007\/s11524-018-0316-9","article-title":"Starfish sampling\": a novel, hybrid approach to recruiting hidden populations","volume":"96","author":"Raymond H Fisher","year":"2019","unstructured":"H Fisher Raymond, Yea-Hung Chen, and Willi McFarland. 2019. \"Starfish sampling\": a novel, hybrid approach to recruiting hidden populations. Journal of Urban Health 96 (2019), 55--62.","journal-title":"Journal of Urban Health"},{"key":"e_1_3_2_1_36_1","volume-title":"Sampling and estimation in hidden populations using respondent-driven sampling. Sociological methodology 34, 1","author":"Salganik Matthew J","year":"2004","unstructured":"Matthew J Salganik and Douglas D Heckathorn. 2004. 5. Sampling and estimation in hidden populations using respondent-driven sampling. Sociological methodology 34, 1 (2004), 193--240."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1177\/075910639203600103","article-title":"Rare populations, hidden populations, and link-tracing designs: what and why","volume":"36","author":"Spreen Marinus","year":"1992","unstructured":"Marinus Spreen. 1992. Rare populations, hidden populations, and link-tracing designs: what and why? Bulletin of Sociological Methodology\/Bulletin de Methodologie Sociologique 36, 1 (1992), 34--58.","journal-title":"Bulletin of Sociological Methodology\/Bulletin de Methodologie Sociologique"},{"key":"e_1_3_2_1_38_1","volume-title":"Estimating the size of hidden populations: A Bayesian approach. Department of Statistics","author":"Tallberg Christian","year":"2003","unstructured":"Christian Tallberg. 2003. Estimating the size of hidden populations: A Bayesian approach. Department of Statistics, Stockholm University (2003)."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1086\/598499","article-title":"Estimating population size and hidden demographic parameters with state-space modeling","volume":"173","author":"Tavecchia Giacomo","year":"2009","unstructured":"Giacomo Tavecchia, Panagiotis Besbeas, Tim Coulson, Byron JT Morgan, and Tim H Clutton-Brock. 2009. Estimating population size and hidden demographic parameters with state-space modeling. The American Naturalist 173, 6 (2009), 722--733.","journal-title":"The American Naturalist"},{"key":"e_1_3_2_1_40_1","volume-title":"Research methods knowledge base","author":"Trochim William MK","unstructured":"William MK Trochim and James P Donnelly. 2001. Research methods knowledge base. Vol. 2. Atomic Dog Pub. Macmillan Publishing Company, New York."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1080\/19419899.2018.1434558","article-title":"Studying trans: Recommendations for ethical recruitment and collaboration with transgender participants in academic research","volume":"9","author":"Vincent Benjamin William","year":"2018","unstructured":"Benjamin William Vincent. 2018. Studying trans: Recommendations for ethical recruitment and collaboration with transgender participants in academic research. Psychology & Sexuality 9, 2 (2018), 102--116.","journal-title":"Psychology & Sexuality"},{"key":"e_1_3_2_1_42_1","volume-title":"Targeted sampling: Options for the study of hidden populations. Social problems 36, 4","author":"Watters John K","year":"1989","unstructured":"John K Watters and Patrick Biernacki. 1989. Targeted sampling: Options for the study of hidden populations. Social problems 36, 4 (1989), 416--430."},{"key":"e_1_3_2_1_43_1","first-page":"4","article-title":"Identifying and gaining access to hidden populations","volume":"98","author":"Wayne W","year":"1976","unstructured":"W Wayne. 1976. Identifying and gaining access to hidden populations. NIDA Research Monograph 98 (1976), 4.","journal-title":"NIDA Research Monograph"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1177\/0049124108318333","article-title":"Web-based network sampling: efficiency and efficacy of respondent-driven sampling for online research","volume":"37","author":"Wejnert Cyprian","year":"2008","unstructured":"Cyprian Wejnert and Douglas D Heckathorn. 2008. Web-based network sampling: efficiency and efficacy of respondent-driven sampling for online research. Sociological Methods & Research 37, 1 (2008), 105--134.","journal-title":"Sociological Methods & Research"},{"key":"e_1_3_2_1_45_1","first-page":"1","article-title":"Self-admitted technical debt practices: a comparison between industry and open-source","volume":"26","author":"Zampetti Fiorella","year":"2021","unstructured":"Fiorella Zampetti, Gianmarco Fucci, Alexander Serebrenik, and Massimiliano Di Penta. 2021. Self-admitted technical debt practices: a comparison between industry and open-source. Empirical Software Engineering 26 (2021), 1--32.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3571854","article-title":"Continuous integration and delivery practices for cyber-physical systems: An interview-based study","volume":"32","author":"Zampetti Fiorella","year":"2023","unstructured":"Fiorella Zampetti, Damian Tamburri, Sebastiano Panichella, Annibale Panichella, Gerardo Canfora, and Massimiliano Di Penta. 2023. Continuous integration and delivery practices for cyber-physical systems: An interview-based study. ACM Transactions on Software Engineering and Methodology 32, 3 (2023), 1--44.","journal-title":"ACM Transactions on Software Engineering and Methodology"}],"event":{"name":"WSESE '24: 1st IEEE\/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering","location":"Lisbon Portugal","acronym":"WSESE '24","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS","Faculty of Engineering of University of Porto"]},"container-title":["Proceedings of the 1st IEEE\/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3643664.3648212","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3643664.3648212","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:05:32Z","timestamp":1750291532000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3643664.3648212"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,16]]},"references-count":44,"alternative-id":["10.1145\/3643664.3648212","10.1145\/3643664"],"URL":"https:\/\/doi.org\/10.1145\/3643664.3648212","relation":{},"subject":[],"published":{"date-parts":[[2024,4,16]]},"assertion":[{"value":"2024-08-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}