{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,26]],"date-time":"2026-07-26T01:31:30Z","timestamp":1785029490947,"version":"3.55.0"},"reference-count":68,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,1,21]],"date-time":"2022-01-21T00:00:00Z","timestamp":1642723200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,21]],"date-time":"2022-01-21T00:00:00Z","timestamp":1642723200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005367","name":"Universidad Nacional de Educaci\u00f3n a Distancia","doi-asserted-by":"publisher","award":["OPTIVAC 096-034091 2021V\/PUNED\/008"],"award-info":[{"award-number":["OPTIVAC 096-034091 2021V\/PUNED\/008"]}],"id":[{"id":"10.13039\/501100005367","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u2019on y Universidades","doi-asserted-by":"publisher","award":["OPHELIA RTI2018-101204-B-C22"],"award-info":[{"award-number":["OPHELIA RTI2018-101204-B-C22"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["TASOVA TIN2017-90644-REDT"],"award-info":[{"award-number":["TASOVA TIN2017-90644-REDT"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012818","name":"Comunidad de Madrid","doi-asserted-by":"publisher","award":["ROBOCITY2030-DIH-CM S2018\/NMT-4331"],"award-info":[{"award-number":["ROBOCITY2030-DIH-CM S2018\/NMT-4331"]}],"id":[{"id":"10.13039\/100012818","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011011","name":"Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["METAMORFOSIS project"],"award-info":[{"award-number":["METAMORFOSIS project"]}],"id":[{"id":"10.13039\/501100011011","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Universidad Nacional de Educacion Distancia"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Many analyses on configurable software systems are intractable when confronted with colossal and highly-constrained configuration spaces. These analyses could instead use statistical inference, where a tractable sample accurately predicts results for the entire space. To do so, the laws of statistical inference requires each member of the population to be equally likely to be included in the sample, i.e., the sampling process needs to be \u201cuniform\u201d. SAT-samplers have been developed to generate uniform random samples at a reasonable computational cost. However, there is a lack of experimental validation over colossal spaces to show whether the samplers indeed produce uniform samples or not. This paper (i) proposes a new sampler named , (ii) presents a new statistical test to verify sampler uniformity, and (iii) reports the evaluation of  and five other state-of-the-art samplers: , , , , and . Our experimental results show only  satisfies both scalability and uniformity.<\/jats:p>","DOI":"10.1007\/s10664-021-10102-5","type":"journal-article","created":{"date-parts":[[2022,1,21]],"date-time":"2022-01-21T09:04:06Z","timestamp":1642755846000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Uniform and scalable sampling of highly configurable systems"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7131-0482","authenticated-orcid":false,"given":"Ruben","family":"Heradio","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Fernandez-Amoros","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jos\u00e9 A.","family":"Galindo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Benavides","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Don","family":"Batory","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,1,21]]},"reference":[{"key":"10102_CR1","doi-asserted-by":"crossref","unstructured":"Acher M, Perrouin G, Cordy M (2021) BUrst: a benchmarking platform for uniform random sampling techniques. In: 25th systems and software product line conference (SPLC). Leicester, United Kingdom","DOI":"10.1145\/3461002.3473070"},{"key":"10102_CR2","doi-asserted-by":"crossref","unstructured":"Achlioptas D, Hammoudeh ZS, Theodoropoulos P (2018) Fast sampling of perfectly uniform satisfying assignments. In: 21st International conference on theory and applications of satisfiability testing (SAT). Oxford, UK, pp 135\u2013147","DOI":"10.1007\/978-3-319-94144-8_9"},{"issue":"1","key":"10102_CR3","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1007\/s11219-017-9400-8","volume":"27","author":"M Alf\u00e9rez","year":"2019","unstructured":"Alf\u00e9rez M, Acher M, Galindo J, Baudry B, Benavides D (2019) Modeling variability in the video domain: language and experience report. Software Quality Journal 27(1):307\u2013347","journal-title":"Software Quality Journal"},{"key":"10102_CR4","doi-asserted-by":"crossref","unstructured":"Alves Pereira J, Acher M, Martin H, J\u00e9z\u00e9quel JM (2020) Sampling effect on performance prediction of configurable systems: A case study. In: ACM\/SPEC international conference on performance engineering (ICPE). Edmonton AB, Canada, pp 277\u2013288","DOI":"10.1145\/3358960.3379137"},{"key":"10102_CR5","doi-asserted-by":"crossref","unstructured":"Batory DS (2005) Feature models, grammars, and propositional formulas. In: 9th software product line conference (SPLC). Rennes, France, pp 7\u201320","DOI":"10.1007\/11554844_3"},{"issue":"2","key":"10102_CR6","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1006\/inco.2000.2885","volume":"163","author":"M Bellare","year":"2000","unstructured":"Bellare M, Goldreich O, Petrank E (2000) Uniform generation of NP-witnesses using an NP-oracle. Information and Computation 163(2):510\u2013526","journal-title":"Information and Computation"},{"issue":"12","key":"10102_CR7","doi-asserted-by":"publisher","first-page":"1611","DOI":"10.1109\/TSE.2013.34","volume":"39","author":"T Berger","year":"2013","unstructured":"Berger T, She S, Lotufo R, Wasowski A, Czarnecki K (2013) A study of variability models and languages in the systems software domain. IEEE Transactions on Software Engineering 39(12):1611\u20131640","journal-title":"IEEE Transactions on Software Engineering"},{"key":"10102_CR8","volume-title":"Handbook of satisfiability: Volume 185 frontiers in artificial intelligence and applications","author":"A Biere","year":"2009","unstructured":"Biere A, Heule M, van Maaren H, Walsh T (2009) Handbook of satisfiability: Volume 185 frontiers in artificial intelligence and applications. IOS Press, Amsterdam"},{"key":"10102_CR9","unstructured":"Brace KS, Rudell RL, Bryant E (1990) Variability modeling in the real: a perspective from the operating systems domain. In: IEEE\/ACM design automation conference (DAC). Orlando, Florida, USA, pp 40\u201345"},{"issue":"8","key":"10102_CR10","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1109\/TC.1986.1676819","volume":"C\u201335","author":"RE Bryant","year":"1986","unstructured":"Bryant RE (1986) Graph-based algorithms for boolean function manipulation. IEEE Transactions on Computers C\u201335(8):677\u2013691","journal-title":"IEEE Transactions on Computers"},{"key":"10102_CR11","doi-asserted-by":"crossref","unstructured":"Chakraborty S, Fremont DJ, Meel KS, Seshia SA, Vardi MY (2015) On parallel scalable uniform SAT witness generation. In: 21st international conference on tools and algorithms for the construction and analysis of systems (TACAS). London, UK, pp 304\u2013319","DOI":"10.1007\/978-3-662-46681-0_25"},{"key":"10102_CR12","doi-asserted-by":"crossref","unstructured":"Chakraborty S, Meel KS (2019) On testing of uniform samplers. In: 33rd conference on artificial intelligence (AAAI). Honolulu, Hawaii, USA, pp 7777\u20137784","DOI":"10.1609\/aaai.v33i01.33017777"},{"key":"10102_CR13","doi-asserted-by":"crossref","unstructured":"Chakraborty S, Meel KS, Vardi MY (2013) A scalable and nearly uniform generator of SAT witnesses. In: 25th international conference on computer aided verification (CAV). Saint Petersburg, Russia, pp 608\u2013623","DOI":"10.1007\/978-3-642-39799-8_40"},{"key":"10102_CR14","volume-title":"Mathematical statistics with Resampling and R","author":"LM Chihara","year":"2011","unstructured":"Chihara LM, Hesterberg TC (2011) Mathematical statistics with Resampling and R. Wiley, New York"},{"key":"10102_CR15","unstructured":"Chollet F, Allaire J (2018) Deep learning with R. Manning Publications"},{"key":"10102_CR16","volume-title":"Statistical power analysis for the behavioral sciences","author":"J Cohen","year":"1988","unstructured":"Cohen J (1988) Statistical power analysis for the behavioral sciences. Routledge, Evanston"},{"key":"10102_CR17","volume-title":"Elements of information theory","author":"TM Cover","year":"2006","unstructured":"Cover TM, Thomas JA (2006) Elements of information theory. Wiley, New York"},{"key":"10102_CR18","volume-title":"Goodness-of-fit-techniques","author":"RB D\u2019Agostino","year":"1986","unstructured":"D\u2019Agostino RB, Stephens MA (1986) Goodness-of-fit-techniques. CRC Press, Boca Raton"},{"issue":"7","key":"10102_CR19","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1145\/368273.368557","volume":"5","author":"M Davis","year":"1962","unstructured":"Davis M, Logemann G, Loveland D (1962) A machine program for Theorem-proving. Communications of the ACM 5(7):394\u2013397","journal-title":"Communications of the ACM"},{"key":"10102_CR20","doi-asserted-by":"crossref","unstructured":"van Dijk, T (2016) Sylvan: multi-core decision diagrams. Ph.D. thesis, University of Twente","DOI":"10.1007\/s10009-016-0433-2"},{"key":"10102_CR21","doi-asserted-by":"crossref","unstructured":"Dutra R, Laeufer K, Bachrach J, Sen K (2018) Efficient sampling of SAT solutions for testing. In: 40th international conference on software engineering (ICSE). ACM, New York, NY, USA, pp 549\u2013559","DOI":"10.1145\/3180155.3180248"},{"issue":"39","key":"10102_CR22","doi-asserted-by":"publisher","first-page":"175","DOI":"10.3758\/BF03193146","volume":"2","author":"F Faul","year":"2007","unstructured":"Faul F, Erdfelder E, Lang AG, Buchner A (2007) G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods 2(39):175\u2013191","journal-title":"Behavior Research Methods"},{"issue":"8","key":"10102_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/math8081253","volume":"8","author":"D Fernandez-Amoros","year":"2020","unstructured":"Fernandez-Amoros D, Bra S, Aranda-Escolastico E, Heradio R (2020) Using extended logical primitives for efficient BDD building. Mathematics 8(8):1\u201317","journal-title":"Mathematics"},{"key":"10102_CR24","doi-asserted-by":"crossref","unstructured":"Fernandez-Amoros D, Heradio R, Mayr-Dorn C, Egyed A (2019) A Kconfig translation to logic with one-way validation system. In: 23rd international systems and software product line conference (SPLC). Paris, France, pp 303\u2013308","DOI":"10.1145\/3336294.3336313"},{"key":"10102_CR25","volume-title":"Deep learning","author":"I Goodfellow","year":"2016","unstructured":"Goodfellow I, Bengio Y, Courville A (2016) Deep learning. The MIT Press, Cambridge"},{"issue":"2","key":"10102_CR26","first-page":"041,905\/1","volume":"65","author":"I Grosse","year":"2002","unstructured":"Grosse I, Bernaola-Galvan P, Carpena P, Roman-Roldan R, Oliver J, Stanley HE (2002) Analysis of symbolic sequences using the Jensen-Shannon divergence. Physical Review E 65(2):041,905\/1-0419,051\/16","journal-title":"Physical Review E"},{"issue":"3","key":"10102_CR27","doi-asserted-by":"publisher","first-page":"1826","DOI":"10.1007\/s10664-017-9573-6","volume":"23","author":"J Guo","year":"2018","unstructured":"Guo J, Yang D, Siegmund N, Apel S, Sarkar A, Valov P, Czarnecki K, Wasowski A, Yu H (2018) Data-efficient performance learning for configurable systems. Empirical Software Engineering 23(3):1826\u20131867","journal-title":"Empirical Software Engineering"},{"issue":"2","key":"10102_CR28","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1007\/s10664-018-9635-4","volume":"24","author":"A Halin","year":"2019","unstructured":"Halin A, Nuttinck A, Acher M, Devroey X, Perrouin G, Baudry B (2019) Test them all, is it worth it? Assessing configuration sampling on the JHipster Web development stack. Empirical Software Engineering 24(2):674\u2013717","journal-title":"Empirical Software Engineering"},{"key":"10102_CR29","doi-asserted-by":"crossref","unstructured":"Heradio R, Fernandez-Amoros D, Galindo JA, Benavides D (2020) Uniform and scalable SAT-sampling for configurable systems. In: 24th systems and software product line conference (SPLC). Montr\u00e9al, Canada, pp 1\u201311","DOI":"10.1145\/3382025.3414951"},{"key":"10102_CR30","doi-asserted-by":"crossref","unstructured":"Heradio R, Fernandez-Amoros D, Mayr-Dorn C, Egyed A (2019) Supporting the statistical analysis of variability models. In: 41st international conference on software engineering (ICSE). Montr\u00e9al, Canada, pp 843\u2013853","DOI":"10.1109\/ICSE.2019.00091"},{"key":"10102_CR31","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-6460-1","volume-title":"Multiprocessor system-on-Chip: Hardware design and tool integration","author":"M H\u00ebbner","year":"2011","unstructured":"H\u00ebbner M, Becker J (2011) Multiprocessor system-on-Chip: Hardware design and tool integration. Springer, New York"},{"issue":"1","key":"10102_CR32","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1007\/s10601-015-9204-z","volume":"21","author":"A Ivrii","year":"2016","unstructured":"Ivrii A, Malik S, Meel KS, Vardi MY (2016) On computing minimal independent support and its applications to sampling and counting. Constraints 21(1):41\u201358","journal-title":"Constraints"},{"key":"10102_CR33","unstructured":"Kabacoff R (2011) R in Action: Data analysis and graphics with R. Manning Publications"},{"issue":"4","key":"10102_CR34","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1109\/MS.2020.2987024","volume":"37","author":"C Kaltenecker","year":"2020","unstructured":"Kaltenecker C, Grebhahn A, Siegmund N, Apel S (2020) The interplay of sampling and machine learning for software performance prediction. IEEE Software 37(4):58\u201366","journal-title":"IEEE Software"},{"key":"10102_CR35","doi-asserted-by":"crossref","unstructured":"Kaltenecker C, Grebhahn A, Siegmund N, Guo J, Apel S (2019) Distance-based sampling of software configuration spaces. In: 41st international conference on software engineering (ICSE). Montreal, Canada, pp 1084\u20131094","DOI":"10.1109\/ICSE.2019.00112"},{"key":"10102_CR36","unstructured":"Kaplan D (2012) Statistical modeling: A fresh approach. Project Mosaic"},{"key":"10102_CR37","unstructured":"Knuth DE (2009) The art of computer programming, Volume 4, Fascicle 1: Bitwise Tricks & Techniques; Binary Decision Diagrams. Addison-Wesley Professional"},{"issue":"3","key":"10102_CR38","doi-asserted-by":"publisher","first-page":"2265","DOI":"10.1007\/s10270-018-0662-9","volume":"18","author":"S Kolesnikov","year":"2019","unstructured":"Kolesnikov S, Siegmund N, K\u00e4stner C, Grebhahn A, Apel S (2019) Tradeoffs in modeling performance of highly configurable software systems. Software & Systems Modeling 18(3):2265\u20132283","journal-title":"Software & Systems Modeling"},{"key":"10102_CR39","doi-asserted-by":"crossref","unstructured":"Krieter S (2019) Enabling efficient automated configuration generation and management. In: 23rd international systems and software product line conference (SPLC). Paris, France, pp 215\u2013221","DOI":"10.1145\/3307630.3342705"},{"key":"10102_CR40","doi-asserted-by":"crossref","unstructured":"Krieter S, Th\u00fcm T, Schulze S, Saake G, Leich T (2020) Yasa: Yet another sampling algorithm. In: 14th international working conference on variability modelling of software-intensive system (VaMoS). Magdeburg, Germany, pp 1\u201310","DOI":"10.1145\/3377024.3377042"},{"key":"10102_CR41","doi-asserted-by":"crossref","unstructured":"Krieter S, Th\u00fcm T, Schulze S, Schr\u00f6ter R, Saake G (2018) Propagating configuration decisions with modal implication graphs. In: 40th international conference on software engineering (ICSE). Gothenburg, Sweden, pp 898\u2013909","DOI":"10.1145\/3180155.3180159"},{"key":"10102_CR42","doi-asserted-by":"crossref","unstructured":"Lagniez JM, Marquis P (2017) An improved decision-DNNF compiler. In: 26th International joint conference on artificial intelligence (IJCAI). Melbourne, Australia","DOI":"10.24963\/ijcai.2017\/93"},{"issue":"863","key":"10102_CR43","first-page":"1","volume":"4","author":"D Lakens","year":"2013","unstructured":"Lakens D (2013) Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Frontiers in Psychology 4(863):1\u201312","journal-title":"Frontiers in Psychology"},{"issue":"1","key":"10102_CR44","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1109\/18.61115","volume":"37","author":"J Lin","year":"1991","unstructured":"Lin J (1991) Divergence measures based on the shannon entropy. IEEE Transactions on Information Theory 37(1):145\u2013151","journal-title":"IEEE Transactions on Information Theory"},{"key":"10102_CR45","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-58940-9","volume-title":"Algorithms and data structures in VLSI design: OBDD - foundations and applications","author":"C Meinel","year":"1998","unstructured":"Meinel C, Theobald T (1998) Algorithms and data structures in VLSI design: OBDD - foundations and applications. Springer, New York"},{"key":"10102_CR46","doi-asserted-by":"crossref","unstructured":"Mendon\u00e7a, M (2009) Efficient reasoning techniques for large scale feature models. Ph.D. thesis, University of Waterloo","DOI":"10.1145\/1449913.1449918"},{"key":"10102_CR47","doi-asserted-by":"crossref","unstructured":"de Moura L, Bj\u00f8rner N (2008) Z3: An Efficient SMT Solver. In: 14th International conference on tools and algorithms for the construction and analysis of systems (TACAS). Budapest, Hungary, pp 337\u2013340","DOI":"10.1007\/978-3-540-78800-3_24"},{"key":"10102_CR48","doi-asserted-by":"crossref","unstructured":"Mu\u00f1oz DJ, Oh J, Pinto M, Fuentes L, Batory D (2019) Uniform random sampling product configurations of feature models that have numerical features. In: 23rd international systems and software product line conference (SPLC). Paris, France, pp 289\u2013301","DOI":"10.1145\/3336294.3336297"},{"key":"10102_CR49","doi-asserted-by":"crossref","unstructured":"Nair V, Menzies T, Siegmund N, Apel S (2017) Using bad learners to find good configurations. In: 11th joint meeting on foundations of software engineering (ESEC\/FSE). Paderborn, Germany, pp 257\u2013267","DOI":"10.1145\/3106237.3106238"},{"key":"10102_CR50","unstructured":"Narodytska N, Walsh T (2007) Constraint and variable ordering heuristics for compiling configuration problems. In: International joint conference on artificial intelligence (IJCAI). Hyderabad, India, pp 149\u2013154"},{"key":"10102_CR51","unstructured":"Naveh Y, Rimon M, Jaeger I, Katz Y, Vinov M, Marcus E, Shurek G (2006) Constraint-based random stimuli generation for hardware verification. In: 18th innovative applications of artificial intelligence conference (IAAI). Boston, Massachusetts, USA, pp 1720\u20131727"},{"issue":"2","key":"10102_CR52","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1007\/s10515-012-0117-4","volume":"20","author":"A N\u00f6hrer","year":"2013","unstructured":"N\u00f6hrer A, Egyed A (2013) C2O configurator: a tool for guided decision-making. Automated Software Engineering 20(2):265\u2013296","journal-title":"Automated Software Engineering"},{"key":"10102_CR53","doi-asserted-by":"crossref","unstructured":"Oh J, Batory D, Myers M, Siegmund N (2017) Finding near-optimal configurations in product lines by random sampling. In: 11th joint meeting on foundations of software engineering (ESEC\/FSE). New York, NY, USA, pp 61\u201371","DOI":"10.1145\/3106237.3106273"},{"key":"10102_CR54","doi-asserted-by":"crossref","unstructured":"Oh J, Gazzillo P, Batory DS (2019) t-wise coverage by uniform sampling. In: 23rd international systems and software product line conference (SPLC). Paris, France, pp 84\u201387","DOI":"10.1145\/3336294.3342359"},{"key":"10102_CR55","doi-asserted-by":"crossref","unstructured":"Pett T, Krieter S, Th\u00fcm T, Lochau M, Schaefer I (2021) AutoSMP: An evaluation platform for sampling algorithms. In: 25th systems and software product line conference (SPLC). Leicester, United Kingdom","DOI":"10.1145\/3461002.3473073"},{"key":"10102_CR56","doi-asserted-by":"crossref","unstructured":"Pett T, Th\u00fcm T, Runge T, Krieter S, Lochau M, Schaefer I (2019) Product sampling for product lines: The scalability challenge. In: 23rd international systems and software product line conference (SPLC). Paris, France, pp 78\u201383","DOI":"10.1145\/3336294.3336322"},{"key":"10102_CR57","doi-asserted-by":"crossref","unstructured":"Plazar Q, Acher M, Perrouin G, Devroey X, Cordy M (2019) Uniform sampling of SAT solutions for configurable systems: Are We There Yet? In: 12th IEEE conference on software testing, validation and verification (ICST). Xian, China, pp 240\u2013251","DOI":"10.1109\/ICST.2019.00032"},{"key":"10102_CR58","doi-asserted-by":"crossref","unstructured":"Roy S, Pandey A, Dolan-Gavitt B, Hu Y (2018) Bug synthesis: Challenging bug-finding tools with deep faults. In: 26th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering (ESEC\/FSE). Lake Buena Vista, Florida, USA, pp 224\u2013234","DOI":"10.1145\/3236024.3236084"},{"key":"10102_CR59","unstructured":"Sharma S, Gupta R, Roy S, Meel KS (2018) Knowledge compilation meets uniform sampling. In: 22nd international conference on logic for programming, artificial intelligence and reasoning (LPAR). Awassa, Ethiopia, pp 620\u2013636"},{"key":"10102_CR60","volume-title":"The goal\/question\/metric method: A practical guide for quality improvement of software development","author":"R van Solingen","year":"1999","unstructured":"van Solingen R, Berghout E (1999) The goal\/question\/metric method: A practical guide for quality improvement of software development. McGraw-Hill, New York"},{"key":"10102_CR61","doi-asserted-by":"crossref","unstructured":"Temple P, Galindo JA, Acher M, J\u00e9z\u00e9quel JM (2016) Using machine learning to infer constraints for product lines. In: 20th international systems and software product line conference (SPLC). Beijing, China, pp 209\u2013218","DOI":"10.1145\/2934466.2934472"},{"key":"10102_CR62","doi-asserted-by":"crossref","unstructured":"Thurley M (2006) sharpSAT - Counting models with advanced component caching and implicit BCP. In: 9th international conference on theory and applications of satisfiability testing (SAT). Seattle, WA, USA, pp 424\u2013429","DOI":"10.1007\/11814948_38"},{"key":"10102_CR63","unstructured":"Trochim WM, Donnelly JP, Arora K (2015) Research methods: the essential knowledge base. Wadsworth Publishing"},{"key":"10102_CR64","doi-asserted-by":"crossref","unstructured":"Varshosaz M, Al-Hajjaji M, Th\u00fcm T, Runge T, Mousavi MR, Schaefer I (2018) A classification of product sampling for software product lines. In: 22md International Systems and Software Product Line Conference (SPLC). Gothenburg, Sweden, pp 1\u201313","DOI":"10.1145\/3233027.3233035"},{"key":"10102_CR65","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-16313-5","volume-title":"The foundations of statistics: a simulation-based approach","author":"S Vasishth","year":"2011","unstructured":"Vasishth S, Broe M (2011) The foundations of statistics: a simulation-based approach. Springer, New York"},{"key":"10102_CR66","doi-asserted-by":"crossref","unstructured":"Weckesser M, Kluge R, Pfannem\u00fcller M, Matth\u00e9 M, Sch\u00fcrr A, Becker C (2018) Optimal reconfiguration of dynamic software product lines based on performance-influence models. In: 22nd international systems and software product line conference (SPLC). Gothenburg, Sweden, pp 98\u2013109","DOI":"10.1145\/3233027.3233030"},{"key":"10102_CR67","volume-title":"Statistics for linguists: an introduction using R","author":"B Winter","year":"2020","unstructured":"Winter B (2020) Statistics for linguists: an introduction using R. Routledge, Evanston"},{"key":"10102_CR68","doi-asserted-by":"crossref","unstructured":"Yuan J, Albin K, Aziz A, Pixley C (2002) Simplifying constraint solving in random simulation generation. In: 11th IEEE\/ACM international workshop on logic & synthesis (IWLS). New Orleans, Louisiana, USA, pp 185\u2013190","DOI":"10.1145\/774572.774590"}],"updated-by":[{"DOI":"10.1007\/s10664-022-10141-6","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2022,3,14]],"date-time":"2022-03-14T00:00:00Z","timestamp":1647216000000}}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-10102-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-021-10102-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-10102-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T06:14:31Z","timestamp":1652940871000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-021-10102-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,21]]},"references-count":68,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,3]]}},"alternative-id":["10102"],"URL":"https:\/\/doi.org\/10.1007\/s10664-021-10102-5","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s10664-022-10141-6","asserted-by":"object"}]},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,21]]},"assertion":[{"value":"9 December 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 January 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 May 2022","order":3,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":4,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The original version of this paper was updated due to the addition of Leopoldo Motta Teixeira in the \"Communicated by\" line.","order":5,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 March 2022","order":6,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":7,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":8,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s10664-022-10141-6","URL":"https:\/\/doi.org\/10.1007\/s10664-022-10141-6","order":9,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}],"article-number":"44"}}