{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T06:08:42Z","timestamp":1725516522293},"reference-count":0,"publisher":"EasyChair","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>Evaluating improvements to modern SAT solvers and comparison of two arbitrary solvers is a challenging and important task. Relative performance of two solvers is usually assessed by running them on a set of SAT instances and comparing the number of solved instances and their running time in a straightforward manner. In this paper we point to shortcomings of this approach and advocate more reliable, statistically founded methodologies that could discriminate better between good and bad ideas. We present one such methodology and illustrate its application.<\/jats:p>","DOI":"10.29007\/bhvj","type":"proceedings-article","created":{"date-parts":[[2018,1,23]],"date-time":"2018-01-23T21:46:52Z","timestamp":1516744012000},"page":"33-26","source":"Crossref","is-referenced-by-count":0,"title":["Statistical Methodology for Comparison of SAT Solvers"],"prefix":"10.29007","volume":"6","author":[{"given":"Mladen","family":"Nikoli\u0107","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"11545","event":{"name":"EMSQMS 2010. Workshop on Evaluation Methods for Solvers, and Quality Metrics for Solutions"},"container-title":["EPiC Series in Computing"],"original-title":[],"deposited":{"date-parts":[[2018,1,23]],"date-time":"2018-01-23T21:46:53Z","timestamp":1516744013000},"score":1,"resource":{"primary":{"URL":"https:\/\/easychair.org\/publications\/paper\/gW"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[null]]},"references-count":0,"URL":"https:\/\/doi.org\/10.29007\/bhvj","relation":{},"ISSN":["2398-7340"],"issn-type":[{"type":"print","value":"2398-7340"}],"subject":[]}}