{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T11:27:26Z","timestamp":1740137246154,"version":"3.37.3"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2022,8,13]],"date-time":"2022-08-13T00:00:00Z","timestamp":1660348800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,13]],"date-time":"2022-08-13T00:00:00Z","timestamp":1660348800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001870","name":"Fundacja na rzecz Nauki Polskiej","doi-asserted-by":"publisher","award":["TEAM NET POIR.04.04.00-00-17C1\/18-00","TEAM NET POIR.04.04.00-00-17C1\/18-00"],"award-info":[{"award-number":["TEAM NET POIR.04.04.00-00-17C1\/18-00","TEAM NET POIR.04.04.00-00-17C1\/18-00"]}],"id":[{"id":"10.13039\/501100001870","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011019","name":"Nemzeti Kutat\u00e1si Fejleszt\u00e9si \u00e9s Innov\u00e1ci\u00f3s Hivatal","doi-asserted-by":"publisher","award":["OTKA K133882 and K124351."],"award-info":[{"award-number":["OTKA K133882 and K124351."]}],"id":[{"id":"10.13039\/501100011019","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Quantum Inf Process"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The ability to evaluate the outcomes of quantum annealers is essential for such devices to be used in complex computational tasks. We introduce a statistical test of the quality of Ising-based annealers\u2019 output based on the data only, assessing the ground state\u2019s probability of being sampled. A higher probability value implies that at least the lower part of the spectrum is a part of the sample. Assuming a plausible model of the univariate energy distribution of the sample, we express the ground-state energy and temperature as a function of cumulants up to the third order. Using the annealer samples, we evaluate this multiple times using Bootstrap resampling, resulting in an estimated histogram of ground-state energies and deduce the desired parameter on this basis. The approach provides an easily implementable method for the primary validation of Ising-based annealers\u2019 output. We demonstrate its behavior through experiments made with actual samples originating from quantum annealer devices.<\/jats:p>","DOI":"10.1007\/s11128-022-03623-5","type":"journal-article","created":{"date-parts":[[2022,8,13]],"date-time":"2022-08-13T20:16:56Z","timestamp":1660421816000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Statistical quality assessment of Ising-based annealer outputs"],"prefix":"10.1007","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7386-5441","authenticated-orcid":false,"given":"Krzysztof","family":"Domino","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"M\u00e1ty\u00e1s","family":"Koniorczyk","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zbigniew","family":"Pucha\u0142a","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,8,13]]},"reference":[{"issue":"sup1","key":"3623_CR1","doi-asserted-by":"publisher","first-page":"S5","DOI":"10.1057\/jors.2009.13","volume":"60","author":"J Rosenhead","year":"2009","unstructured":"Rosenhead, J.: Reflections on fifty years of operational research. J. Oper. Res. Soc. 60(sup1), S5\u2013S15 (2009)","journal-title":"J. Oper. Res. Soc."},{"key":"3623_CR2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511979309","volume-title":"Quantum Computing Since Democritus","author":"S Aaronson","year":"2013","unstructured":"Aaronson, S.: Quantum Computing Since Democritus. Cambridge University Press, New York, NY, USA (2013)"},{"key":"3623_CR3","volume-title":"Computers and Intractability","author":"MR Garey","year":"1979","unstructured":"Garey, M.R., Johnson, D.S.: Computers and Intractability, vol. 174. Freeman, San Francisco (1979)"},{"key":"3623_CR4","first-page":"22","volume":"23","author":"RP Feynman","year":"1960","unstructured":"Feynman, R.P.: There\u2019s plenty of room at the bottom. Caltech Eng. Sci. 23, 22\u201336 (1960)","journal-title":"Caltech Eng. Sci."},{"key":"3623_CR5","volume":"4","author":"T Lanting","year":"2014","unstructured":"Lanting, T., et al.: Entanglement in a quantum annealing processor. Phys. Rev. X 4, 021041 (2014)","journal-title":"Phys. Rev. X"},{"key":"3623_CR6","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1126\/science.aat2025","volume":"361","author":"R Harris","year":"2018","unstructured":"Harris, R., et al.: Phase transitions in a programmable quantum spin glass simulator. Science 361, 162\u2013165 (2018)","journal-title":"Science"},{"key":"3623_CR7","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1038\/s41586-018-0410-x","volume":"560","author":"A King","year":"2018","unstructured":"King, A., et al.: Observation of topological phenomena in a programmable lattice of 1800 qubits. Nature 560, 456\u2013460 (2018)","journal-title":"Nature"},{"key":"3623_CR8","doi-asserted-by":"publisher","first-page":"5","DOI":"10.3389\/fphy.2014.00005","volume":"2","author":"A Lucas","year":"2014","unstructured":"Lucas, A.: Ising formulations of many NP problems. Front. Phys. 2, 5 (2014)","journal-title":"Front. Phys."},{"key":"3623_CR9","unstructured":"Farhi, E., Goldstone, J., Gutmann, S., Sipser, M.: Quantum computation by adiabatic evolution. arXiv preprint arXiv:quant-ph\/0001106, (2000)"},{"key":"3623_CR10","volume-title":"The Theory of Open Quantum Systems","author":"HP Breuer","year":"2002","unstructured":"Breuer, H.P., Petruccione, F.: The Theory of Open Quantum Systems. Oxford University Press, Oxford (2002)"},{"key":"3623_CR11","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1103\/RevModPhys.75.715","volume":"75","author":"WH Zurek","year":"2003","unstructured":"Zurek, W.H.: Decoherence, einselection, and the quantum origins of the classical. Rev. Mod. Phys. 75, 715\u2013775 (2003)","journal-title":"Rev. Mod. Phys."},{"issue":"3","key":"3623_CR12","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.93.032118","volume":"93","author":"LC Venuti","year":"2016","unstructured":"Venuti, L.C., Albash, T., Lidar, D.A., Zanardi, P.: Adiabaticity in open quantum systems. Phys. Rev. A 93(3), 032118 (2016)","journal-title":"Phys. Rev. A"},{"key":"3623_CR13","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.77.022104","volume":"77","author":"A Montina","year":"2008","unstructured":"Montina, A.: Exponential complexity and ontological theories of quantum mechanics. Phys. Rev. A 77, 022104 (2008)","journal-title":"Phys. Rev. A"},{"key":"3623_CR14","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.65.012322","volume":"65","author":"AM Childs","year":"2001","unstructured":"Childs, A.M., Farhi, E., Preskill, J.: Robustness of adiabatic quantum computation. Phys. Rev. A 65, 012322 (2001)","journal-title":"Phys. Rev. A"},{"key":"3623_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11128-020-02692-8","volume":"19","author":"M Willsch","year":"2020","unstructured":"Willsch, M., Willsch, D., Jin, F., De Raedt, H., Michielsen, K.: Benchmarking the quantum approximate optimization algorithm. Quantum Inf. Process. 19, 1\u201324 (2020)","journal-title":"Quantum Inf. Process."},{"key":"3623_CR16","doi-asserted-by":"crossref","unstructured":"Willsch, D., Willsch, M., Calaza, C.D.G., Jin, F., De\u00a0Raedt, H., Svensson, M., Michielsen, K.: Benchmarking Advantage and D-Wave 2000Q quantum annealers with exact cover problems. arXiv: 2105.02208, (2021)","DOI":"10.1007\/s11128-022-03476-y"},{"issue":"6","key":"3623_CR17","doi-asserted-by":"publisher","DOI":"10.7566\/JPSJ.90.064001","volume":"90","author":"AS Koshikawa","year":"2021","unstructured":"Koshikawa, A.S., Ohzeki, M., Kadowaki, T., Tanaka, K.: Benchmark test of black-box optimization using d-wave quantum annealer. J. Phys. Soc. Jpn. 90(6), 064001 (2021)","journal-title":"J. Phys. Soc. Jpn."},{"issue":"1\u20133","key":"3623_CR18","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1080\/10556789808805690","volume":"9","author":"Y Nesterov","year":"1998","unstructured":"Nesterov, Y.: Semidefinite relaxation and nonconvex quadratic optimization. Optim. Methods Softw. 9(1\u20133), 141\u2013160 (1998)","journal-title":"Optim. Methods Softw."},{"key":"3623_CR19","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1007\/s10107980012a","volume":"84","author":"Y Ye","year":"1997","unstructured":"Ye, Y.: Approximating quadratic programming with bound constraints. Math. Program. 84, 219\u2013226 (1997)","journal-title":"Math. Program."},{"issue":"11","key":"3623_CR20","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.119.110502","volume":"119","author":"T Albash","year":"2017","unstructured":"Albash, T., Martin-Mayor, V., Hen, I.: Temperature scaling law for quantum annealing optimizers. Phys. Rev. Lett. 119(11), 110502 (2017)","journal-title":"Phys. Rev. Lett."},{"key":"3623_CR21","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-3675-0","volume-title":"An Introduction to Statistical Modeling of Extreme Values","author":"S Coles","year":"2001","unstructured":"Coles, S., Bawa, J., Trenner, L., Dorazio, P.: An Introduction to Statistical Modeling of Extreme Values, vol. 208. Springer, Berlin (2001)"},{"key":"3623_CR22","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1007\/s10288-019-00424-y","volume":"17","author":"F Glover","year":"2019","unstructured":"Glover, F., Kochenberger, G., Du, Y.: Quantum bridge analytics i: a tutorial on formulating and using QUBO models. 4OR 17, 335\u2013371 (2019)","journal-title":"4OR"},{"issue":"5","key":"3623_CR23","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.92.052323","volume":"92","author":"MH Amin","year":"2015","unstructured":"Amin, M.H.: Searching for quantum speedup in quasistatic quantum annealers. Phys. Rev. A 92(5), 052323 (2015)","journal-title":"Phys. Rev. A"},{"key":"3623_CR24","first-page":"1","volume":"57","author":"RJ Tibshirani","year":"1993","unstructured":"Tibshirani, R.J., Efron, B.: An introduction to the bootstrap. Monograph. Stat. Appl. Prob. 57, 1\u2013436 (1993)","journal-title":"Monograph. Stat. Appl. Prob."},{"key":"3623_CR25","unstructured":"Weisstein, E.W.: k-statistic. (2002). https:\/\/mathworld.wolfram.com, accessed on 2022.03.25"},{"issue":"3","key":"3623_CR26","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1179\/030801801679449","volume":"26","author":"M Gligor","year":"2001","unstructured":"Gligor, M., Ignat, M.: Econophysics: a new field for statistical physics? Interdisc. Sci. Rev. 26(3), 183\u2013190 (2001)","journal-title":"Interdisc. Sci. Rev."},{"key":"3623_CR27","doi-asserted-by":"crossref","unstructured":"Malsagov, M.Y., Karandashev, I., Kryzhanovsky, B.: The analytical expressions for a finite-size 2d ising model. arXiv preprint arXiv:1706.02541, (2017)","DOI":"10.3103\/S1060992X17030031"},{"key":"3623_CR28","first-page":"74","volume":"690","author":"K Binder","year":"2003","unstructured":"Binder, K.: Overcoming the limitation of finite size in simulations: From the phase transition of the ising model to polymers, , spin glasses, etc. in AIP Conference Proceedings. Am. Inst. Phys. 690, 74\u201384 (2003)","journal-title":"Am. Inst. Phys."},{"issue":"8","key":"3623_CR29","doi-asserted-by":"publisher","first-page":"585","DOI":"10.3390\/e20080585","volume":"20","author":"B Kryzhanovsky","year":"2018","unstructured":"Kryzhanovsky, B., Malsagov, M., Karandashev, I.: Investigation of finite-size 2D Ising model with a noisy matrix of spin-spin interactions. Entropy 20(8), 585 (2018)","journal-title":"Entropy"},{"key":"3623_CR30","unstructured":"Domino, K., Pawela, \u0141.: StatisticalVerificationOfIsingEnergies. (2021). https:\/\/github.com\/iitis\/StatisticalVerificationOfIsingEnergies, accessed on 2022.03.25"},{"key":"3623_CR31","unstructured":"Domino, K.,\u00a0Koniorczyk, M.,\u00a0Krawiec, K.,\u00a0Ja\u0142owiecki, K.,\u00a0Deffner, S., Gardas, B.: Quantum annealing in the NISQ era: railway conflict management. arXiv preprint arXiv:2112.03674, (2021)"},{"key":"3623_CR32","unstructured":"Rams, M.\u00a0M.,\u00a0Mohseni, M.,\u00a0Gardas, B.: Heuristic optimization and sampling with tensor networks for quasi-2D spin glass problems. arXiv preprint arXiv:1811.06518, (2019)"},{"key":"3623_CR33","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/S0377-2217(03)00095-X","volume":"153","author":"A Ernst","year":"2004","unstructured":"Ernst, A., Jiang, H., Krishnamoorthy, M., Sier, D.: Staff scheduling and rostering: A review of applications, methods and models. Eur. J. Oper. Res. 153, 3\u201327 (2004)","journal-title":"Eur. J. Oper. Res."},{"key":"3623_CR34","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1007\/s13676-019-00145-6","volume":"8","author":"A Tahir","year":"2019","unstructured":"Tahir, A., Desaulniers, G., Hallaoui, I.E.: Integral column generation for the set partitioning problem. EURO J. Transp. Logist. 8, 713\u2013744 (2019)","journal-title":"EURO J. Transp. Logist."},{"key":"3623_CR35","first-page":"17","volume":"4","author":"R Fortet","year":"1960","unstructured":"Fortet, R.: Applications de l\u2019alg\u00e9bre de boole en recherche op\u00e9rationelle. Revue Fran\u00e7aise Recherche Op\u00e9rationelle 4, 17\u201326 (1960)","journal-title":"Revue Fran\u00e7aise Recherche Op\u00e9rationelle"},{"key":"3623_CR36","unstructured":"\u201cGLPK - GNU Project - Free Software Foundation (FSF).\u201d https:\/\/www.gnu.org\/software\/glpk\/. Accessed on 2022.03.25. See also https:\/\/lists.gnu.org\/archive\/html\/help-glpk\/2022-01\/msg00000.html about solving QUBOs"},{"key":"3623_CR37","unstructured":"Grozea, C.,\u00a0Hans, R.,\u00a0Koch, M.,\u00a0Riehn, C.,\u00a0Wolf, A.: Optimising rolling stock planning including maintenance with constraint programming and quantum annealing. arXiv preprint arXiv:2109.07212, (2021)"},{"key":"3623_CR38","doi-asserted-by":"crossref","unstructured":"Salehi, \u00d6.,\u00a0Glos, A., Miszczak, J.\u00a0A.: Unconstrained binary models of the travelling salesman problem variants for quantum optimization. arXiv preprint arXiv:2106.09056, (2021)","DOI":"10.1007\/s11128-021-03405-5"},{"issue":"4","key":"3623_CR39","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevApplied.11.044083","volume":"11","author":"J Marshall","year":"2019","unstructured":"Marshall, J., Venturelli, D., Hen, I., Rieffel, E.G.: Power of pausing: Advancing understanding of thermalization in experimental quantum annealers. Phys. Rev. Appl. 11(4), 044083 (2019)","journal-title":"Phys. Rev. Appl."},{"issue":"4","key":"3623_CR40","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1080\/00031305.1995.10476177","volume":"49","author":"S Chib","year":"1995","unstructured":"Chib, S., Greenberg, E.: Understanding the Metropolis-Hastings algorithm. Am. Stat. 49(4), 327\u2013335 (1995)","journal-title":"Am. Stat."}],"container-title":["Quantum Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11128-022-03623-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11128-022-03623-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11128-022-03623-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,1]],"date-time":"2024-10-01T17:48:24Z","timestamp":1727804904000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11128-022-03623-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,13]]},"references-count":40,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["3623"],"URL":"https:\/\/doi.org\/10.1007\/s11128-022-03623-5","relation":{},"ISSN":["1573-1332"],"issn-type":[{"type":"electronic","value":"1573-1332"}],"subject":[],"published":{"date-parts":[[2022,8,13]]},"assertion":[{"value":"8 December 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 July 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 August 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"288"}}