{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T23:45:40Z","timestamp":1740181540898,"version":"3.37.3"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2022,4,20]],"date-time":"2022-04-20T00:00:00Z","timestamp":1650412800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,4,20]],"date-time":"2022-04-20T00:00:00Z","timestamp":1650412800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004238","name":"Universit\u00e4t Potsdam","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004238","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["SN COMPUT. SCI."],"published-print":{"date-parts":[[2022,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In many online markets, we observe fierce competition and highly dynamic price adjustments. Competitors frequently adjust their prices to respond to changing market situations caused by competitors\u2019 price adjustments. In this paper, we examine price response strategies within an infinite horizon duopoly where the competitor\u2019s strategy has to be learned. The goal is to derive knowledge about the opponent\u2019s pricing strategy in a self-adaptive way and to balance exploration and exploitation. Our models are based on anticipated price reaction probabilities and efficient dynamic programming techniques. We show that our approach works when played against unknown strategies. Further, we analyze the mutual interplay of our self-learning strategies as well as their tendencies to form a cartel when motivated accordingly. Moreover, we propose two extensions of our model to integrate risk aversion. Finally, we demonstrate the effectiveness of parallelization techniques to speed up the computation of strategies as well as their simulation.<\/jats:p>","DOI":"10.1007\/s42979-022-01114-z","type":"journal-article","created":{"date-parts":[[2022,4,20]],"date-time":"2022-04-20T11:03:42Z","timestamp":1650452622000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Self-Adaptive Agents in a Dynamic Pricing Duopoly: Competition, Collusion, and Risk Considerations"],"prefix":"10.1007","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6627-4026","authenticated-orcid":false,"given":"Rainer","family":"Schlosser","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jan","family":"Westphal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mats","family":"P\u00f6rschke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tobias","family":"Maltenberger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Youri","family":"Kaminsky","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,4,20]]},"reference":[{"key":"1114_CR1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1287\/opre.1090.0718","volume":"58","author":"E Adida","year":"2010","unstructured":"Adida E, Perakis G. Dynamic pricing and inventory control: uncertainty and competition. Oper Res. 2010;58:289\u2013302.","journal-title":"Oper Res"},{"key":"1114_CR2","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1287\/msom.5.3.203.16031","volume":"5","author":"G Bitran","year":"2003","unstructured":"Bitran G, Caldentey R. An overview of pricing models for revenue management. Manuf Serv Oper Manag. 2003;5:203\u201329.","journal-title":"Manuf Serv Oper Manag"},{"key":"1114_CR3","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1111\/j.1542-4774.2010.tb00532.x","volume":"8","author":"Y Cai","year":"2010","unstructured":"Cai Y, Judd KL. Stable and efficient computational methods for dynamic programming. J Eur Econ Assoc. 2010;8:626\u201334.","journal-title":"J Eur Econ Assoc"},{"key":"1114_CR4","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1111\/poms.12295","volume":"24","author":"M Chen","year":"2015","unstructured":"Chen M, Chen Z-L. Recent developments in dynamic pricing research: multiple products, competition, and limited demand information. Prod Oper Manag. 2015;24:704\u201331.","journal-title":"Prod Oper Manag"},{"key":"1114_CR5","first-page":"1","volume":"20","author":"AV den Boer","year":"2015","unstructured":"den Boer AV. Dynamic pricing and learning: historical origins, current research, and new directions. Surv Oper Res Manag Sci. 2015;20:1\u201318.","journal-title":"Surv Oper Res Manag Sci"},{"key":"1114_CR6","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1109\/TEM.2011.2140323","volume":"59","author":"B Do Chung","year":"2011","unstructured":"Do Chung B, Li J, Yao T, Kwon C, Friesz TL. Demand learning and dynamic pricing under competition in a state-space framework. IEEE Trans Eng Manag. 2011;59:240\u20139.","journal-title":"IEEE Trans Eng Manag"},{"issue":"2","key":"1114_CR7","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1287\/opre.47.2.337","volume":"47","author":"Y Feng","year":"1999","unstructured":"Feng Y, Xiao B. Maximizing revenues of perishable assets with a risk factor. Oper Res. 1999;47(2):337\u201341.","journal-title":"Oper Res"},{"key":"1114_CR8","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.1287\/mnsc.2013.1821","volume":"60","author":"G Gallego","year":"2014","unstructured":"Gallego G, Hu M. Dynamic pricing of perishable assets under competition. Manag Sci. 2014;60:1241\u201359.","journal-title":"Manag Sci"},{"key":"1114_CR9","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4939-9606-3","volume-title":"Revenue management and pricing analytics","author":"G Gallego","year":"2019","unstructured":"Gallego G, Topaloglu H. Revenue management and pricing analytics. Berlin: Springer; 2019."},{"key":"1114_CR10","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1287\/opre.2013.1249","volume":"62","author":"G Gallego","year":"2014","unstructured":"Gallego G, Wang R. Multiproduct price optimization and competition under the nested logit model with product-differentiated price sensitivities. Oper Res. 2014;62:450\u201361.","journal-title":"Oper Res"},{"key":"1114_CR11","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1016\/j.ijpe.2011.10.004","volume":"135","author":"A Hajji","year":"2012","unstructured":"Hajji A, Pellerin R, L\u00e9ger P-M, Gharbi A, Babin G. Dynamic pricing models for ERP systems under network externality. Int J Prod Econ. 2012;135:708.","journal-title":"Int J Prod Econ"},{"key":"1114_CR12","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.omega.2017.08.014","volume":"80","author":"Q-C He","year":"2018","unstructured":"He Q-C, Chen Y-J. Dynamic pricing of electronic products with consumer reviews. Omega. 2018;80:123\u201334.","journal-title":"Omega"},{"key":"1114_CR13","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1109\/MC.2008.209","volume":"41","author":"M Hill","year":"2008","unstructured":"Hill M, Marty M. Amdahl\u2019s law in the multicore era. Computer. 2008;41:33\u20138.","journal-title":"Computer"},{"key":"1114_CR14","doi-asserted-by":"crossref","first-page":"4299","DOI":"10.1080\/00207543.2014.881576","volume":"52","author":"Y-S Huang","year":"2014","unstructured":"Huang Y-S, Hsu C-S, Ho J-W. Dynamic pricing for fashion goods with partial backlogging. Int J Prod Res. 2014;52:4299\u2013314.","journal-title":"Int J Prod Res"},{"key":"1114_CR15","doi-asserted-by":"crossref","unstructured":"Kaminsky K, Maltenberger T, P\u00f6rschke M, Westphal J, Schlosser R. Pricing competition in a duopoly with self-adapting strategies. In: ICORES 2021. 2021. p. 60\u201371.","DOI":"10.5220\/0010232900600071"},{"key":"1114_CR16","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1057\/s41272-021-00285-3","volume":"21","author":"A Kastius","year":"2022","unstructured":"Kastius A, Schlosser R. Dynamic pricing under competition using reinforcement learning. J Revenue Pricing Manag. 2022;21:50\u201363.","journal-title":"J Revenue Pricing Manag"},{"issue":"6","key":"1114_CR17","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1016\/S1389-1286(00)00026-8","volume":"32","author":"JO Kephart","year":"2000","unstructured":"Kephart JO, Hanson JE, Greenwald A. Dynamic pricing by software agents. Comput Netw. 2000;32(6):731\u201352.","journal-title":"Comput Netw"},{"key":"1114_CR18","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1016\/j.ejor.2019.06.034","volume":"284","author":"R Klein","year":"2020","unstructured":"Klein R, Koch S, Steinhardt C, Strauss A. A review of revenue management: recent generalizations and advances in industry applications. Eur J Oper Res. 2020;284:397\u2013412.","journal-title":"Eur J Oper Res"},{"key":"1114_CR19","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.ijpe.2015.03.027","volume":"166","author":"M Koenig","year":"2015","unstructured":"Koenig M, Meissner J. Value-at-risk optimal policies for revenue management problems. Int J Prod Econ. 2015;166:11\u20139.","journal-title":"Int J Prod Econ"},{"key":"1114_CR20","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1145\/238793.238822","volume":"26","author":"U Legedza","year":"1996","unstructured":"Legedza U, Weihl W. Reducing synchronization overhead in parallel simulation. ACM Sigsim Simul Digest. 1996;26:86\u201395.","journal-title":"ACM Sigsim Simul Digest"},{"issue":"2","key":"1114_CR21","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1287\/opre.1070.0438","volume":"56","author":"Y Levin","year":"2008","unstructured":"Levin Y, McGill J, Nediak M. Risk in revenue management and dynamic pricing. Oper Res. 2008;56(2):326\u201343.","journal-title":"Oper Res"},{"key":"1114_CR22","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1287\/mnsc.1080.0936","volume":"55","author":"Y Levin","year":"2009","unstructured":"Levin Y, McGill J, Nediak M. Dynamic pricing in the presence of strategic consumers and oligopolistic competition. Manag Sci. 2009;55:32\u201346.","journal-title":"Manag Sci"},{"issue":"5","key":"1114_CR23","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/j.orl.2009.05.005","volume":"37","author":"MZF Li","year":"2009","unstructured":"Li MZF, Zhuang W. Risk in revenue management and dynamic pricing. Oper Res Lett. 2009;37(5):327\u201332.","journal-title":"Oper Res Lett"},{"key":"1114_CR24","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1287\/opre.1070.0385","volume":"55","author":"AEB Lim","year":"2007","unstructured":"Lim AEB, Shanthikumar JG. Relative entropy, exponential utility and robust dynamic pricing. Oper Res. 2007;55:198\u2013214.","journal-title":"Oper Res"},{"key":"1114_CR25","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1287\/mnsc.1120.1564","volume":"59","author":"Q Liu","year":"2013","unstructured":"Liu Q, Zhang D. Dynamic pricing competition with strategic customers under vertical product differentiation. Manag Sci. 2013;59:84\u2013101.","journal-title":"Manag Sci"},{"key":"1114_CR26","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.1287\/mnsc.1110.1337","volume":"57","author":"V Mart\u00ednez-de Alb\u00e9niz","year":"2011","unstructured":"Mart\u00ednez-de Alb\u00e9niz V, Talluri K. Dynamic price competition with fixed capacities. Manag Sci. 2011;57:1078\u201393.","journal-title":"Manag Sci"},{"key":"1114_CR27","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1287\/trsc.33.2.233","volume":"33","author":"J McGill","year":"1999","unstructured":"McGill J, van Ryzin G. Revenue management: research overview and prospects. Transp Sci. 1999;33:233\u201356.","journal-title":"Transp Sci"},{"key":"1114_CR28","first-page":"2080","volume":"28","author":"T Meeds","year":"2015","unstructured":"Meeds T, Welling M. Optimization Monte Carlo: efficient and embarrassingly parallel likelihood-free inference. Adv Neural Inf Process Syst. 2015;28:2080\u20138.","journal-title":"Adv Neural Inf Process Syst"},{"key":"1114_CR29","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1162\/rest.89.2.324","volume":"89","author":"M Noel","year":"2007","unstructured":"Noel M. Edgeworth price cycles, cost-based pricing, and sticky pricing in retail gasoline markets. Rev Econ Stat. 2007;89:324\u201334.","journal-title":"Rev Econ Stat"},{"key":"1114_CR30","doi-asserted-by":"crossref","first-page":"942","DOI":"10.1016\/j.eneco.2011.05.004","volume":"34","author":"M Noel","year":"2012","unstructured":"Noel M. Edgeworth price cycles and intertemporal price discrimination. Energy Econ. 2012;34:942\u201354.","journal-title":"Energy Econ"},{"key":"1114_CR31","doi-asserted-by":"crossref","DOI":"10.1515\/9780804781640","volume-title":"Pricing and revenue optimization","author":"RL Phillips","year":"2005","unstructured":"Phillips RL. Pricing and revenue optimization. Redwood City: Stanford University Press; 2005."},{"key":"1114_CR32","first-page":"72","volume":"34","author":"R Rugina","year":"1999","unstructured":"Rugina R, Rinard M. Automatic parallelization of divide and conquer algorithms. Spec Interest Gr Progr Lang Not. 1999;34:72\u201383.","journal-title":"Spec Interest Gr Progr Lang Not"},{"issue":"6","key":"1114_CR33","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1057\/rpm.2015.20","volume":"14","author":"R Schlosser","year":"2015","unstructured":"Schlosser R. A stochastic dynamic pricing and advertising model under risk aversion. J Revenue Pricing Manag. 2015;14(6):451\u201368.","journal-title":"J Revenue Pricing Manag"},{"issue":"2","key":"1114_CR34","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1093\/imaman\/dpab009","volume":"33","author":"R Schlosser","year":"2022","unstructured":"Schlosser R. Heuristic mean variance optimization in Markov decision processes using state-dependent risk aversion. IMA J Manag Math. 2022;33(2):181\u201399.","journal-title":"IMA J Manag Math"},{"key":"1114_CR35","first-page":"47","volume":"2017","author":"R Schlosser","year":"2017","unstructured":"Schlosser R, Boissier M. Optimal price reaction strategies in the presence of active and passive competitors. ICORES. 2017;2017:47\u201356.","journal-title":"ICORES"},{"key":"1114_CR36","doi-asserted-by":"crossref","unstructured":"Schlosser R, Boissier M. Dynamic pricing under competition on online marketplaces: a data-driven approach. In: International Conference on Knowledge Discovery and Data Mining. 2018. p. 705\u201314.","DOI":"10.1145\/3219819.3219833"},{"key":"1114_CR37","first-page":"21","volume":"2018","author":"R Schlosser","year":"2018","unstructured":"Schlosser R, Richly K. Dynamic pricing strategies in a finite horizon duopoly with partial information. ICORES. 2018;2018:21\u201330.","journal-title":"ICORES"},{"issue":"6","key":"1114_CR38","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1057\/s41272-019-00206-5","volume":"18","author":"R Schlosser","year":"2019","unstructured":"Schlosser R, Richly K. Dynamic pricing under competition with data-driven price anticipations and endogenous reference price effects. J Revenue Pricing Manag. 2019;18(6):451\u201364.","journal-title":"J Revenue Pricing Manag"},{"key":"1114_CR39","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/j.ejor.2018.01.011","volume":"271","author":"AK Strauss","year":"2018","unstructured":"Strauss AK, Klein R, Steinhardt C. A review of choice-based revenue management: theory and methods. Eur J Oper Res. 2018;271:375\u201387.","journal-title":"Eur J Oper Res"},{"key":"1114_CR40","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1086\/669254","volume":"120","author":"A Sweeting","year":"2012","unstructured":"Sweeting A. Dynamic pricing behavior in perishable goods markets: evidence from secondary markets for major league baseball tickets. J Polit Econ. 2012;120:1133\u201372.","journal-title":"J Polit Econ"},{"key":"1114_CR41","volume-title":"The theory and practice of revenue management","author":"KT Talluri","year":"2006","unstructured":"Talluri KT, Van Ryzin GJ. The theory and practice of revenue management. Berlin: Springer; 2006."},{"key":"1114_CR42","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/j.ijpe.2019.07.010","volume":"219","author":"T Tong","year":"2020","unstructured":"Tong T, Dai H, Xiao Q, Yan N. Will dynamic pricing outperform? Theoretical analysis and empirical evidence from O2O on-demand food service market. Int J Prod Econ. 2020;219:375\u201385.","journal-title":"Int J Prod Econ"},{"key":"1114_CR43","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1016\/j.omega.2007.07.001","volume":"37","author":"W-H Tsai","year":"2009","unstructured":"Tsai W-H, Hung S-J. Dynamic pricing and revenue management process in internet retailing under uncertainty: an integrated real options approach. Omega. 2009;37:471\u201381.","journal-title":"Omega"},{"key":"1114_CR44","first-page":"1","volume":"4","author":"J Zhang","year":"2017","unstructured":"Zhang J, Wei Q, Zheng X, Li L. PDP: parallel dynamic programming. Acta Automatica Sinica. 2017;4:1\u20135.","journal-title":"Acta Automatica Sinica"}],"container-title":["SN Computer Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-022-01114-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s42979-022-01114-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-022-01114-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,9]],"date-time":"2022-05-09T18:01:51Z","timestamp":1652119311000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s42979-022-01114-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,20]]},"references-count":44,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,5]]}},"alternative-id":["1114"],"URL":"https:\/\/doi.org\/10.1007\/s42979-022-01114-z","relation":{},"ISSN":["2662-995X","2661-8907"],"issn-type":[{"type":"print","value":"2662-995X"},{"type":"electronic","value":"2661-8907"}],"subject":[],"published":{"date-parts":[[2022,4,20]]},"assertion":[{"value":"14 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 March 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 April 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors confirm that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable, could be provided.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}],"article-number":"234"}}