{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T14:20:20Z","timestamp":1753885220131,"version":"3.41.2"},"reference-count":48,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T00:00:00Z","timestamp":1640908800000},"content-version":"vor","delay-in-days":364,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100017607","name":"Shenzhen Fundamental Research Program","doi-asserted-by":"publisher","award":["JCYJ20190809175613332"],"award-info":[{"award-number":["JCYJ20190809175613332"]}],"id":[{"id":"10.13039\/501100017607","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Journal of Sensors"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>With the development of the IoT (Internet of Things), sensors networks can bring a large amount of valuable data. In addition to be utilized in the local IoT applications, the data can also be traded in the connected edge servers. As an efficient resource allocation mechanism, the double auction has been widely used in the stock and futures markets and can be also applied in the data resource allocation in sensor networks. Currently, there usually exist multiple edge servers running double auctions competing with each other to attract data users (buyers) and producers (sellers). Therefore, the double auction market run on each edge server needs efficient mechanism to improve the allocation efficiency. Specifically, the pricing strategy of the double auction plays an important role on affecting traders\u2019 profit, and thus, will affect the traders\u2019 market choices and bidding strategies, which in turn affect the competition result of double auction markets. In addition, the traders\u2019 trading strategies will also affect the market\u2019s pricing strategy. Therefore, we need to analyze the double auction markets\u2019 pricing strategy and traders\u2019 trading strategies. Specifically, we use a deep reinforcement learning algorithm combined with mean field theory to solve this problem with a huge state and action space. For trading strategies, we use the Independent Parametrized Deep Q\u2010Network (I\u2010PDQN) algorithm combined with mean field theory to compute the Nash equilibrium strategies. We then compare it with the fictitious play (FP) algorithm. The experimental results show that the computation speed of I\u2010PDQN algorithm is significantly faster than that of FP algorithm. For pricing strategies, the double auction markets will dynamically adjust the pricing strategy according to traders\u2019 trading strategies. This is a sequential decision\u2010making process involving multiple agents. Therefore, we model it as a Markov game. We adopt Multiagent Deep Deterministic Policy Gradient (MADDPG) algorithm to analyze the Nash equilibrium pricing strategies. The experimental results show that the MADDPG algorithm solves the problem faster than the FP algorithm.<\/jats:p>","DOI":"10.1155\/2021\/9651117","type":"journal-article","created":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T17:35:28Z","timestamp":1640972128000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Trading and Pricing Sensor Data in Competing Edge Servers with Double Auction Markets"],"prefix":"10.1155","volume":"2021","author":[{"given":"Bing","family":"Shi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhaoxiang","family":"Song","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6497-7863","authenticated-orcid":false,"given":"Jianqiao","family":"Xu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2021,12,31]]},"reference":[{"key":"e_1_2_10_1_2","article-title":"Combinatorial double auction-based allocation of retrieval tasks in internet of things","volume":"36","author":"Xu Z. K.","year":"2015","journal-title":"Journal on Communications"},{"key":"e_1_2_10_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2017.2683200"},{"key":"e_1_2_10_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2012.2203127"},{"key":"e_1_2_10_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10614-018-9866-x"},{"key":"e_1_2_10_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeem.2017.11.003"},{"key":"e_1_2_10_6_2","doi-asserted-by":"crossref","unstructured":"HuF. ChenB. WangJ. LiM. LiP. andPanM. MastDP: matching based double auction mechanism for spectrum trading with differential privacy 2019 IEEE Global Communications Conference 2019 Waikoloa HI USA 1\u20136.","DOI":"10.1109\/GLOBECOM38437.2019.9013917"},{"key":"e_1_2_10_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.12.009"},{"key":"e_1_2_10_8_2","unstructured":"WangX.andWellmanM. P. Spoofing the limit order book: an agent-based model Workshops at the Thirty-First AAAI Conference on Artificial Intelligence 2017 San Francisco California USA 651\u2013659."},{"key":"e_1_2_10_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-8508-7"},{"key":"e_1_2_10_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11537-007-0657-8"},{"key":"e_1_2_10_11_2","doi-asserted-by":"crossref","unstructured":"SangoleyeF. IrtijaN. andTsiropoulouE. E. Data acquisition in social internet of things based on contract theory IEEE International Conference on Communications 2021 Montreal QC Canada 1\u20136.","DOI":"10.1109\/ICC42927.2021.9500254"},{"key":"e_1_2_10_12_2","doi-asserted-by":"publisher","DOI":"10.3390\/s19071716"},{"key":"e_1_2_10_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-015-0175-5"},{"key":"e_1_2_10_14_2","doi-asserted-by":"publisher","DOI":"10.3390\/proceedings2130852"},{"key":"e_1_2_10_15_2","doi-asserted-by":"crossref","unstructured":"NiuC. ZhengZ. WuF. GaoX. andChenG. Trading data in good faith: integrating truthfulness and privacy preservation in data markets The IEEE 33rd International Conference on Data Engineering 2017 San Diego CA USA 223\u2013226.","DOI":"10.1109\/ICDE.2017.80"},{"key":"e_1_2_10_16_2","doi-asserted-by":"crossref","unstructured":"CaoX. ChenY. andLiuK. J. R. An iterative auction mechanism for data trading IEEE International Conference on Acoustics Speech and Signal Processing 2017 New Orleans LA USA 5850\u20135854.","DOI":"10.1109\/ICASSP.2017.7953278"},{"key":"e_1_2_10_17_2","doi-asserted-by":"crossref","unstructured":"JiaoY. WangP. NiyatoD. AlsheikhM. A. andFengS. Profit maximization auction and data management in big data markets 2017 IEEE Wireless Communications and Networking Conference (WCNC) 2017 San Francisco CA USA 1\u20136.","DOI":"10.1109\/WCNC.2017.7925760"},{"key":"e_1_2_10_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2902528"},{"key":"e_1_2_10_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2020.06.075"},{"key":"e_1_2_10_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2017.2676958"},{"key":"e_1_2_10_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TETC.2017.2674023"},{"key":"e_1_2_10_22_2","doi-asserted-by":"crossref","unstructured":"NiyatoD. AlsheikhM. A. WangP. KimD. I. andHanZ. Market model and optimal pricing scheme of big data and internet of things (IoT) IEEE International Conference on Communications 2016 Kuala Lumpur Malaysia 1\u20136.","DOI":"10.1109\/ICC.2016.7510922"},{"key":"e_1_2_10_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TETC.2013.2278698"},{"key":"e_1_2_10_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2018.2819706"},{"key":"e_1_2_10_25_2","doi-asserted-by":"crossref","unstructured":"ChenC.andWangY. SPARC: strategy-proof double auction for mobile participatory sensing International Conference on Cloud Computing and Big Data 2013 Fuzhou China 133\u2013140.","DOI":"10.1109\/CLOUDCOM-ASIA.2013.99"},{"key":"e_1_2_10_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2018.2855746"},{"key":"e_1_2_10_27_2","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxz025"},{"key":"e_1_2_10_28_2","doi-asserted-by":"publisher","DOI":"10.1086\/261868"},{"key":"e_1_2_10_29_2","first-page":"73","article-title":"Solutions of games by differential equations","volume":"27","author":"Brown G. W.","year":"1950","journal-title":"Contributions to the Theory Games"},{"key":"e_1_2_10_30_2","unstructured":"RabinovichZ. GerdingE. PolukarovM. andJenningsN. R. Generalised fictitious play for a continuum of anonymous players The 21st International Joint Conference on Artificial Intelligence 2009 Pasadena California USA 245\u2013250."},{"key":"e_1_2_10_31_2","unstructured":"ShiB. GerdingE. H. VytelingumP. andJenningsN. R. An equilibrium analysis of competing double auction marketplaces using fictitious play The 19th European Conference on Artificial Intelligence 2010 Lisbon Portugal 575\u2013580."},{"key":"e_1_2_10_32_2","unstructured":"SchvartzmanL. J.andWellmanM. P. Stronger CDA strategies through empirical game-theoretic analysis and reinforcement learning The 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 1 2009 Budapest Hungary 249\u2013256."},{"key":"e_1_2_10_33_2","doi-asserted-by":"crossref","unstructured":"ChowdhuryM. M. KiekintveldC. SonT. C. andYeohW. Bidding strategy for periodic double auctions using Monte Carlo tree search The 17th International Conference on Autonomous Agents and Multiagent Systems 2018 Stockholm Sweden 1897\u20131899.","DOI":"10.24963\/ijcai.2018\/23"},{"key":"e_1_2_10_34_2","unstructured":"BredinJ.andParkesD. C. Models for truthful online double auctions The 21st Conference on Uncertainty in Artificial Intelligence 2012 Toronto Ontario Canada."},{"key":"e_1_2_10_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.elerap.2011.07.009"},{"key":"e_1_2_10_36_2","doi-asserted-by":"crossref","unstructured":"CaiK. NiuJ. andParsonsS. On the economic effects of competition between double auction markets Agent-Mediated Electronic Commerce and Trading Agent Design and Analysis 2010.","DOI":"10.1007\/978-3-642-15237-5_7"},{"key":"e_1_2_10_37_2","doi-asserted-by":"crossref","unstructured":"ShiB. HuangY. XiongS. andGerdingE. H. Setting an effective pricing policy for double auction marketplaces Pacific Rim International Conference on Artificial Intelligence 2016 Phuket Thailand 457\u2013471.","DOI":"10.1007\/978-3-319-42911-3_38"},{"key":"e_1_2_10_38_2","doi-asserted-by":"crossref","unstructured":"ShiB.andLiX. A game-theoretical analysis of charging strategies for competing double auction marketplaces Multi-Agent Systems and Agreement Technologies 2020 100\u2013115.","DOI":"10.1007\/978-3-030-66412-1_7"},{"key":"e_1_2_10_39_2","doi-asserted-by":"publisher","DOI":"10.1142\/S021952590300089X"},{"key":"e_1_2_10_40_2","unstructured":"HeinrichJ. LanctotM. andSilverD. Fictitious self-play in extensive-form games International Conference on Machine Learning 2015 Lille France 805\u2013813."},{"key":"e_1_2_10_41_2","unstructured":"XiongJ. WangQ. YangZ. SunP. HanL. ZhengY. FuH. ZhangT. LiuJ. andLiuH. Parametrized deep q-networks learning: Reinforcement learning with discrete-continuous hybrid action space 2018 https:\/\/arxiv.org\/abs\/1810.06394."},{"key":"e_1_2_10_42_2","doi-asserted-by":"crossref","unstructured":"FuH. TangH. HaoJ. LeiZ. ChenY. andFanC. Deep multi-agent reinforcement learning with discrete-continuous hybrid action spaces The 21st International Joint Conference on Artificial Intelligence 2019 Pasadena California USA 2329\u20132335.","DOI":"10.24963\/ijcai.2019\/323"},{"key":"e_1_2_10_43_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_2_10_44_2","unstructured":"LillicrapT. P. HuntJ. J. PritzelA. HeessN. ErezT. TassaY. SilverD. andWierstraD. Continuous control with deep reinforcement learning International Conference on Learning Representations 2016 San Juan Puerto Rico."},{"key":"e_1_2_10_45_2","doi-asserted-by":"crossref","unstructured":"MajumdarA. BenavidezP. andJamshidiM. Multi-agent exploration for faster and reliable deep Q-learning convergence in reinforcement learning 2018 World Automation Congress (WAC) 2018 Stevenson WA USA 1\u20136.","DOI":"10.23919\/WAC.2018.8430409"},{"key":"e_1_2_10_46_2","doi-asserted-by":"crossref","unstructured":"TanM. Multi-agent reinforcement learning: independent vs. cooperative agents Proceedings of the Tenth International Conference on Machine Learning 1993 Amherst MA USA 330\u2013337.","DOI":"10.1016\/B978-1-55860-307-3.50049-6"},{"volume-title":"Reinforcement Learning: An Introduction","year":"2018","author":"Richard S.","key":"e_1_2_10_47_2"},{"key":"e_1_2_10_48_2","unstructured":"LoweR. WuY. TamarA. HarbJ. AbbeelP. andMordatchI. Multi-agent actor-critic for mixed cooperative-competitive environments Advances in Neural Information Processing Systems 2017 6379\u20136390."}],"container-title":["Journal of Sensors"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2021\/9651117.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2021\/9651117.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2021\/9651117","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T00:11:49Z","timestamp":1722903109000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2021\/9651117"}},"subtitle":[],"editor":[{"given":"Guolong","family":"Shi","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":48,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1155\/2021\/9651117"],"URL":"https:\/\/doi.org\/10.1155\/2021\/9651117","archive":["Portico"],"relation":{},"ISSN":["1687-725X","1687-7268"],"issn-type":[{"type":"print","value":"1687-725X"},{"type":"electronic","value":"1687-7268"}],"subject":[],"published":{"date-parts":[[2021,1]]},"assertion":[{"value":"2021-11-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-31","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"9651117"}}