{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T06:25:36Z","timestamp":1783405536010,"version":"3.54.6"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,10,2]],"date-time":"2025-10-02T00:00:00Z","timestamp":1759363200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>With the rapid growth of e-commerce and online auction markets, malicious bidding activities have severely disrupted market order. Traditional detection methods face limitations due to their inability to effectively address the covert nature, dynamic characteristics, and massive data volumes associated with such behaviors. To address this challenge, this paper proposes a detection method for users engaging in malicious bidding based on Multi-Agent Reinforcement Learning (MARL). This approach first models target users as specialized agents, then integrates their historical bidding data, and finally learns optimal strategies through competitive games with adversarial agents. Additionally, this paper designs a dynamic adjustment mechanism for the maliciousness coefficient to simulate user behavior changes, enabling precise assessment of malicious intent. Compared to existing fraud detection approaches based on reinforcement learning, the fundamental innovation lies not merely in applying MARL technology, but in introducing the novel \u201cdynamic maliciousness coefficient\u201d mechanism. This mechanism achieves dynamic and precise maliciousness assessment through mathematical modeling and real-time iteration, addressing the shortcomings of traditional MARL models in capturing user behavioral heterogeneity. Experimental results demonstrate that this method exhibits higher detection accuracy and adaptability in complex dynamic market environments. It effectively captures bidder interaction relationships, significantly enhancing the detection of malicious behavior.<\/jats:p>","DOI":"10.3389\/fcomp.2025.1670238","type":"journal-article","created":{"date-parts":[[2025,10,2]],"date-time":"2025-10-02T05:30:50Z","timestamp":1759383050000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Market malicious bidding user detection based on multi-agent reinforcement learning"],"prefix":"10.3389","volume":"7","author":[{"given":"Peng","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yimeng","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yilin","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yin","family":"Lan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziyang","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Di","family":"Tang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Liang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,10,2]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3502289","article-title":"Ai in finance: Challenges, techniques, and opportunities","volume":"55","author":"Cao","year":"2022","journal-title":"ACM Comp. Surv"},{"key":"B2","article-title":"\u201cPoster: Actively detecting implicit fraudulent transactions,\u201d","author":"Cao","year":"2017","journal-title":"Proceedings of the"},{"key":"B3","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1007\/s00521-024-10649-6","article-title":"Real-time bidding with multi-agent reinforcement learning in multi-channel display advertising","volume":"37","author":"Chen","year":"2024","journal-title":"Neural Comp. Appl"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2506.13113","article-title":"Dynamic reinsurance treaty bidding via multi-agent reinforcement learning","author":"Dong","year":"2025","journal-title":"arXiv"},{"key":"B5","doi-asserted-by":"publisher","first-page":"3857","DOI":"10.1007\/s11831-024-10095-6","article-title":"A systematic review on game-theoretic models and different types of security requirements in cloud environment: challenges and opportunities","volume":"31","author":"Gill","year":"2024","journal-title":"Arch. Comp. Methods Eng"},{"key":"B6","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1080\/21642583.2021.1891992","article-title":"Game analysis of merchants and consumers confronting fakes on e-commerce platforms","volume":"9","author":"Guo","year":"2021","journal-title":"Syst. Sci. Cont. Eng"},{"key":"B7","doi-asserted-by":"publisher","first-page":"109650","DOI":"10.1016\/j.comnet.2023.109650","article-title":"Federated learning using game strategies: State-of-the-art and future trends","volume":"225","author":"Gupta","year":"2023","journal-title":"Comp. Netw"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2004.02764","article-title":"Using multi-agent reinforcement learning in auction simulations","author":"Kanmaz","year":"2020","journal-title":"arXiv"},{"key":"B9","doi-asserted-by":"publisher","first-page":"375","DOI":"10.3390\/biomimetics10060375","article-title":"Multi-agent reinforcement learning in games: Research and applications","volume":"10","author":"Li","year":"2025","journal-title":"Biomimetics"},{"key":"B10","doi-asserted-by":"publisher","first-page":"3790","DOI":"10.1109\/TCE.2025.3544802","article-title":"Self-organization scheduling of dynamic aav-md networks via three-layer hierarchical reinforcement learning","volume":"71","author":"Liao","year":"2025","journal-title":"IEEE Trans. Consum. Elect"},{"key":"B11","article-title":"\u201cAn unsupervised incremental virtual learning method for financial fraud detection,\u201d","author":"Ma","year":"2019","journal-title":"2019 IEEE\/ACS 16th International Conference on Computer Systems and Applications"},{"key":"B12","first-page":"111","article-title":"Detecting collusive seller shill bidding using social network analysis","volume":"20","author":"Majadi","year":"2024","journal-title":"J. Inform. Syst. Secur"},{"key":"B13","doi-asserted-by":"publisher","first-page":"236","DOI":"10.3934\/DSFE.2024009","article-title":"Credit scoring using machine learning and deep learning-based models","volume":"4","author":"Mestiri","year":"2024","journal-title":"Data Sci. Finance Econ"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3640312","article-title":"Security and privacy issues in deep reinforcement learning: threats and countermeasures","volume":"56","author":"Mo","year":"2024","journal-title":"ACM Comp. Surv"},{"key":"B15","doi-asserted-by":"publisher","first-page":"121252","DOI":"10.1016\/j.eswa.2023.121252","article-title":"Distributed dynamic pricing of multiple perishable products using multi-agent reinforcement learning","volume":"237","author":"Qiao","year":"2024","journal-title":"Expert Syst. Appl"},{"key":"B16","doi-asserted-by":"publisher","first-page":"103858","DOI":"10.1016\/j.jnca.2024.103858","article-title":"AI-enhanced blockchain technology: a review of advancements and opportunities","volume":"225","author":"Ressi","year":"2024","journal-title":"J. Netw. Comp. Appl"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2507.09179","article-title":"Hide-and-shill: A reinforcement learning framework for market manipulation detection in symphony-a decentralized multi-agent system","author":"Shi","year":"2025","journal-title":"arXiv"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1238","DOI":"10.1007\/s13235-023-00550-7","article-title":"A strongly group strategyproof and shill resistant bargaining mechanism for fog resource pricing","volume":"14","author":"Sim","year":"2024","journal-title":"Dynam. Games Appl"},{"key":"B19","doi-asserted-by":"publisher","first-page":"53","DOI":"10.3934\/DSFE.2024002","article-title":"Valuation of big data analytics quality and competitive advantage with strategic alignment model: from greek philosophy to contemporary conceptualization","volume":"4","author":"Theodorou","year":"2024","journal-title":"Data Sci. Finance Econ"},{"key":"B20","doi-asserted-by":"publisher","first-page":"111235","DOI":"10.1016\/j.asoc.2024.111235","article-title":"Intelligent strategic bidding in competitive electricity markets using multi-agent simulation and deep reinforcement learning","volume":"152","author":"Wu","year":"2024","journal-title":"Appl. Soft Comput"},{"key":"B21","doi-asserted-by":"publisher","first-page":"518","DOI":"10.1109\/TPWRS.2024.3404472","article-title":"Multi-agent deep reinforcement learning for simulating centralized double-sided auction electricity market","volume":"40","author":"Yin","year":"2025","journal-title":"IEEE Trans. Power Syst"},{"key":"B22","doi-asserted-by":"publisher","first-page":"101063","DOI":"10.1016\/j.suscom.2024.101063","article-title":"Sustainable supply chain management: A green computing approach using deep q-networks","volume":"45","author":"Yuan","year":"2025","journal-title":"Sustain. Comp.: Inform. Syst"},{"key":"B23","doi-asserted-by":"publisher","first-page":"12979","DOI":"10.1007\/s00521-020-05243-5","article-title":"Evolution of cooperation in malicious social networks with differential privacy mechanisms","volume":"35","author":"Zhang","year":"","journal-title":"Neural Comp. Appl"},{"key":"B24","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1016\/j.neucom.2019.08.106","article-title":"Ev charging bidding by multi-dqn reinforcement learning in electricity auction market","volume":"397","author":"Zhang","year":"","journal-title":"Neurocomp"},{"key":"B25","doi-asserted-by":"publisher","first-page":"065","DOI":"10.53106\/199115992024023501005","article-title":"Efficient first-price sealed e-auction protocol under secure multi-party computational malicious model","volume":"35","author":"Zhou","year":"2024","journal-title":"J. Inform. Sci. Eng"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TITS.2025.3557259","article-title":"Reinforcement learning-based edge server placement in the intelligent internet of vehicles environment","volume":"2025","author":"Zhou","year":"2025","journal-title":"IEEE Trans. Intellig. Transport. Syst"},{"key":"B27","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1016\/j.future.2017.07.048","article-title":"Minimizing sla violation and power consumption in cloud data centers using adaptive energy-aware algorithms","volume":"86","author":"Zhou","year":"2018","journal-title":"Future Generat. Comp. Syst"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1747","DOI":"10.1109\/TGCN.2021.3111909","article-title":"IADE: An improved differential evolution algorithm to preserve sustainability in a 6G network","volume":"5","author":"Zhou","year":"","journal-title":"IEEE Trans. Green Commun. Network"},{"key":"B29","doi-asserted-by":"publisher","first-page":"658","DOI":"10.1109\/TGCN.2021.3067309","article-title":"Afed-ef: An energy-efficient vm allocation algorithm for iot applications in a cloud data center","volume":"5","author":"Zhou","year":"","journal-title":"IEEE Trans. Green Commun. Network"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1670238\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,2]],"date-time":"2025-10-02T05:30:51Z","timestamp":1759383051000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1670238\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,2]]},"references-count":29,"alternative-id":["10.3389\/fcomp.2025.1670238"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2025.1670238","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,2]]},"article-number":"1670238"}}