{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T13:25:03Z","timestamp":1777728303087,"version":"3.51.4"},"reference-count":25,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IA"],"published-print":{"date-parts":[[2022,7,8]]},"abstract":"<jats:p>Nowadays, micro-mobility sharing systems have become extremely popular. Such systems consist in fleets of dockless electric vehicles which are deployed in cities, and used by citizens to move in a more ecological and flexible way. Unfortunately, one of the issues related to such technologies is its intrinsic load imbalance, since users can pick up and drop off the electric vehicles where they prefer. In this paper we present ESB-DQN, a multi-agent system for E-Scooter Balancing (ESB) based on Deep Reinforcement Learning where agents are implemented as Deep Q-Networks (DQN). ESB-DQN offers suggestions to pick or return e-scooters in order to make the fleet usage and sharing as balanced as possible, still ensuring that the original plans of the user undergo only minor changes. The main contributions of this paper include a careful analysis of the state of the art, an innovative customer-oriented rebalancing strategy, the integration of state-of-the-art libraries for deep Reinforcement Learning into the existing ODySSEUS simulator of mobility sharing systems, and preliminary but promising experiments that suggest that our approach is worth further exploration.<\/jats:p>","DOI":"10.3233\/ia-210126","type":"journal-article","created":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T11:10:16Z","timestamp":1657278616000},"page":"49-67","source":"Crossref","is-referenced-by-count":9,"title":["Smart balancing of E-scooter sharing systems via deep reinforcement learning: a preliminary study"],"prefix":"10.1177","volume":"16","author":[{"given":"Gianvito","family":"Losapio","sequence":"first","affiliation":[{"name":"DIBRIS, University of Genova, Italy"}]},{"given":"Federico","family":"Minutoli","sequence":"additional","affiliation":[{"name":"DIBRIS, University of Genova, Italy"}]},{"given":"Viviana","family":"Mascardi","sequence":"additional","affiliation":[{"name":"DIBRIS, University of Genova, Italy"}]},{"given":"Angelo","family":"Ferrando","sequence":"additional","affiliation":[{"name":"DIBRIS, University of Genova, Italy"}]}],"member":"179","reference":[{"key":"10.3233\/IA-210126_ref1","doi-asserted-by":"crossref","first-page":"102424","DOI":"10.1016\/j.cities.2019.102424","article-title":"Exploring the adoption of moped scooter-sharing systems in spanish urban areas","volume":"96","author":"Aguilera-Garc\u00eda","year":"2020","journal-title":"Cities"},{"key":"10.3233\/IA-210126_ref2","unstructured":"Austin shared micro-mobility open data, 2019."},{"issue":"22","key":"10.3233\/IA-210126_ref3","doi-asserted-by":"crossref","first-page":"9640","DOI":"10.3390\/su12229640","article-title":"Electric scooter sharing and bike sharing user behaviour and characteristics","volume":"12","author":"Bieli\u0144ski","year":"2020","journal-title":"Sustainability"},{"key":"10.3233\/IA-210126_ref4","unstructured":"Bui A. , Slowik P. and Lutsey N. , Evaluating electric vehicle market growth across U.S. cities. In The International Council on Clean Transportation, 2021."},{"key":"10.3233\/IA-210126_ref5","doi-asserted-by":"crossref","unstructured":"Carrese S. , D\u2019Andreagiovanni F. , Giacchetti T. , Nardin A. and Zamberlan L. , A beautiful fleet: Optimal repositioning in e-scooter sharing systems for urban decorum, Transportation Research Procedia 52 (2020), 581\u2013588. 23rd EUROWorking Group on Transportation Meeting, EWGT 2020, 16-18 September 2020, Paphos, Cyprus.","DOI":"10.1016\/j.trpro.2021.01.069"},{"key":"10.3233\/IA-210126_ref6","unstructured":"Annie Y.J. Chang, L. Miranda-Moreno, R. Clewlow and L. Sun, Trend or fad? deciphering the enablers of micromobility in the US. SAE International, 2019."},{"key":"10.3233\/IA-210126_ref7","doi-asserted-by":"crossref","unstructured":"Ciociola A. , Cocca M. , Giordano D. , Vassio L. and Mellia M. , E-scooter sharing: Leveraging open data for system design. In 2020 IEEE\/ACM DS-RT, pp. 1\u20138. IEEE, 2020.","DOI":"10.1109\/DS-RT50469.2020.9213514"},{"key":"10.3233\/IA-210126_ref9","doi-asserted-by":"crossref","unstructured":"Duan Y. and Wu J. , Optimizing rebalance scheme for dock-less bike-sharing systems with adaptive user incentive. In 2019 IEEE MDM, pp. 176\u2013181. IEEE, 2019.","DOI":"10.1109\/MDM.2019.00-59"},{"key":"10.3233\/IA-210126_ref10","doi-asserted-by":"crossref","first-page":"102327","DOI":"10.1016\/j.trd.2020.102327","article-title":"Adoption intentions for micro-mobility \u2013 insights from electric scooter sharing in Taiwan","volume":"84","author":"Eccarius","year":"2020","journal-title":"Transportation Research part D: Transport and Environment"},{"issue":"3","key":"10.3233\/IA-210126_ref11","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s13676-014-0053-5","article-title":"Incentives and redistribution in homogeneous bike-sharing systems with stations of finite capacity","volume":"5","author":"Fricker","year":"2016","journal-title":"EURO Journal on Transportation and Logistics"},{"key":"10.3233\/IA-210126_ref12","doi-asserted-by":"crossref","first-page":"5236","DOI":"10.1109\/ACCESS.2018.2795247","article-title":"Stabilizing an urban semi-autonomous bicycle","volume":"6","author":"Ramos Garc\u00eda","year":"2018","journal-title":"IEEE Access"},{"key":"10.3233\/IA-210126_ref13","first-page":"1","article-title":"Distribution prediction for reconfiguring urban dockless e-scooter sharing systems","author":"He","year":"2021","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"10.3233\/IA-210126_ref14","doi-asserted-by":"crossref","unstructured":"Hessel M. , Modayil J. , van Hasselt H. , T. Schaul, G. Ostrovski, W. Dabney, D. Horgan, B. Piot, M. Gheshlaghi Azar and D. Silver, Rainbow: Combining improvements in deep reinforcement learning, CoRR, abs\/1710.02298, 2017.","DOI":"10.1609\/aaai.v32i1.11796"},{"key":"10.3233\/IA-210126_ref16","unstructured":"Diederik P. Kingma and J. Ba, Adam: A method for stochastic optimization. In Yoshua Bengio and Yann LeCun, editors, 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings. 2015."},{"key":"10.3233\/IA-210126_ref17","first-page":"1","article-title":"Estimating the potential for shared autonomous scooters","author":"Kondor","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"10.3233\/IA-210126_ref18","doi-asserted-by":"crossref","unstructured":"Liu J. , Sun L. , Chen W. and Xiong H. , Rebalancing bike-sharing systems: A multi-source data smart optimization. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD\u201916, pp. 1005\u20131014, New York, NY, USA, 2016. Association for Computing Machinery.","DOI":"10.1145\/2939672.2939776"},{"key":"10.3233\/IA-210126_ref19","unstructured":"Losapio G. , Minutoli F. , Mascardi V. and Ferrando A. , Smart balancing of e-scooter sharing systems via deep reinforcement learning. In Roberta Calegari, Giovanni Ciatto, Enrico Denti, Andrea Omicini, and Giovanni Sartor, editors, Proceedings of the 22nd Workshop \u201cFrom Objects to Agents\", Bologna, Italy , September 1-3, 2021, volume 2963 of CEUR Workshop Proceedings, pp. 83\u201397. CEURWS.org, 2021."},{"issue":"7540","key":"10.3233\/IA-210126_ref20","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"10.3233\/IA-210126_ref21","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1609\/aaai.v33i01.33011393","article-title":"A deep reinforcement learning framework for rebalancing dockless bike-sharing systems","author":"Pan","year":"2019","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"issue":"4","key":"10.3233\/IA-210126_ref22","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1109\/TITS.2014.2303986","article-title":"Dynamic vehicle redistribution and online price incentives in shared mobility systems","volume":"15","author":"Pfrommer","year":"2014","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"10.3233\/IA-210126_ref23","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.tre.2014.10.005","article-title":"Proactive vehicle routing with inferred demand to solve the bike-sharing rebalancing problem","volume":"72","author":"Regue","year":"2014","journal-title":"Transportation Research Part E: Logistics and Transportation Review"},{"key":"10.3233\/IA-210126_ref24","unstructured":"Scott Smith C. and Joseph P. Schwieterman, E-scooter scenarios: Evaluating the potential mobility benefits of shared dockless scooters in Chicago. Available online., 2018."},{"key":"10.3233\/IA-210126_ref25","doi-asserted-by":"crossref","unstructured":"Spieker H. , Constraint-guided reinforcement learning: Augmenting the agent-environment interaction. CoRR, abs\/2104.11918, 2021.","DOI":"10.1109\/IJCNN52387.2021.9533996"},{"key":"10.3233\/IA-210126_ref26","doi-asserted-by":"crossref","unstructured":"Yi P. , Huang F. and Peng J. , A rebalancing strategy for the imbalance problem in bike-sharing systems, Energies 12(13), 2019.","DOI":"10.3390\/en12132578"},{"key":"10.3233\/IA-210126_ref27","doi-asserted-by":"crossref","first-page":"101483","DOI":"10.1016\/j.compenvurbsys.2020.101483","article-title":"Understanding spatio-temporal heterogeneity of bikesharing and scooter-sharing mobility","volume":"81","author":"Zhu","year":"2020","journal-title":"Computers, Environment and Urban Systems"}],"container-title":["Intelligenza Artificiale"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IA-210126","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:51:44Z","timestamp":1777459904000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IA-210126"}},"subtitle":[],"editor":[{"given":"Roberta","family":"Calegari","sequence":"additional","affiliation":[]},{"given":"Giovanni","family":"Ciatto","sequence":"additional","affiliation":[]},{"given":"Andrea","family":"Omicini","sequence":"additional","affiliation":[]},{"given":"Giuseppe","family":"Vizzari","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,7,8]]},"references-count":25,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/ia-210126","relation":{},"ISSN":["1724-8035","2211-0097"],"issn-type":[{"value":"1724-8035","type":"print"},{"value":"2211-0097","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,8]]}}}