{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T02:52:17Z","timestamp":1771037537943,"version":"3.50.1"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"S18","license":[{"start":{"date-parts":[[2019,11,1]],"date-time":"2019-11-01T00:00:00Z","timestamp":1572566400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,11,25]],"date-time":"2019-11-25T00:00:00Z","timestamp":1574640000000},"content-version":"vor","delay-in-days":24,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2019,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Collective cell migration is a significant and complex phenomenon that affects many basic biological processes. The coordination between leader cell and follower cell affects the rate of collective cell migration. However, there are still very few papers on the impacts of the stimulus signal released by the leader on the follower. Tracking cell movement using 3D time-lapse microscopy images provides an unprecedented opportunity to systematically study and analyze collective cell migration.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Recently, deep reinforcement learning algorithms have become very popular. In our paper, we also use this method to train the number of cells and control signals. By experimenting with single-follower cell and multi-follower cells, it is concluded that the number of stimulation signals is proportional to the rate of collective movement of the cells. Such research provides a more diverse approach and approach to studying biological problems.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Traditional research methods are always based on real-life scenarios, but as the number of cells grows exponentially, the research process is too time consuming. Agent-based modeling is a robust framework that approximates cells to isotropic, elastic, and sticky objects. In this paper, an agent-based modeling framework is used to establish a simulation platform for simulating collective cell migration. The goal of the platform is to build a biomimetic environment to demonstrate the importance of stimuli between the leading and following cells.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12859-019-3126-5","type":"journal-article","created":{"date-parts":[[2019,11,25]],"date-time":"2019-11-25T00:02:47Z","timestamp":1574640167000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Using deep reinforcement learning to speed up collective cell migration"],"prefix":"10.1186","volume":"20","author":[{"given":"Hanxu","family":"Hou","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tian","family":"Gan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaodong","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xianglei","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sen","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiming","family":"Guo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianye","family":"Hao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,11,25]]},"reference":[{"issue":"6865","key":"3126_CR1","doi-asserted-by":"publisher","first-page":"813","DOI":"10.1038\/414813a","volume":"414","author":"M Brownlee","year":"2001","unstructured":"Brownlee M. Biochemistry and molecular cell biology of diabetic complications. Nature. 2001; 414(6865):813\u201320.","journal-title":"Nature"},{"issue":"5","key":"3126_CR2","first-page":"303","volume":"3","author":"A Revathi","year":"2007","unstructured":"Revathi A, Allen E. The forces behind cell movement. Int J Biol Sci. 2007; 3(5):303\u201317.","journal-title":"Int J Biol Sci"},{"key":"3126_CR3","doi-asserted-by":"publisher","unstructured":"Peng J, Hui W, Li Q, Chen B, Jiang Q, Shang X, Wei Z. A learning-based framework for miRNA-disease association prediction using neural networks. 2018. https:\/\/doi.org\/10.1101\/276048.","DOI":"10.1101\/276048"},{"issue":"8","key":"3126_CR4","doi-asserted-by":"publisher","first-page":"777","DOI":"10.1038\/ncb2548","volume":"14","author":"P Friedl","year":"2012","unstructured":"Friedl P, Locker J, Sahai E, Segall JE. Classifying collective cancer cell invasion. Nat Cell Biol. 2012; 14(8):777\u201383.","journal-title":"Nat Cell Biol"},{"issue":"11-12","key":"3126_CR5","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1039\/c0ib00052c","volume":"2","author":"AA Khalil","year":"2010","unstructured":"Khalil AA, Friedl P. Determinants of leader cells in collective cell migration. Integr Biol. 2010; 2(11-12):568\u201374.","journal-title":"Integr Biol"},{"issue":"9","key":"3126_CR6","doi-asserted-by":"publisher","first-page":"556","DOI":"10.1016\/j.tcb.2015.06.003","volume":"25","author":"A Haeger","year":"2015","unstructured":"Haeger A, Wolf K, Zegers MM, Friedl P. Collective cell migration: guidance principles and hierarchies. Trends Cell Biol. 2015; 25(9):556\u201366.","journal-title":"Trends Cell Biol"},{"key":"3126_CR7","doi-asserted-by":"publisher","first-page":"6556","DOI":"10.1038\/ncomms7556","volume":"6","author":"R Riahi","year":"2015","unstructured":"Riahi R, Sun J, Wang S, Long M, Zhang DD, Wong PK. Notch1-dll4 signaling and mechanical force regulate leader cell formation during collective cell migration. Nat Commun. 2015; 6:6556.","journal-title":"Nat Commun"},{"issue":"1-2","key":"3126_CR8","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1016\/j.cell.2013.11.046","volume":"156","author":"Z Du","year":"2014","unstructured":"Du Z, Santella A, He F, Tiongson M, Bao Z. De novo inference of systems-level mechanistic models of development from live-imaging-based phenotype analysis. Cell. 2014; 156(1-2):359\u201372.","journal-title":"Cell"},{"issue":"5","key":"3126_CR9","doi-asserted-by":"publisher","first-page":"592","DOI":"10.1016\/j.devcel.2015.07.014","volume":"34","author":"Z Du","year":"2015","unstructured":"Du Z, Santella A, He F, Shah P, Kamikawa Y, Bao Z. The regulatory landscape of lineage differentiation in a metazoan embryo. Dev Cell. 2015; 34(5):592\u2013607.","journal-title":"Dev Cell"},{"issue":"Database issue","key":"3126_CR10","first-page":"732","volume":"41","author":"K Kyoda","year":"2013","unstructured":"Kyoda K, Adachi E, Masuda E, Nagai Y, Suzuki Y, Oguro T, Urai M, Arai R, Furukawa M, Shimada K. Wddd: Worm developmental dynamics database. Nucleic Acids Res. 2013; 41(Database issue):732.","journal-title":"Nucleic Acids Res"},{"key":"3126_CR11","doi-asserted-by":"publisher","first-page":"226","DOI":"10.3389\/fgene.2019.00226","volume":"10","author":"J Peng","year":"2019","unstructured":"Peng J, Guan J, Shang X. Predicting parkinson\u2019s disease genes based on node2vec and autoencoder. Front Genet. 2019; 10:226.","journal-title":"Front Genet"},{"issue":"20","key":"3126_CR12","doi-asserted-by":"publisher","first-page":"2641","DOI":"10.1093\/bioinformatics\/btq437","volume":"26","author":"S Hoehme","year":"2010","unstructured":"Hoehme S, Drasdo D. A cell-based simulation software for multi-cellular systems. Bioinformatics. 2010; 26(20):2641.","journal-title":"Bioinformatics"},{"issue":"24","key":"3126_CR13","doi-asserted-by":"publisher","first-page":"3798","DOI":"10.1093\/bioinformatics\/btw551","volume":"32","author":"AL Olivares","year":"2016","unstructured":"Olivares AL, Gonz\u00e1lez Ballester MA, Noailly J. Virtual exploration of early stage atherosclerosis. Bioinformatics. 2016; 32(24):3798.","journal-title":"Bioinformatics"},{"issue":"8","key":"3126_CR14","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1186\/s12859-019-2769-6","volume":"20","author":"J Peng","year":"2019","unstructured":"Peng J, Wang X, Shang X. Combining gene ontology with deep neural networks to enhance the clustering of single cell rna-seq data. BMC bioinformatics. 2019; 20(8):284.","journal-title":"BMC bioinformatics"},{"issue":"1","key":"3126_CR15","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1613\/jair.301","volume":"4","author":"LP Kaelbling","year":"1996","unstructured":"Kaelbling LP, Littman ML, Moore AW. Reinforcement learning: A survey. J Artif Intell Res. 1996; 4(1):237\u201385.","journal-title":"J Artif Intell Res"},{"key":"3126_CR16","doi-asserted-by":"publisher","unstructured":"Hu Y, Zhao T, Zang T, Zhang Y, Cheng L. Identification of alzheimer\u2019s disease-related genes based on data integration method. Front Genet. 2018; 9. https:\/\/doi.org\/10.3389\/fgene.2018.00703.","DOI":"10.3389\/fgene.2018.00703"},{"key":"3126_CR17","volume-title":"Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems","author":"Y Wang","year":"2018","unstructured":"Wang Y, Lu W, Hao J, Wei J, Leung H-F. Efficient convention emergence through decoupled reinforcement social learning with teacher-student mechanism. In: Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems. Stockholm: International Foundation for Autonomous Agents and Multiagent Systems: 2018. p. 795\u2013803."},{"key":"3126_CR18","volume-title":"European Conference on Artificial Intelligence","author":"T Yang","year":"2016","unstructured":"Yang T, Meng Z, Hao J, Sen S, Yu C. Accelerating norm emergence through hierarchical heuristic learning. In: European Conference on Artificial Intelligence. Netherlands: IOS Press and Hague: 2016."},{"key":"3126_CR19","doi-asserted-by":"publisher","unstructured":"Strehl AL, Li L, Wiewiora E, Langford J, Littman ML. Pac model-free reinforcement learning. In: Proceedings of the 23rd international conference on Machine learning \u2013 ICML\u201906. ACM Press: 2006. https:\/\/doi.org\/10.1145\/1143844.1143955.","DOI":"10.1145\/1143844.1143955"},{"key":"3126_CR20","doi-asserted-by":"crossref","unstructured":"Arulkumaran K, Deisenroth MP, Brundage M, Bharath AA. A brief survey of deep reinforcement learning. 2017. arXiv preprint arXiv:1708.05866.","DOI":"10.1109\/MSP.2017.2743240"},{"key":"3126_CR21","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/j.engappai.2016.11.008","volume":"58","author":"J Hao","year":"2017","unstructured":"Hao J, Huang D, Cai Y, Leung HF. The dynamics of reinforcement social learning in networked cooperative multiagent systems. Eng Appl Artif Intell. 2017; 58:111\u201322.","journal-title":"Eng Appl Artif Intell"},{"key":"3126_CR22","volume-title":"Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence","author":"G Weiss","year":"2000","unstructured":"Weiss G. Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence. Cambridge: The MIT Press; 2000."},{"issue":"1","key":"3126_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2200\/S00091ED1V01Y200705AIM002","volume":"1","author":"N Vlassis","year":"2007","unstructured":"Vlassis N. A concise introduction to multiagent systems and distributed artificial intelligence. Synthesis Lectures on Artificial Intelligence and Machine Learning. 2007; 1(1):1\u201371. Morgan & Claypool Publishers.","journal-title":"Synthesis Lectures on Artificial Intelligence and Machine Learning"},{"key":"3126_CR24","doi-asserted-by":"publisher","unstructured":"Yang Y, Hao J, Sun M, Wang Z, Fan C, Strbac G. Recurrent deep multiagent q-learning for autonomous brokers in smart grid. In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization: 2018. https:\/\/doi.org\/10.24963\/ijcai.2018\/79.","DOI":"10.24963\/ijcai.2018\/79"},{"key":"3126_CR25","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/j.engappai.2016.11.008","volume":"58","author":"J Hao","year":"2017","unstructured":"Hao J, Huang D, Cai Y, Leung H-F. The dynamics of reinforcement social learning in networked cooperative multiagent systems. Eng Appl Artif Intell. 2017; 58:111\u201322.","journal-title":"Eng Appl Artif Intell"},{"issue":"4","key":"3126_CR26","first-page":"20","volume":"9","author":"J Hao","year":"2015","unstructured":"Hao J, Leung H-F, Ming Z. Multiagent reinforcement social learning toward coordination in cooperative multiagent systems. ACM Trans Autom Adapt Syst (TAAS). 2015; 9(4):20.","journal-title":"ACM Trans Autom Adapt Syst (TAAS)"},{"issue":"2","key":"3126_CR27","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1109\/TSMCC.2007.913919","volume":"38","author":"L Busoniu","year":"2008","unstructured":"Busoniu L, Babuska R, De Schutter B. A comprehensive survey of multiagent reinforcement learning. Trans Syst IEEE Man Cybern C Appl Rev. 2008; 38(2):156\u2013172.","journal-title":"Trans Syst IEEE Man Cybern C Appl Rev"},{"issue":"7","key":"3126_CR28","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1038\/nrm2720","volume":"10","author":"P Friedl","year":"2009","unstructured":"Friedl P, Hegerfeldt Y, Tusch M. Collective cell migration in morphogenesis and cancer. Nat Rev Mol Cell Biol. 2009; 10(7):445\u201357.","journal-title":"Nat Rev Mol Cell Biol"},{"issue":"11","key":"3126_CR29","doi-asserted-by":"publisher","first-page":"1953","DOI":"10.1093\/bioinformatics\/bty002","volume":"34","author":"L Cheng","year":"2018","unstructured":"Cheng L, Hu Y, Sun J, Zhou M, Jiang Q. Dincrna: a comprehensive web-based bioinformatics toolkit for exploring disease associations and ncrna function. Bioinformatics. 2018; 34(11):1953\u20136.","journal-title":"Bioinformatics"},{"issue":"D1","key":"3126_CR30","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1093\/nar\/gky1051","volume":"47","author":"L Cheng","year":"2018","unstructured":"Cheng L, Wang P, Tian R, Wang S, Guo Q, Luo M, Zhou W, Liu G, Jiang H, Jiang Q. Lncrna2target v2. 0: a comprehensive database for target genes of lncrnas in human and mouse. Nucleic Acids Res. 2018; 47(D1): 140\u20134.","journal-title":"Nucleic Acids Res"},{"issue":"18","key":"3126_CR31","doi-asserted-by":"publisher","first-page":"3203","DOI":"10.1242\/jcs.036525","volume":"122","author":"O Ilina","year":"2009","unstructured":"Ilina O, Friedl P. Mechanisms of collective cell migration at a glance. J Cell Sci. 2009; 122(18):3203\u20138.","journal-title":"J Cell Sci"},{"issue":"18","key":"3126_CR32","doi-asserted-by":"publisher","first-page":"3215","DOI":"10.1242\/jcs.036517","volume":"122","author":"CJ Weijer","year":"2009","unstructured":"Weijer CJ. Collective cell migration in development. J Cell Sci. 2009; 122(18):3215\u201323.","journal-title":"J Cell Sci"},{"issue":"5","key":"3126_CR33","first-page":"1054","volume":"9","author":"B Arnold","year":"1998","unstructured":"Arnold B. Reinforcement learning: An introduction (adaptive computation and machine learning). IEEE Trans Neural Netw. 1998; 9(5):1054.","journal-title":"IEEE Trans Neural Netw"},{"issue":"1","key":"3126_CR34","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1016\/S0925-2312(00)00324-6","volume":"35","author":"JD Johnson","year":"2000","unstructured":"Johnson JD, Li J, Chen Z. Reinforcement learning: An introduction : R.s. sutton, a.g. barto, mit press, cambridge, ma 1998, 322 pp. isbn 0-262-19398-1. Neurocomputing. 2000; 35(1):205\u20136.","journal-title":"Neurocomputing"},{"issue":"18","key":"3126_CR35","doi-asserted-by":"publisher","first-page":"3169","DOI":"10.1093\/bioinformatics\/bty323","volume":"34","author":"Zi Wang","year":"2018","unstructured":"Wang Z, Wang D, Li C, Xu Y, Li H, Bao Z. Deep reinforcement learning of cell movement in the early stage of c. elegans embryogenesis. Bioinformatics; 34(18):3169\u201377.","journal-title":"Bioinformatics"},{"issue":"3-4","key":"3126_CR36","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/BF00992698","volume":"8","author":"CJCH Watkins","year":"1992","unstructured":"Watkins CJCH, Dayan P. Q -learning. Mach Learn. 1992; 8(3-4):279\u201392.","journal-title":"Mach Learn"},{"key":"3126_CR37","unstructured":"Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D, Riedmiller M. Playing atari with deep reinforcement learning. Comput Sci. 2013. arXiv preprint arXiv:1312.5602."},{"issue":"7540","key":"3126_CR38","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G. Human-level control through deep reinforcement learning. Nature. 2015; 518(7540):529.","journal-title":"Nature"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-019-3126-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12859-019-3126-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-019-3126-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,24]],"date-time":"2020-11-24T00:11:53Z","timestamp":1606176713000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-019-3126-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11]]},"references-count":38,"journal-issue":{"issue":"S18","published-print":{"date-parts":[[2019,11]]}},"alternative-id":["3126"],"URL":"https:\/\/doi.org\/10.1186\/s12859-019-3126-5","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11]]},"assertion":[{"value":"25 November 2019","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"571"}}