{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T14:19:10Z","timestamp":1777299550012,"version":"3.51.4"},"reference-count":35,"publisher":"World Scientific Pub Co Pte Ltd","issue":"11","funder":[{"name":"European Union\u2019s Horizon","award":["899287"],"award-info":[{"award-number":["899287"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2022,11]]},"abstract":"<jats:p>Visual neuroprostheses are a promising approach to restore basic sight in visually impaired people. A major challenge is to condense the sensory information contained in a complex environment into meaningful stimulation patterns at low spatial and temporal resolution. Previous approaches considered task-agnostic feature extractors such as edge detectors or semantic segmentation, which are likely suboptimal for specific tasks in complex dynamic environments. As an alternative approach, we propose to optimize stimulation patterns by end-to-end training of a feature extractor using deep reinforcement learning agents in virtual environments. We present a task-oriented evaluation framework to compare different stimulus generation mechanisms, such as static edge-based and adaptive end-to-end approaches like the one introduced here. Our experiments in Atari games show that stimulation patterns obtained via task-dependent end-to-end optimized reinforcement learning result in equivalent or improved performance compared to fixed feature extractors on high difficulty levels. These findings signify the relevance of adaptive reinforcement learning for neuroprosthetic vision in complex environments.<\/jats:p>","DOI":"10.1142\/s0129065722500526","type":"journal-article","created":{"date-parts":[[2022,8,1]],"date-time":"2022-08-01T02:14:51Z","timestamp":1659320091000},"source":"Crossref","is-referenced-by-count":25,"title":["Optimization of Neuroprosthetic Vision via End-to-End Deep Reinforcement Learning"],"prefix":"10.1142","volume":"32","author":[{"given":"Burcu","family":"K\u00fc\u00e7\u00fcko\u011flu","sequence":"first","affiliation":[{"name":"Department of Artificial Intelligence, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Heyendaalseweg 135, Nijmegen, Gelderland 6525 AJ, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bodo","family":"Rueckauer","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Heyendaalseweg 135, Nijmegen, Gelderland 6525 AJ, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nasir","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Heyendaalseweg 135, Nijmegen, Gelderland 6525 AJ, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jaap de Ruyter","family":"van Steveninck","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Heyendaalseweg 135, Nijmegen, Gelderland 6525 AJ, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Umut","family":"G\u00fc\u00e7l\u00fc","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Heyendaalseweg 135, Nijmegen, Gelderland 6525 AJ, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcel","family":"van Gerven","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Heyendaalseweg 135, Nijmegen, Gelderland 6525 AJ, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2022,11,4]]},"reference":[{"key":"S0129065722500526BIB001","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s42234-018-0013-8","volume":"4","author":"Fern\u00e1ndez E.","year":"2018","journal-title":"Bioelectron. Med."},{"key":"S0129065722500526BIB002","doi-asserted-by":"crossref","first-page":"681","DOI":"10.3389\/fnins.2020.00681","volume":"14","author":"Fern\u00e1ndez E.","year":"2020","journal-title":"Front. Neurosci."},{"issue":"2","key":"S0129065722500526BIB003","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1113\/jphysiol.1968.sp008519","volume":"196","author":"Brindley G.","year":"1968","journal-title":"J. Physiol."},{"key":"S0129065722500526BIB004","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1126\/science.abd7435","volume":"370","author":"Chen X.","year":"2020","journal-title":"Science"},{"key":"S0129065722500526BIB005","doi-asserted-by":"crossref","first-page":"494","DOI":"10.4103\/2008-322X.150830","volume":"9","author":"Maghami M. H.","year":"2014","journal-title":"J. Ophthalmic Vis. Res."},{"key":"S0129065722500526BIB006","doi-asserted-by":"publisher","DOI":"10.1016\/j.tibtech.2013.07.001"},{"issue":"10","key":"S0129065722500526BIB007","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1111\/aor.14022","volume":"45","author":"Wang J.","year":"2021","journal-title":"Artif. Organs"},{"key":"S0129065722500526BIB008","doi-asserted-by":"crossref","first-page":"S92","DOI":"10.1088\/1741-2560\/4\/1\/S11","volume":"4","author":"Dagnelie G.","year":"2007","journal-title":"J. Neural Eng."},{"key":"S0129065722500526BIB009","doi-asserted-by":"crossref","first-page":"026017","DOI":"10.1088\/1741-2560\/10\/2\/026017","volume":"10","author":"Parikh N.","year":"2013","journal-title":"J. Neural Eng."},{"key":"S0129065722500526BIB010","first-page":"2585","volume-title":"2014 36th Annual Int. Conf. IEEE Engineering in Medicine and Biology Society","author":"Vergnieux V.","year":"2014"},{"key":"S0129065722500526BIB011","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065720500458"},{"issue":"1","key":"S0129065722500526BIB012","doi-asserted-by":"crossref","first-page":"16006","DOI":"10.1088\/1741-2560\/7\/1\/016006","volume":"7","author":"Parikh N.","year":"2010","journal-title":"J. Neural Eng."},{"key":"S0129065722500526BIB013","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1145\/3458709.3458982","volume-title":"Augmented Humans Conf. 2021, AHs\u2019,21","author":"Han N.","year":"2021"},{"key":"S0129065722500526BIB014","volume-title":"Proc. IEEE Int. Conf. Computer Vision (ICCV) Workshops","author":"Perez-Yus A.","year":"2017"},{"issue":"1","key":"S0129065722500526BIB015","doi-asserted-by":"crossref","first-page":"016003","DOI":"10.1088\/1741-2560\/12\/1\/016003","volume":"12","author":"McCarthy C.","year":"2014","journal-title":"J. Neural Eng."},{"key":"S0129065722500526BIB016","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0227677"},{"key":"S0129065722500526BIB017","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1111\/aor.12868","volume":"41","author":"Vergnieux V.","year":"2017","journal-title":"Artif. Organs"},{"key":"S0129065722500526BIB018","first-page":"85","volume-title":"The Seventh Australian and New Zealand Intelligent Information Systems Conf.","author":"Boyle J. R.","year":"2001"},{"key":"S0129065722500526BIB019","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2018\/3198342","volume":"2018","author":"Guo F.","year":"2018","journal-title":"Int. J. Biomed. Imaging"},{"key":"S0129065722500526BIB020","doi-asserted-by":"crossref","first-page":"035008","DOI":"10.1088\/1741-2560\/6\/3\/035008","volume":"6","author":"Srivastava N. R.","year":"2009","journal-title":"J. Neural Eng."},{"key":"S0129065722500526BIB021","first-page":"85","volume-title":"2019 8th Int. Conf. Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","author":"Bollen C. J.","year":"2019"},{"key":"S0129065722500526BIB022","doi-asserted-by":"publisher","DOI":"10.1167\/jov.22.2.20"},{"key":"S0129065722500526BIB023","first-page":"2900","volume-title":"2019 41st Annual Int. Conf. IEEE Engineering in Medicine and Biology Society (EMBC)","author":"Casta\u00f1o-Candamil S.","year":"2019"},{"key":"S0129065722500526BIB024","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065709001987"},{"key":"S0129065722500526BIB026","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1016\/j.neuron.2020.06.014","volume":"107","author":"Botvinick M.","year":"2020","journal-title":"Neuron"},{"key":"S0129065722500526BIB028","first-page":"2809","volume-title":"2019 41st Annual Int. Conf. IEEE Engineering in Medicine and Biology Society (EMBC)","author":"White J.","year":"2019"},{"issue":"1","key":"S0129065722500526BIB029","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1109\/THMS.2021.3121661","volume":"52","author":"White J.","year":"2022","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"S0129065722500526BIB030","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"S0129065722500526BIB031","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1613\/jair.5699","volume":"61","author":"Machado M. C.","year":"2018","journal-title":"J. Artif. Intell. Res."},{"key":"S0129065722500526BIB033","first-page":"120","volume":"25","author":"Bradski G.","year":"2000","journal-title":"Dr. Dobb\u2019s Journal of Software Tools"},{"issue":"2","key":"S0129065722500526BIB034","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/jov.22.2.1","volume":"22","author":"van Steveninck J. de Ruyter","year":"2022","journal-title":"J. Vis."},{"key":"S0129065722500526BIB035","first-page":"780","volume":"5369","author":"Dowling J.","year":"2004","journal-title":"Proc. SPIE Int. Soc. Opt. Eng."},{"issue":"8","key":"S0129065722500526BIB036","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1016\/j.imavis.2012.05.007","volume":"30","author":"Barnes N.","year":"2012","journal-title":"Image Vis. Comput."},{"issue":"86","key":"S0129065722500526BIB037","first-page":"2579","volume":"9","author":"van der Maaten L.","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"S0129065722500526BIB038","series-title":"Proceedings of Machine Learning Research","first-page":"507","volume-title":"Proc. 37th Int. Conf. Machine Learning","volume":"119","author":"Badia A. P."}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065722500526","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,26]],"date-time":"2022-11-26T02:40:25Z","timestamp":1669430425000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0129065722500526"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11]]},"references-count":35,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2022,11]]}},"alternative-id":["10.1142\/S0129065722500526"],"URL":"https:\/\/doi.org\/10.1142\/s0129065722500526","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.02.25.482017","asserted-by":"object"}]},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11]]},"article-number":"2250052"}}