{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T03:23:21Z","timestamp":1774409001140,"version":"3.50.1"},"reference-count":39,"publisher":"Institute of Electronics, Information and Communications Engineers (IEICE)","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Electron."],"published-print":{"date-parts":[[2022,2,1]]},"DOI":"10.1587\/transele.2021ecp5013","type":"journal-article","created":{"date-parts":[[2021,8,23]],"date-time":"2021-08-23T22:08:20Z","timestamp":1629756500000},"page":"95-101","source":"Crossref","is-referenced-by-count":8,"title":["A Reinforcement Learning Method for Optical Thin-Film Design"],"prefix":"10.1587","volume":"E105.C","author":[{"given":"Anqing","family":"JIANG","sequence":"first","affiliation":[{"name":"Graduate School of Information, Production and Systems, Waseda University"}]},{"given":"Osamu","family":"YOSHIE","sequence":"additional","affiliation":[{"name":"Graduate School of Information, Production and Systems, Waseda University"}]}],"member":"532","reference":[{"key":"1","doi-asserted-by":"publisher","unstructured":"[1] C. Yang, C. Ji, W. Shen, K.-T. Lee, Y. Zhang, X. Liu, and L.J. Guo, \u201cCompact multilayer film structures for ultrabroadband, omnidirectional, and efficient absorption,\u201d Acs Photonics, vol.3, no.4, pp.590-596, 2016. 10.1021\/acsphotonics.5b00689","DOI":"10.1021\/acsphotonics.5b00689"},{"key":"2","doi-asserted-by":"publisher","unstructured":"[2] Y. Li, Z. Liu, H. Zhang, P. Tang, B. Wu, and G. Liu, \u201cUltra-broadband perfect absorber utilizing refractory materials in metal-insulator composite multilayer stacks,\u201d Optics express, vol.27, no.8, pp.11809-11818, 2019. 10.1364\/oe.27.011809","DOI":"10.1364\/OE.27.011809"},{"key":"3","doi-asserted-by":"publisher","unstructured":"[3] J. Ma, J. Wang, Z.-D. Hu, Z. Zhang, L. Pan, and A. Di Falco, \u201cHigh-efficiency and ultrabroadband flexible absorbers based on transversely symmetrical multi-layer structures,\u201d AIP Advances, vol.9, no.11, p.115007, 2019. 10.1063\/1.5119406","DOI":"10.1063\/1.5119406"},{"key":"4","doi-asserted-by":"publisher","unstructured":"[4] X.-H. Gao, X.-L. Qiu, X.-T. Li, W. Theiss, B.-H. Chen, H.-X. Guo, T.-H. Zhou, and G. Liu, \u201cStructure, thermal stability and optical simulation of zrb2 based spectrally selective solar absorber coatings,\u201d Solar Energy Materials and Solar Cells, vol.193, pp.178-183, 2019. 10.1016\/j.solmat.2018.12.040","DOI":"10.1016\/j.solmat.2018.12.040"},{"key":"5","doi-asserted-by":"publisher","unstructured":"[5] N. Khoza, Z.Y. Nuru, J. Sackey, L. Kotsedi, N. Matinise, C. Ndlangamandla, and M. Maaza, \u201cStructural and optical properties of zrox\/zr\/zrox\/alxoy multilayered coatings as selective solar absorbers,\u201d Journal of Alloys and Compounds, vol.773, pp.975-979, 2019. 10.1016\/j.jallcom.2018.09.329","DOI":"10.1016\/j.jallcom.2018.09.329"},{"key":"6","doi-asserted-by":"publisher","unstructured":"[6] E.B. Rubin, Y. Chen, and R. Chen, \u201cOptical properties and thermal stability of cu spinel oxide nanoparticle solar absorber coatings,\u201d Solar Energy Materials and Solar Cells, vol.195, pp.81-88, 2019. 10.1016\/j.solmat.2019.02.032","DOI":"10.1016\/j.solmat.2019.02.032"},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] D. Chae, M. Kim, P.-H. Jung, S. Son, J. Seo, Y. Liu, B.J. Lee, and H. Lee, \u201cSpectrally selective inorganic-based multilayer emitter for daytime radiative cooling,\u201d ACS Applied Materials & Interfaces, vol.12, no.7, pp.8073-8081, 2020. 10.1021\/acsami.9b16742","DOI":"10.1021\/acsami.9b16742"},{"key":"8","doi-asserted-by":"publisher","unstructured":"[8] B.B. Naghshine and A. Saboonchi, \u201cOptimized thin film coatings for passive radiative cooling applications,\u201d Optics Communications, vol.410, pp.416-423, 2018. 10.1016\/j.optcom.2017.10.047","DOI":"10.1016\/j.optcom.2017.10.047"},{"key":"9","doi-asserted-by":"publisher","unstructured":"[9] H. Greiner, \u201cRobust optical coating design with evolutionary strategies,\u201d Applied Optics, vol.35, no.28, pp.5477-5483, 1996. 10.1364\/ao.35.005477","DOI":"10.1364\/AO.35.005477"},{"key":"10","doi-asserted-by":"publisher","unstructured":"[10] S. Martin, J. Rivory, and M. Schoenauer, \u201cSynthesis of optical multilayer systems using genetic algorithms,\u201d Applied Optics, vol.34, no.13, pp.2247-2254, 1995. 10.1364\/ao.34.002247","DOI":"10.1364\/AO.34.002247"},{"key":"11","doi-asserted-by":"crossref","unstructured":"[11] D. Li and A.C. Watson, \u201cOptical thin film optimization design using genetic algorithms,\u201d 1997 IEEE International Conference on Intelligent Processing Systems (Cat. no.97TH8335), vol.1, pp.132-136, 1997. 10.1109\/icips.1997.672752","DOI":"10.1109\/ICIPS.1997.672752"},{"key":"12","doi-asserted-by":"publisher","unstructured":"[12] B.T. Sullivan and J.A. Dobrowolski, \u201cImplementation of a numerical needle method for thin-film design,\u201d Applied optics, vol.35, no.28, pp.5484-5492, 1996. 10.1364\/ao.35.005484","DOI":"10.1364\/AO.35.005484"},{"key":"13","doi-asserted-by":"crossref","unstructured":"[13] A.V. Tikhonravov and M.K. Trubetskov, \u201cDevelopment of the needle optimization technique and new features of optilayer design software,\u201d Optical Interference Coatings, vol.2253, International Society for Optics and Photonics, pp.10-20, 1994. 10.1117\/12.192109","DOI":"10.1117\/12.192109"},{"key":"14","doi-asserted-by":"publisher","unstructured":"[14] R.I. Rabady and A. Ababneh, \u201cGlobal optimal design of optical multilayer thin-film filters using particle swarm optimization,\u201d Optik, vol.125, no.1, pp.548-553, 2014. 10.1016\/j.ijleo.2013.07.028","DOI":"10.1016\/j.ijleo.2013.07.028"},{"key":"15","doi-asserted-by":"crossref","unstructured":"[15] J. Peurifoy, Y. Shen, L. Jing, Y. Yang, F. Cano-Renteria, B.G. DeLacy, M. Tegmark, J.D. Joannopoulos, and M. Solja\u010di\u0107, \u201cNanophotonic particle simulation and inverse design using artificial neural networks,\u201d Science advances, vol.4, no.6, p.eaar4206, 2018. 10.1117\/12.2289195","DOI":"10.1126\/sciadv.aar4206"},{"key":"16","doi-asserted-by":"publisher","unstructured":"[16] D. Liu, Y. Tan, E. Khoram, and Z. Yu, \u201cTraining deep neural networks for the inverse design of nanophotonic structures,\u201d ACS Photonics, vol.5, no.4, pp.1365-1369, 2018. 10.1021\/acsphotonics.7b01377","DOI":"10.1021\/acsphotonics.7b01377"},{"key":"17","doi-asserted-by":"publisher","unstructured":"[17] T. Asano and S. Noda, \u201cOptimization of photonic crystal nanocavities based on deep learning,\u201d Optics express, vol.26, no.25, pp.32704-32717, 2018. 10.1364\/oe.26.032704","DOI":"10.1364\/OE.26.032704"},{"key":"18","doi-asserted-by":"crossref","unstructured":"[18] I. Malkiel, M. Mrejen, A. Nagler, U. Arieli, L. Wolf, and H. Suchowski, \u201cPlasmonic nanostructure design and characterization via deep learning,\u201d Light: Science & Applications, vol.7, no.1, pp.1-8, 2018. 10.1038\/s41377-018-0060-7","DOI":"10.1038\/s41377-018-0060-7"},{"key":"19","doi-asserted-by":"publisher","unstructured":"[19] I. Sajedian, H. Lee, and J. Rho, \u201cDesign of high transmission color filters for solar cells directed by deep Q-learning,\u201d Solar Energy, vol.195, pp.670-676, 2020. 10.1016\/j.solener.2019.12.013","DOI":"10.1016\/j.solener.2019.12.013"},{"key":"20","doi-asserted-by":"crossref","unstructured":"[20] H. Wang, Z. Zheng, C. Ji, and L.J. Guo, \u201cAutomated Optical Multi-layer Design via Deep Reinforcement Learning,\u201d arXiv, 2020.","DOI":"10.1088\/2632-2153\/abc327"},{"key":"21","doi-asserted-by":"publisher","unstructured":"[21] A. Jiang, Y. Osamu, and L. Chen, \u201cMultilayer optical thin film design with deep Q learning,\u201d Scientific Reports, vol.10, no.1, pp.1-7, 2020. 10.1038\/s41598-020-69754-w","DOI":"10.1038\/s41598-020-69754-w"},{"key":"22","doi-asserted-by":"publisher","unstructured":"[22] Y. Shi, W. Li, A. Raman, and S. Fan, \u201cOptimization of Multilayer Optical Films with a Memetic Algorithm and Mixed Integer Programming,\u201d ACS Photonics, vol.5, no.3, pp.684-691, 2018. 10.1021\/acsphotonics.7b01136","DOI":"10.1021\/acsphotonics.7b01136"},{"key":"23","doi-asserted-by":"publisher","unstructured":"[23] S. So, J. Mun, and J. Rho, \u201cSimultaneous inverse design of materials and structures via deep learning: demonstration of dipole resonance engineering using core-shell nanoparticles,\u201d ACS applied materials & interfaces, vol.11, no.27, pp.24264-24268, 2019. 10.1021\/acsami.9b05857","DOI":"10.1021\/acsami.9b05857"},{"key":"24","doi-asserted-by":"crossref","unstructured":"[24] D.E. Rumelhart, G.E. Hinton, and R.J. Williams, \u201cLearning internal representations by error propagation,\u201d California Univ San Diego La Jolla Inst for Cognitive Science, Tech. Rep., 1985. 10.1016\/b978-1-4832-1446-7.50035-2","DOI":"10.21236\/ADA164453"},{"key":"25","unstructured":"[25] D.P. Kingma and M. Welling, \u201cAuto-encoding variational bayes,\u201d arXiv preprint arXiv:1312.6114, 2013."},{"key":"26","doi-asserted-by":"crossref","unstructured":"[26] I.A. Siradjuddin, W.A. Wardana, and M.K. Sophan, \u201cFeature extraction using self-supervised convolutional autoencoder for content based image retrieval,\u201d 2019 3rd International Conference on Informatics and Computational Sciences (ICICoS). IEEE, pp.1-5, 2019. 10.1109\/icicos48119.2019.8982468","DOI":"10.1109\/ICICoS48119.2019.8982468"},{"key":"27","doi-asserted-by":"publisher","unstructured":"[27] W. Kristjanpoller, A. Fadic, and M.C. Minutolo, \u201cVolatility forecast using hybrid neural network models,\u201d Expert Systems with Applications, vol.41, no.5, pp.2437-2442, 2014. 10.1016\/j.eswa.2013.09.043","DOI":"10.1016\/j.eswa.2013.09.043"},{"key":"28","doi-asserted-by":"crossref","unstructured":"[28] J.M. Graving and I.D. Couzin, \u201cVae-sne: a deep generative model for simultaneous dimensionality reduction and clustering,\u201d bioRxiv, 2020. 10.1101\/2020.07.17.207993","DOI":"10.1101\/2020.07.17.207993"},{"key":"29","unstructured":"[29] D. Silver, R.S. Sutton, and M. M\u00fcller, \u201cReinforcement learning of local shape in the game of go.\u201d IJCAI, vol.7, pp.1053-1058, 2007."},{"key":"30","unstructured":"[30] G. Brockman, V. Cheung, L. Pettersson, J. Schneider, J. Schulman, J. Tang, and W. Zaremba, \u201cOpenai gym,\u201d CoRR, abs\/1606.01540, 2016. [Online]. Available: http:\/\/arxiv.org\/abs\/1606.01540"},{"key":"31","unstructured":"[31] M. Chevalier-Boisvert, F. Golemo, Y. Cao, B. Mehta, and L. Paull, \u201cDuckietown environments for openai gym,\u201d https:\/\/github.com\/duckietown\/gym-duckietown, 2018."},{"key":"32","doi-asserted-by":"publisher","unstructured":"[32] L.A.A. Pettersson, L.S. Roman, and O. Inganas, \u201cModeling photocurrent action spectra of photovoltaic devices based on organic thin films,\u201d Journal of Applied Physics, vol.86, no.1, pp.487-496, 1999. 10.1063\/1.370757","DOI":"10.1063\/1.370757"},{"key":"33","unstructured":"[33] M. Grzes, \u201cReward shaping in episodic reinforcement learning,\u201d Conference on Autonomous Agents and Multiagent Sytems, 2017."},{"key":"34","doi-asserted-by":"publisher","unstructured":"[34] S.Z. Selim and K. Alsultan, \u201cA simulated annealing algorithm for the clustering problem,\u201d Pattern Recognition, vol.24, no.10, pp.1003-1008, 1991. 10.1016\/0031-3203(91)90097-o","DOI":"10.1016\/0031-3203(91)90097-O"},{"key":"35","unstructured":"[35] L.X. Li, Z.J. Shao, and J.X. Qian, \u201cAn optimizing method based on autonomous animals: fish-swarm algorithm systems engineering,\u201d 2002."},{"key":"36","doi-asserted-by":"publisher","unstructured":"[36] E.-T. Hu, X.-X. Liu, Y. Yao, K.-Y. Zang, Z.-J. Tu, A.-Q. Jiang, K.-H. Yu, J.-J. Zheng, W. Wei, Y.-X. Zheng, R.-J. Zhang, S.-Y. Wang, H.-B. Zhao, O. Yoshie, Y.-P. Lee, C.-Z. Wang, D.W. Lynch, J.-P. Guo, and L.-Y. Chen, \u201cMultilayered metal-dielectric film structure for highly efficient solar selective absorption,\u201d Materials Research Express, vol.5, no.6, p.066428, 2018. 10.1088\/2053-1591\/aacdb3","DOI":"10.1088\/2053-1591\/aacdb3"},{"key":"37","doi-asserted-by":"publisher","unstructured":"[37] X.-F. Li, Y.-R. Chen, J. Miao, P. Zhou, Y.-X. Zheng, L.-Y. Chen, and Y.-P. Lee, \u201cHigh solar absorption of a multilayered thin film structure,\u201d Opt. Express, vol.15, no.4, pp.1907-1912, Feb. 2007. 10.1364\/oe.15.001907","DOI":"10.1364\/OE.15.001907"},{"key":"38","doi-asserted-by":"publisher","unstructured":"[38] W.-X. Zhou, Y. Shen, E.-T. Hu, Y. Zhao, M.-Y. Sheng, Y.-X. Zheng, S.-Y. Wang, Y.-P. Lee, C.-Z. Wang, D.W. Lynch, and L.-Y. Chen, \u201cNano-cr-film-based solar selective absorber with high photo-thermal conversion efficiency and good thermal stability,\u201d Opt. Express, vol.20, no.27, pp.28953-28962, Dec. 2012. 10.1364\/oe.20.028953","DOI":"10.1364\/OE.20.028953"},{"key":"39","doi-asserted-by":"publisher","unstructured":"[39] E.-T. Hu, S. Guo, T. Gu, K.-Y. Zang, Y. Yao, Z.-Y. Wang, K.-H. Yu, W. Wei, Y.-X. Zheng, S.-Y. Wang, R.-J. Zhang, Y.-P. Lee, and L.-Y. Chen, \u201cEnhancement of solar absorption by a surface-roughened metal-dielectric film structure,\u201d Japanese Journal of Applied Physics, vol.56, no.11, p.112301, Oct. 2017. 10.7567\/jjap.56.112301","DOI":"10.7567\/JJAP.56.112301"}],"container-title":["IEICE Transactions on Electronics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transele\/E105.C\/2\/E105.C_2021ECP5013\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,7]],"date-time":"2024-09-07T03:43:47Z","timestamp":1725680627000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transele\/E105.C\/2\/E105.C_2021ECP5013\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,1]]},"references-count":39,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022]]}},"URL":"https:\/\/doi.org\/10.1587\/transele.2021ecp5013","relation":{},"ISSN":["0916-8524","1745-1353"],"issn-type":[{"value":"0916-8524","type":"print"},{"value":"1745-1353","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,1]]},"article-number":"2021ECP5013"}}