{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T14:36:31Z","timestamp":1767191791675,"version":"3.48.0"},"reference-count":53,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T00:00:00Z","timestamp":1766966400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"JSPS KAKENHI","award":["JP20H00612"],"award-info":[{"award-number":["JP20H00612"]}]},{"name":"JSPS KAKENHI","award":["JP23H04357"],"award-info":[{"award-number":["JP23H04357"]}]},{"name":"JST SPRING","award":["JPMJSP2154"],"award-info":[{"award-number":["JPMJSP2154"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Synthesizing photo-realistic images of a scene from arbitrary viewpoints and under arbitrary lighting environments is one of the important research topics in computer vision and graphics. In this paper, we propose a method for synthesizing photo-realistic images of a scene with fluorescent objects from novel viewpoints and under novel lighting colors and spectra. In general, fluorescent materials absorb light with certain wavelengths and then emit light with longer wavelengths than the absorbed ones, in contrast to reflective materials, which preserve wavelengths of light. Therefore, we cannot reproduce the colors of fluorescent objects under arbitrary lighting colors by combining conventional view synthesis techniques with the white balance adjustment of the RGB channels. Accordingly, we extend the novel-view synthesis based on the neural radiance fields by incorporating the superposition principle of light; our proposed method captures a sparse set of images of a scene from varying viewpoints and under varying lighting colors or spectra with active lighting systems such as a color display or a multi-spectral light stage and then synthesizes photo-realistic images of the scene without explicitly modeling its geometric and photometric models. We conducted a number of experiments using real images captured with an LCD and confirmed that our method works better than the existing methods. Moreover, we showed that the extension of our method using more than three primary colors with a light stage enables us to reproduce the colors of fluorescent objects under common light sources.<\/jats:p>","DOI":"10.3390\/jimaging12010016","type":"journal-article","created":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T14:08:11Z","timestamp":1767190091000},"page":"16","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["FluoNeRF: Fluorescent Novel-View Synthesis Under Novel Light Source Colors and Spectra"],"prefix":"10.3390","volume":"12","author":[{"given":"Lin","family":"Shi","sequence":"first","affiliation":[{"name":"Department of Artificial Intelligence, Kyushu Institute of Technology, Fukuoka 820-8502, Japan"},{"name":"Research Center for Neuromorphic AI Hardware, Kyushu Institute of Technology, Fukuoka 808-0196, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kengo","family":"Matsufuji","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Kyushu Institute of Technology, Fukuoka 820-8502, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2227-6345","authenticated-orcid":false,"given":"Michitaka","family":"Yoshida","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Okayama University, Okayama 700-8530, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9819-3634","authenticated-orcid":false,"given":"Ryo","family":"Kawahara","sequence":"additional","affiliation":[{"name":"Graduate School of Informatics, Kyoto University, Kyoto 606-8501, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2183-7112","authenticated-orcid":false,"given":"Takahiro","family":"Okabe","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Okayama University, Okayama 700-8530, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"257","DOI":"10.2352\/CIC.1999.7.1.art00048","article-title":"Color constancy with fluorescent surfaces","volume":"7","author":"Barnard","year":"1999","journal-title":"Color Imaging Conf."},{"key":"ref_2","unstructured":"Zhang, C., and Sato, I. (2021, January 20\u201325). Separating reflective and fluorescent components of an image. Proceedings of the CVPR 2011, Colorado Springs, CO, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mildenhall, B., Srinivasan, P., Tancik, M., Barron, J., Ramamoorthi, R., and Ng, R. (2020, January 23\u201328). Nerf: Representing scenes as neural radiance fields for view synthesis. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_24"},{"key":"ref_4","first-page":"967","article-title":"Neural surface reconstruction of dynamic scenes with monocular rgb-d camera","volume":"35","author":"Cai","year":"2022","journal-title":"Neural Inf. Process. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ost, J., Mannan, F., Thuerey, N., Knodt, J., and Heide, F. (2021, January 20\u201325). Neural scene graphs for dynamic scenes. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00288"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Park, J., Florence, P., Straub, J., Newcombe, R., and Lovegrove, S. (2019, January 15\u201320). Deepsdf: Learning continuous signed distance functions for shape representation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00025"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Park, K., Sinha, U., Barron, J., Bouaziz, S., Goldman, D., Seitz, S., and Martin-Brualla, R. (2021, January 10\u201317). Nerfies: Deformable neural radiance fields. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV2021), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00581"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Pumarola, A., Corona, E., Pons-Moll, G., and Moreno-Noguer, F. (2021, January 20\u201325). D-nerf: Neural radiance fields for dynamic scenes. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01018"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rudnev, V., Elgharib, M., Smith, W., Liu, L., Golyanik, V., and Theobalt, C. (2022, January 23\u201327). Nerf for outdoor scene relighting. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19787-1_35"},{"key":"ref_10","unstructured":"Yu, H., Guibas, L., and Wu, J. (2022, January 25\u201329). Unsupervised discovery of object radiance fields. Proceedings of the ICLR 2022, Online."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Duisterhof, B., Mao, Y., Teng, S., and Ichnowski, J. (2024, January 13\u201317). Residual-nerf: Learning residual nerfs for transparent object manipulation. InProceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan.","DOI":"10.1109\/ICRA57147.2024.10611224"},{"key":"ref_12","unstructured":"Ichnowski, J., Avigal, Y., Kerr, J., and Goldberg, K. (2020). Dex-NeRF: Using a neural radiance field to grasp transparent objects. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Levy, D., Peleg, A., Pearl, N., Rosenbaum, D., Akkaynak, D., Korman, S., and Treibitz, T. (2023, January 17\u201324). Seathru-nerf: Neural radiance fields in scattering media. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00014"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sethuraman, A., Ramanagopal, M., and Skinner, K. (2023, January 25\u201328). Waternerf: Neural radiance fields for underwater scenes. Proceedings of the OCEANS 2023\u2014MTS\/IEEE U.S. Gulf Coast, Biloxi, MS, USA.","DOI":"10.23919\/OCEANS52994.2023.10336972"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, Z., Yang, W., Cao, J., Hu, Q., Xu, L., Yu, J., and Yu, J. (2023, January 28\u201330). Neref: Neural refractive field for fluid surface reconstruction and rendering. Proceedings of the 2023 IEEE International Conference on Computational Photography (ICCP), Madison, WI, USA.","DOI":"10.1109\/ICCP56744.2023.10233838"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Boss, M., Braun, R., Jampani, V., Barron, J., Liu, C., and Lensch, H. (2021, January 10\u201317). NeRD: Neural reflectance decomposition from image collections. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV2021), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01245"},{"key":"ref_17","unstructured":"Boss, M., Jampani, V., Braun, R., Liu, C., Barron, J., and Lensch, H. (2021, January 6\u201314). Neural-PIL: Neural pre-integrated lighting for reflectance decomposition. Proceedings of the 35th International Conference on Neural Information Processing Systems (NeurIPS2021), Online."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Guo, Y., Kang, D., Bao, L., He, Y., and Zhang, S. (2022, January 18\u201324). Nerfren: Neural radiance fields with reflections. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01786"},{"key":"ref_19","first-page":"22856","article-title":"Shape, light, and material decomposition from images using monte carlo rendering and denoising","volume":"35","author":"Hasselgren","year":"2022","journal-title":"Neural Inf. Process. Syst."},{"key":"ref_20","first-page":"1","article-title":"Nero: Neural geometry and brdf reconstruction of reflective objects from multiview images","volume":"42","author":"Liu","year":"2023","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Martin-Brualla, R., Radwan, N., Sajjadi, M., Barron, J., Dosovitskiy, A., and Duckworth, D. (2021, January 20\u201325). Nerf in the wild: Neural radiance fields for unconstrained photo collections. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00713"},{"key":"ref_22","unstructured":"Wang, P., Liu, L., Liu, Y., Theobalt, C., Komura, T., and Wang, W. (2021, January 6\u201314). Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction. Proceedings of the 35th International Conference on Neural Information Processing Systems, Online."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Xu, Y., Zoss, G., Chandran, P., Gross, M., Bradley, D., and Gotardo, P. (2023, January 1\u20136). Renerf: Relightable neural radiance fields with nearfield lighting. Proceedings of the 2023 IEEE\/CVF International Conference on Computer Vision (ICCV), Paris, France.","DOI":"10.1109\/ICCV51070.2023.02064"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yao, Y., Zhang, J., Liu, J., Qu, Y., Fang, T., McKinnon, D., Tsin, Y., and Quan, L. (2022, January 23\u201327). Neilf: Neural incident light field for physically-based material estimation. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19821-2_40"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, K., Luan, F., Wang, Q., Bala, K., and Snavely, N. (2021, January 20\u201325). Physg: Inverse rendering with spherical gaussians for physics-based material editing and relighting. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00541"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3478513.3480500","article-title":"Neural light transport for relighting and view synthesis","volume":"40","author":"Zhang","year":"2021","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3478513.3480500","article-title":"Nerfactor: Neural factorization of shape and reflectance under an unknown illumination","volume":"40","author":"Zhang","year":"2021","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Sun, J., He, X., Fu, H., Jia, R., and Zhou, X. (2022, January 18\u201324). Modeling indirect illumination for inverse rendering. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01809"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Barron, J., Mildenhall, B., Verbin, D., Srinivasan, P., and Hedman, P. (2023, January 1\u20136). Zip-NeRF: Anti-aliased grid-based neural radiance fields. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV2023), Paris, France.","DOI":"10.1109\/ICCV51070.2023.01804"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Barron, J., Mildenhall, B., Tancik, M., Hedman, P., Martin-Brualla, R., and Srinivasan, P. (2021, January 10\u201317). Mip-NeRF: A multiscale representation for anti-aliasing neural radiance fields. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV2021), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00580"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chen, Z., Li, Z., Song, L., Chen, L., Yu, J., Yuan, J., and Xu, Y. (2023, January 1\u20136). NeuRBF: A neural fields representation with adaptive radial basis functions. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV2023), Paris, France.","DOI":"10.1109\/ICCV51070.2023.00386"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Garbin, S., Kowalski, M., Johnson, M., Shotton, J., and Valentin, J. (2021, January 10\u201317). Fastnerf: High-fidelity neural rendering at 200fps. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01408"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3592433","article-title":"3d gaussian splatting for real-time radiance field rendering","volume":"42","author":"Kerbl","year":"2023","journal-title":"ACM Trans. Graph."},{"key":"ref_34","first-page":"15651","article-title":"Neural sparse voxel fields","volume":"33","author":"Liu","year":"2020","journal-title":"Neural Inf. Process. Syst."},{"key":"ref_35","first-page":"1","article-title":"Instant neural graphics primitives with a multiresolution hash encoding","volume":"41","author":"Evans","year":"2022","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Tretschk, E., Tewari, A., Golyanik, V., Zollh\u00f6fer, M., Lassner, C., and Theobalt, C. (2021, January 10\u201317). Non-rigid neural radiance fields: Reconstruction and novel view synthesis of a dynamic scene from monocular video. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01272"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Fu, Y., Lam, A., Sato, I., Okabe, T., and Sato, Y. (2013, January 1\u20138). Separating reflective and fluorescent components using high frequency illumination in the spectral domain. Proceedings of the 2013 IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.63"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Koyamatsu, K., Hidaka, D., Okabe, T., and Lensch, H.P.A. (2019, January 15\u201320). Reflective and fluorescent separation under narrow-band illumination. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00776"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1109\/TPAMI.2015.2439270","article-title":"Reflectance and fluorescence spectral recovery via actively lit rgb images","volume":"38","author":"Fu","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Treibitz, T., Murez, Z., Mitchell, B., and Kriegman, D. (2012, January 7\u201313). Shape from fluorescence. Proceedings of the European Conference on Computer Vision (ECCV 2012), Florence, Italy.","DOI":"10.1007\/978-3-642-33786-4_22"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1778765.1778834","article-title":"Acquisition and analysis of bispectral bidirectional reflectance and reradiation distribution functions","volume":"29","author":"Hullin","year":"2010","journal-title":"ACM Trans. Graph."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Lyu, L., Tewari, A., Leimk\u00fchler, T., Habermann, M., and Theobalt, C. (2022, January 23\u201327). Neural radiance transfer fields for relightable novel-view synthesis with global illumination. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19790-1_10"},{"key":"ref_43","unstructured":"Sun, T., Lin, K., Bi, S., Xu, Z., and Ramamoorthi, R. (July, January 29). Nelf: Neural light-transport field for portrait view synthesis and relighting. Proceedings of the EGSR2021, Saarbr\u00fccken, Germany."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Schechner, Y., Nayar, S., and Belhumeur, P. (2003, January 13\u201316). A theory of multiplexed illumination. Proceedings of the Proceedings Ninth IEEE International Conference on Computer Vision, Nice, France.","DOI":"10.1109\/ICCV.2003.1238431"},{"key":"ref_45","unstructured":"Ajdin, B., Finckh, M., Fuchs, C., Hanika, J., and Lensch, H. (2012). Compressive Higher-Order Sparse and Low-Rank Acquisition with a Hyperspectral Light Stage, Eberhard Karls Universit\u00e4t T\u00fcbingen. Technical Report WSI-2012-01."},{"key":"ref_46","unstructured":"Debevec, P. (2012, January 26\u201327). The Light Stages and Their Applications to Photoreal Digital Actors. Proceedings of the SIGGRAPH Asia2012, Singapore. Technical Briefs."},{"key":"ref_47","unstructured":"Gu, J., and Liu, C. (2012, January 16\u201321). Discriminative illumination: Per-pixel classification of raw materials based on optimal projections of spectral BRDF. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Kurachi, M., Kawahara, R., and Okabe, T. (2025, January 26\u201328). One-Shot Polarization-Based Material Classification with Optimal Illumination. Proceedings of the 20th International Conference on Computer Vision Theory and Applications, Porto, Portugal.","DOI":"10.5220\/0013312700003912"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Wang, C., and Okabe, T. (2017, January 4\u20137). Joint optimization of coded illumination and grayscale conversion for one-shot raw material classification. Proceedings of the 28th British Machine Vision Conference (BMVC2017), London, UK.","DOI":"10.5244\/C.31.136"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Park, J.-I., Lee, M.-H., Grossberg, M., and Nayar, S. (2007, January 14\u201321). Multispectral imaging using multiplexed illumination. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4409090"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J., and Frahm, J. (2016, January 27\u201330). Structure-from-motion revisited. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J., Zheng, E., Pollefeys, M., and Frahm, J. (2016, January 11\u201314). Pixelwise view selection for unstructured multi-view stereo. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"ref_53","unstructured":"Kingma, D., and Ba, J. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diega, CA, USA."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/1\/16\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T14:33:52Z","timestamp":1767191632000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/1\/16"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,29]]},"references-count":53,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["jimaging12010016"],"URL":"https:\/\/doi.org\/10.3390\/jimaging12010016","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,29]]}}}