{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T05:07:41Z","timestamp":1761196061300,"version":"3.37.3"},"reference-count":18,"publisher":"Wiley","license":[{"start":{"date-parts":[[2019,6,26]],"date-time":"2019-06-26T00:00:00Z","timestamp":1561507200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002641","name":"Konkuk University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002641","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Sensors"],"published-print":{"date-parts":[[2019,6,26]]},"abstract":"<jats:p>Particulate matter (PM) has been revealed to have detrimental effects on public health, social economy, agriculture, and so forth. Thus, it became one of the major concerns in terms of a factor that can reduce \u201cquality of life\u201d over East Asia, where the concentration is significantly high. In this regard, it is imperative to develop affordable and efficient prediction models to monitor real-time changes in PM concentration levels using digital images, which are readily available for many individuals (e.g., via mobile phone). Previous studies (i.e., DeepHaze) were limited in scope to priorly collected data and thereby less practical in providing real-time information (i.e., undermined interprediction). This drawback led us to hardly capture drastic changes caused by weather or regions of interests. To address this challenge, we propose a new method called Deep Q-haze, whose inference scheme is built on an online learning-based method in collaboration with reinforcement learning and deep learning (i.e., Deep Q-learning), making it possible to improve testing accuracy and model flexibility in virtue of real-time basis inference. Taking into account various experiment scenarios, the proposed method learns a binary decision rule on the basis of video sequences to predict, in real time, whether the level of PM10 (particles smaller than 10 in aerodynamic diameter) concentration is harmful (<mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"M1\"><mml:mrow><mml:mo>&gt;<\/mml:mo><\/mml:mrow><\/mml:math>80<mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"M2\"><mml:mi>\u03bc<\/mml:mi><mml:mi>g<\/mml:mi><\/mml:math>\/<mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"M3\"><mml:mrow><mml:msup><mml:mrow><mml:mi>m<\/mml:mi><\/mml:mrow><mml:mrow><mml:mn mathvariant=\"normal\">3<\/mml:mn><\/mml:mrow><\/mml:msup><\/mml:mrow><\/mml:math>) or not. The proposed model shows superior accuracy compared to existing algorithms. Deep Q-haze effectively accounts for unexpected environmental changes in essence (e.g., weather) and facilitates monitoring of real-time PM10 concentration levels, showing implications for better understanding of characteristics of airborne particles.<\/jats:p>","DOI":"10.1155\/2019\/9673047","type":"journal-article","created":{"date-parts":[[2019,6,26]],"date-time":"2019-06-26T19:31:44Z","timestamp":1561577504000},"page":"1-10","source":"Crossref","is-referenced-by-count":3,"title":["Vision-Based Deep Q-Learning Network Models to Predict Particulate Matter Concentration Levels Using Temporal Digital Image Data"],"prefix":"10.1155","volume":"2019","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0442-7795","authenticated-orcid":true,"given":"SungHwan","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Applied Statistics, Konkuk University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7980-3911","authenticated-orcid":true,"given":"SeHee","family":"Jung","sequence":"additional","affiliation":[{"name":"AI Analytics Team, Deep Visions, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2972-135X","authenticated-orcid":true,"given":"SeongMin","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Applied Statistics, Konkuk University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"JiSeong","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Applied Statistics, Konkuk University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"ByungYong","family":"Lee","sequence":"additional","affiliation":[{"name":"Marketing Team, INSUNGIT, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5029-476X","authenticated-orcid":true,"given":"JaeHwa","family":"Lee","sequence":"additional","affiliation":[{"name":"Earth System Science Interdisciplinary Center, University of Maryland, College Park, MD, USA"},{"name":"NASA Goddard Space Flight Center, Greenbelt, MD, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0040-3542","authenticated-orcid":true,"given":"Sung Won","family":"Han","sequence":"additional","affiliation":[{"name":"School of Industrial Management Engineering, Korea University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"key":"17","doi-asserted-by":"publisher","DOI":"10.1023\/A:1016328200723"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1016\/1352-2310(94)00370-Z"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-05092-8"},{"issue":"9","key":"20","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1016\/S1470-2045(13)70279-1","volume":"14","year":"2013","journal-title":"The Lancet Oncology"},{"year":"2018","key":"18"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1007\/s10653-015-9720-1"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1016\/j.envpol.2018.11.034"},{"key":"1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.publhealth.25.102802.124329"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0145955"},{"issue":"5","key":"12","first-page":"2107","volume":"13","year":"2018","journal-title":"Journal of Electrical Engineering and Technology"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1038\/nature24270"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14435-6_7"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1561\/2000000039"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0135749"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2598681"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1080\/00022470.1980.10465927"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1016\/j.scitotenv.2009.02.019"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2003.10.022"}],"container-title":["Journal of Sensors"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2019\/9673047.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2019\/9673047.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/js\/2019\/9673047.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,9,23]],"date-time":"2019-09-23T07:42:51Z","timestamp":1569224571000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/js\/2019\/9673047\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,26]]},"references-count":18,"alternative-id":["9673047","9673047"],"URL":"https:\/\/doi.org\/10.1155\/2019\/9673047","relation":{},"ISSN":["1687-725X","1687-7268"],"issn-type":[{"type":"print","value":"1687-725X"},{"type":"electronic","value":"1687-7268"}],"subject":[],"published":{"date-parts":[[2019,6,26]]}}}