{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T12:43:19Z","timestamp":1740141799587,"version":"3.37.3"},"reference-count":15,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2013,4,1]],"date-time":"2013-04-01T00:00:00Z","timestamp":1364774400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100004055","name":"King Fahd University of Petroleum and Minerals","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004055","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Distributed Sensor Networks"],"published-print":{"date-parts":[[2013,4,1]]},"abstract":"<jats:p> Biological sensors (biosensors, for short) are tiny wireless devices attached or implanted into the body of a human or animal to monitor and detect abnormalities and then relay data to physician or provide therapy on the spot. They are distinguished from conventional sensors by their biologically derived sensing elements and by being temperature constrained. Biosensors generate heat when they transmit their measurements and when they are recharged by electromagnetic energy. The generated heat translates to a temperature increase in the tissues surrounding the biosensors. If the temperature increase exceeds a certain threshold, the tissues might be damaged. In this paper, we discuss the problem of finding an optimal policy for operating a rechargeable biosensor inside a temperature-sensitive environment characterized by a strict maximum temperature increase constraint. This problem can be formulated as a Markov Decision Process (MDP) and solved to obtain the optimal policy which maximizes the average number of samples that can be generated by the biosensor while observing the constraint on the maximum safe temperature level. In order to handle large-size MDP models, it is shown how operating policies can be obtained using Q-learning and heuristics. Numerical and simulation results demonstrating the performance of the different policies are presented. <\/jats:p>","DOI":"10.1155\/2013\/635637","type":"journal-article","created":{"date-parts":[[2013,4,11]],"date-time":"2013-04-11T21:01:53Z","timestamp":1365714113000},"page":"635637","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Optimal Management of Rechargeable Biosensors in Temperature-Sensitive Environments"],"prefix":"10.1177","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0473-221X","authenticated-orcid":false,"given":"Yahya","family":"Osais","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, King Fahd University of Petroleum and Minerals, Dhahran 31261, Saudi Arabia"}]},{"given":"F. Richard","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Systems and Computer Engineering, Carleton University, Ottawa, ON, Canada K1S 5B6"}]},{"given":"Marc","family":"St-Hilaire","sequence":"additional","affiliation":[{"name":"Department of Systems and Computer Engineering, Carleton University, Ottawa, ON, Canada K1S 5B6"}]}],"member":"179","published-online":{"date-parts":[[2013,4,11]]},"reference":[{"first-page":"1993","volume-title":"Proceedings of the International Conference on Communications (ICC 2003)","author":"Gupta S. K. S.","key":"B3-2013-635637"},{"key":"B4-2013-635637","doi-asserted-by":"publisher","DOI":"10.1152\/jappl.1948.1.2.93"},{"key":"B5-2013-635637","doi-asserted-by":"publisher","DOI":"10.1109\/9780470544518"},{"key":"B6-2013-635637","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2005.847527"},{"key":"B7-2013-635637","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1007\/11502593_17","volume-title":"Proceedings of the 1st IEEE International Conference on Distributed Computing in Sensor Systems (DCOSS '05)","volume":"3560","author":"Tang Q."},{"key":"B8-2013-635637","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2007.893213"},{"key":"B9-2013-635637","doi-asserted-by":"publisher","DOI":"10.1007\/s11276-007-0091-0"},{"key":"B10-2013-635637","doi-asserted-by":"publisher","DOI":"10.1007\/1-84628-484-8"},{"key":"B11-2013-635637","doi-asserted-by":"publisher","DOI":"10.1109\/CISS.2008.4558613"},{"volume-title":"Digital Communications","year":"2000","author":"Proakis J. G.","key":"B12-2013-635637"},{"key":"B13-2013-635637","doi-asserted-by":"publisher","DOI":"10.1109\/25.350282"},{"key":"B14-2013-635637","doi-asserted-by":"publisher","DOI":"10.1109\/26.803503"},{"volume-title":"Microwave Mobile Communications","year":"1974","author":"Jakes W. C.","key":"B15-2013-635637"},{"volume-title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","year":"2005","author":"Puterman M. L.","key":"B16-2013-635637"},{"volume-title":"Dynamic Programming and Optimal Control, Volume I","year":"2000","author":"Bertsekas D. P.","key":"B17-2013-635637"}],"container-title":["International Journal of Distributed Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1155\/2013\/635637","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/full-xml\/10.1155\/2013\/635637","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1155\/2013\/635637","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,16]],"date-time":"2021-05-16T21:55:10Z","timestamp":1621202110000},"score":1,"resource":{"primary":{"URL":"http:\/\/journals.sagepub.com\/doi\/10.1155\/2013\/635637"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,4,1]]},"references-count":15,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2013,4,1]]}},"alternative-id":["10.1155\/2013\/635637"],"URL":"https:\/\/doi.org\/10.1155\/2013\/635637","relation":{},"ISSN":["1550-1477","1550-1477"],"issn-type":[{"type":"print","value":"1550-1477"},{"type":"electronic","value":"1550-1477"}],"subject":[],"published":{"date-parts":[[2013,4,1]]}}}