{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T16:58:58Z","timestamp":1784134738631,"version":"3.55.0"},"reference-count":54,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,12,24]],"date-time":"2020-12-24T00:00:00Z","timestamp":1608768000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology on Complex Electronic Simulation Laboratory Foundation","award":["DXZT-JC-ZZ2017-005"],"award-info":[{"award-number":["DXZT-JC-ZZ2017-005"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61802080"],"award-info":[{"award-number":["61802080"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Education Bureau of Guangzhou Municipality Higher Education Research Project","award":["201831827"],"award-info":[{"award-number":["201831827"]}]},{"name":"Guangzhou University Research Project","award":["RQ2020085"],"award-info":[{"award-number":["RQ2020085"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the development of the Internet of Multimedia Things (IoMT), an increasing amount of image data is collected by various multimedia devices, such as smartphones, cameras, and drones. This massive number of images are widely used in each field of IoMT, which presents substantial challenges for privacy preservation. In this paper, we propose a new image privacy protection framework in an effort to protect the sensitive personal information contained in images collected by IoMT devices. We aim to use deep neural network techniques to identify the privacy-sensitive content in images, and then protect it with the synthetic content generated by generative adversarial networks (GANs) with differential privacy (DP). Our experiment results show that the proposed framework can effectively protect users\u2019 privacy while maintaining image utility.<\/jats:p>","DOI":"10.3390\/s21010058","type":"journal-article","created":{"date-parts":[[2020,12,24]],"date-time":"2020-12-24T09:02:44Z","timestamp":1608800564000},"page":"58","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":49,"title":["GAN-Based Differential Private Image Privacy Protection Framework for the Internet of Multimedia Things"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7337-9029","authenticated-orcid":false,"given":"Jinao","family":"Yu","sequence":"first","affiliation":[{"name":"School of Space Information, Space Engineering University, Beijing 101416, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hanyu","family":"Xue","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Technology Sydney, Sydney, NSW 2007, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Technology Sydney, Sydney, NSW 2007, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9807-2293","authenticated-orcid":false,"given":"Yu","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou 510006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shibing","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Space Information, Space Engineering University, Beijing 101416, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Ding","sequence":"additional","affiliation":[{"name":"Data61, CSIRO, Sydney, NSW 2015, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,24]]},"reference":[{"key":"ref_1","unstructured":"EU (2019, July 19). The EU General Data Protection Regulation. Available online: https:\/\/eugdpr.org\/."},{"key":"ref_2","unstructured":"EU (2019, July 19). What is Considered Personal Data?. Available online: https:\/\/gdpr.eu\/eu-gdpr-personal-data\/."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mannan, M., and van Oorschot, P.C. (2008). Privacy-enhanced sharing of personal content on the web. Proceedings of the 17th International Conference on World Wide Web\u2014WWW \u201908, Beijing, China, 21\u201325 April 2008, ACM Press.","DOI":"10.1145\/1367497.1367564"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Vyas, N., Squicciarini, A.C., Chang, C.C., and Yao, D. (2009, January 11\u201314). Towards automatic privacy management in Web 2.0 with semantic analysis on annotations. Proceedings of the 5th International ICST Conference on Collaborative Computing: Networking, Applications, Worksharing, Washington, DC, USA.","DOI":"10.4108\/ICST.COLLABORATECOM2009.8340"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, N., Xu, H., and Grossklags, J. (2011, January 4\u20135). Third-party apps on Facebook: Privacy and the illusion of control. Proceedings of the 5th ACM Symposium on Computer Human Interaction for Management of Information Technology\u2014CHIMIT \u201911, Cambridge, MA, USA.","DOI":"10.1145\/2076444.2076448"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1002\/asi.21473","article-title":"CoPE: Enabling collaborative privacy management in online social networks","volume":"62","author":"Squicciarini","year":"2011","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, B., Ding, M., Shaham, S., Rahayu, W., Farokhi, F., and Lin, Z. (2020). When Machine Learning Meets Privacy: A Survey and Outlook. arXiv.","DOI":"10.1145\/3436755"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wen, Y., Liu, B., Xie, R., Zhu, Y., Cao, j., and Song, L. (2020, January 1\u20134). A Hybrid Model for Natural Face De-Identification with Adjustable Privacy. Proceedings of the 2020 IEEE Visual Communications and Image Processing (VCIP), Virtual Conference.","DOI":"10.1109\/VCIP49819.2020.9301866"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3386082","article-title":"Image privacy prediction using deep neural networks","volume":"14","author":"Tonge","year":"2020","journal-title":"ACM Trans. Web (TWEB)"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.1109\/TIFS.2016.2636090","article-title":"iPrivacy: Image Privacy Protection by Identifying Sensitive Objects via Deep Multi-Task Learning","volume":"12","author":"Yu","year":"2017","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Uittenbogaard, R., Sebastian, C., Vijverberg, J., Boom, B., Gavrila, D., and de With, P.H.N. (2019, January 16\u201320). Privacy Protection in Street-View Panoramas Using Depth and Multi-View Imagery. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01083"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1897438","DOI":"10.1155\/2017\/1897438","article-title":"Protecting Privacy in Shared Photos via Adversarial Examples Based Stealth","volume":"2017","author":"Liu","year":"2017","journal-title":"Secur. Commun. Netw."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liu, B., Xiong, J., Wu, Y., Ding, M., and Wu, C.M. (2019, January 5\u20137). Protecting Multimedia Privacy from Both Humans and AI. Proceedings of the 2019 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Jeju, Korea.","DOI":"10.1109\/BMSB47279.2019.8971914"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e5102","DOI":"10.1002\/cpe.5102","article-title":"Adversaries or allies? Privacy and deep learning in big data era","volume":"31","author":"Liu","year":"2019","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xue, H., Liu, B., Ding, M., Song, L., and Zhu, T. (2020, January 7\u201311). Hiding Private Information in Images From AI. Proceedings of the 2020 IEEE International Conference on Communications (ICC), Dublin, Ireland.","DOI":"10.1109\/ICC40277.2020.9148656"},{"key":"ref_17","unstructured":"McPherson, R., Shokri, R., and Shmatikov, V. (2016). Defeating image obfuscation with deep learning. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"75556","DOI":"10.1109\/ACCESS.2019.2921029","article-title":"Faces are Protected as Privacy: An Automatic Tagging Framework Against Unpermitted Photo Sharing in Social Media","volume":"7","author":"Tang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Pesce, J.P., and Casas, D.L. (2012, January 17). Privacy Attacks in Social Media Using Photo Tagging Networks: A Case Study with Facebook. Proceedings of the 1st Workshop on Privacy and Security in Online Social Media, Lyon, France.","DOI":"10.1145\/2185354.2185358"},{"key":"ref_20","unstructured":"The New York Times (2019, July 19). San Francisco Bans Facial Recognition Technology. Available online: https:\/\/www.nytimes.com\/2019\/05\/14\/us\/facial-recognition-ban-san-francisco.html."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 24\u201327). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hariharan, B., Arbelaez, P., Girshick, R., and Malik, J. (2015, January 7\u201312). Hypercolumns for object segmentation and fine-grained localization. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298642"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 11\u201318). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Las Condes, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_24","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201310). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Efros, A., and Leung, T. (1999, January 20\u201325). Texture synthesis by non-parametric sampling. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790383"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1145\/1531326.1531330","article-title":"PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing","volume":"28","author":"Barnes","year":"2009","journal-title":"ACM Trans. Graph."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Pnevmatikakis, E.A., and Maragos, P. (2008, January 12\u201315). An inpainting system for automatic image structure\u2014Texture restoration with text removal. Proceedings of the 2008 15th IEEE International Conference on Image Processing, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4712330"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Bertalmio, M., Vese, L., Sapiro, G., and Osher, S. (2003, January 18\u201320). Simultaneous Structure and Texture Image Inpainting. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA.","DOI":"10.1109\/TIP.2003.815261"},{"key":"ref_31","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Networks. arXiv."},{"key":"ref_32","unstructured":"Klambauer, G., Unterthiner, T., Mayr, A., and Hochreiter, S. (2017, January 4\u20139). Self-normalizing neural networks. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mao, X., Li, Q., Xie, H., Lau, R., Wang, Z., and Smolley, S. (2017, January 22\u201329). Least Squares Generative Adversarial Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.304"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xiong, W., Yu, J., Lin, Z., Yang, J., Lu, X., Barnes, C., and Luo, J. (2019, January 16\u201320). Foreground-Aware Image Inpainting. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00599"},{"key":"ref_35","unstructured":"Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A.C. (2017, January 4\u20139). Improved training of wasserstein gans. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Karras, T., Laine, S., and Aila, T. (2019, January 16\u201320). A Style-Based Generator Architecture for Generative Adversarial Networks. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00453"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1258","DOI":"10.1016\/j.future.2018.06.007","article-title":"Detecting insider attacks in medical cyber\u2013physical networks based on behavioral profiling","volume":"108","author":"Meng","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.jpdc.2018.07.013","article-title":"A fog-based privacy-preserving approach for distributed signature-based intrusion detection","volume":"122","author":"Wang","year":"2018","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"786","DOI":"10.1109\/TSC.2018.2825986","article-title":"Privacy-Preserving Reputation Management for Edge Computing Enhanced Mobile Crowdsensing","volume":"12","author":"Ma","year":"2019","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2204","DOI":"10.1109\/TITS.2017.2777990","article-title":"CreditCoin: A Privacy-Preserving Blockchain-Based Incentive Announcement Network for Communications of Smart Vehicles","volume":"19","author":"Li","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.dcan.2020.07.003","article-title":"Security and privacy in 6G networks: New areas and new challenges","volume":"6","author":"Wang","year":"2020","journal-title":"Digit. Commun. Netw."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1142\/S0218488502001648","article-title":"k-anonymity: A model for protecting privacy","volume":"10","author":"Sweeney","year":"2002","journal-title":"Int. J. Uncertain. Fuzziness-Knowl. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1145\/1217299.1217302","article-title":"L-diversity: Privacy beyond k-anonymity","volume":"1","author":"Machanavajjhala","year":"2007","journal-title":"ACM Trans. Knowl. Discov. Data"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Li, N., Li, T., and Venkatasubramanian, S. (2017, January 15\u201320). t-closeness: Privacy beyond k-anonymity and l-diversity. Proceedings of the 2007 IEEE 23rd International Conference on Data Engineering, Istanbul, Turkey.","DOI":"10.1109\/ICDE.2007.367856"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Dwork, C. (2006). Differential privacy. Proceedings of the 33rd International Conference on Automata, Languages and Programming-Volume Part II, Beijing, China, 15\u201320 May 2006, Springer.","DOI":"10.1007\/11787006_1"},{"key":"ref_46","unstructured":"Abdal, R., Qin, Y., and Wonka, P. (November, January 27). Image2stylegan: How to embed images into the stylegan latent space?. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_47","unstructured":"Nguyen, T., Nguyen, C., Nguyen, D., and Nahavandi, S. (2019). Deep learning for deepfakes creation and detection. arXiv."},{"key":"ref_48","unstructured":"Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., and Nie\u00dfner, M. (July, January 26). Face2face: Real-time face capture and reenactment of rgb videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Korshunova, I., Shi, W., Dambre, J., and Theis, L. (2017, January 22\u201329). Fast face-swap using convolutional neural networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.397"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Thies, J., Zollh\u00f6fer, M., and Nie\u00dfner, M. (2019). Deferred neural rendering: Image synthesis using neural textures. ACM Transactions on Graphics, ACM.","DOI":"10.1145\/3306346.3323035"},{"key":"ref_51","unstructured":"Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., and Nie\u00dfner, M. (November, January 27). Faceforensics++: Learning to detect manipulated facial images. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., and Matas, J. (2018, January 18\u201322). DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00854"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Nah, S., Kim, T.H., and Lee, K.M. (2017, January 21\u201326). Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.35"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Menon, S., Damian, A., Hu, S., Ravi, N., and Rudin, C. (2020, January 16\u201318). PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00251"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/58\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:45:37Z","timestamp":1760179537000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/58"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,24]]},"references-count":54,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["s21010058"],"URL":"https:\/\/doi.org\/10.3390\/s21010058","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,24]]}}}