{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T18:00:01Z","timestamp":1790359201171,"version":"4.1.0"},"reference-count":88,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T00:00:00Z","timestamp":1790294400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Shanxi Office of Philosophy and Social Sciences Planing","award":["2024YB112"],"award-info":[{"award-number":["2024YB112"]}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:p>In the context of smart cities development and digital governance, administrative intelligent approval plays an effective and valuable role in government service transformation. However, the explosive application of technology has led to several challenges of approval quality such as inconsistent with due process, weak error correction mechanism of algorithmic decision-making and lagged supervisory regime, which hinder the service-oriented transformation. Therefore, it is essential to evaluate the quality of intelligent approval using rigorous, rational, and universally applicable methods, which may not only enhance the service standards of digital government and advance smart cities development toward maturity, but also contribute to achieving the Sustainable Development Goals. In the stage of evaluation indicator system construction, determining first-level indicators including legality, rationality, satisfaction and supervision by Delphi Method. Then the corresponding 10 secondary indicators and 38 tertiary indicators are progressively expanded based on value guidance, institutional norms, literature research and cases. In the stage of applying, Taiyuan in China is taken as the evaluation object and implemented through Analytic Hierarchy Process and Fuzzy Comprehensive Evaluation. The evaluation results indicated that although the overall quality shows good, there are several potential and prominent problems, including insufficient specific modes, inaccessible the right to a hearing, inadequate staff service, ineffective public supervision and the lack of transparency, and the targeted strategies are proposed for improving the approval quality. Additionally, future research will establish a dedicated evaluation committee, leverage digital platforms more extensively, and strengthen relevant legislation and theoretical support.<\/jats:p>","DOI":"10.1371\/journal.pone.0354902","type":"journal-article","created":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T17:21:56Z","timestamp":1790356916000},"page":"e0354902","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Advancing the service-oriented transition of smart cities: Evaluating the intelligent approval quality"],"prefix":"10.1371","volume":"21","author":[{"given":"Jiaqi","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-5174-2393","authenticated-orcid":true,"given":"Yali","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,9,25]]},"reference":[{"key":"pone.0354902.ref001","first-page":"27","article-title":"Institutional advantages and risk response of automated administrative licensing","volume":"40","author":"C Lu","year":"2024","journal-title":"Chin Public Adm"},{"key":"pone.0354902.ref002","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.strueco.2025.12.013","article-title":"Smart governance for sustainable development: stage-specific effects and regional heterogeneity in a global empirical framework","volume":"77","author":"J Yin","year":"2026","journal-title":"Struct Chang Econ Dyn"},{"key":"pone.0354902.ref003"},{"issue":"2","key":"pone.0354902.ref004","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1111\/capa.12465","article-title":"When artificial intelligence meets real public administration","volume":"65","author":"J Longo","year":"2022","journal-title":"Can Public Adm"},{"issue":"383","key":"pone.0354902.ref005","first-page":"227","article-title":"The use of AI in public administration","volume":"57","author":"A Drab-Kurowska","year":"2024","journal-title":"Biul G\u0142 Bibl Lek"},{"key":"pone.0354902.ref006","first-page":"98","article-title":"Applications and challenges of artificial intelligence in national governance","volume":"2","author":"F Guo","year":"2025","journal-title":"Soc Sci Int"},{"key":"pone.0354902.ref007","first-page":"87","article-title":"Adjustment of legal rules of online administrative permits","volume":"5","author":"L Yu","year":"2023","journal-title":"J Comp Law"},{"issue":"6","key":"pone.0354902.ref008","first-page":"27","article-title":"Institutional advantages and risk response of automated administrative licensing","volume":"40","author":"C Lu","year":"2024","journal-title":"Chin Public Adm"},{"issue":"3","key":"pone.0354902.ref009","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1111\/capa.12580","article-title":"Artificial intelligence: opportunities and challenges for public administration","volume":"67","author":"G David","year":"2024","journal-title":"Can Public Adm"},{"key":"pone.0354902.ref010","first-page":"31","article-title":"The quality of public services: an analytical framework and path optimization","volume":"11","author":"L Weng","year":"2021","journal-title":"Soc Sci China"},{"key":"pone.0354902.ref011","doi-asserted-by":"crossref","DOI":"10.3389\/fpos.2026.1788065","article-title":"Digital public service quality and results-oriented governance in Peru","volume":"8","author":"MP Vilca Corrales","year":"2026","journal-title":"Front Polit Sci"},{"issue":"4","key":"pone.0354902.ref012","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1177\/00953997251319749","article-title":"Determinants of public service quality: an exploratory factor analysis","volume":"57","author":"JGV de Carvalho Filho","year":"2025","journal-title":"Adm Soc"},{"key":"pone.0354902.ref013","first-page":"112","article-title":"Digital governance drives the improvement of public service quality: a meta-analytic study based on domain and contextual differences","volume":"4","author":"L Liu","year":"2024","journal-title":"E-Government"},{"key":"pone.0354902.ref014","first-page":"80","article-title":"Grading of digital administration and reform in legal control","volume":"1","author":"Y Ma","year":"2019","journal-title":"Adm Law Rev"},{"key":"pone.0354902.ref015","first-page":"61","article-title":"Legal control of algorithms in digital administration","volume":"1","author":"B Wang","year":"2023","journal-title":"Law Econ"},{"key":"pone.0354902.ref016","first-page":"167","article-title":"Research on the full automation of the administrative act in the age of artificial intelligence","volume":"5","author":"Y Zha","year":"2018","journal-title":"J Comp Law"},{"issue":"3","key":"pone.0354902.ref017","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1080\/13600869.2016.1232465","article-title":"The rise and fall of the legal expert system","volume":"30","author":"P Leith","year":"2016","journal-title":"Int Rev Law Comput Technol"},{"issue":"2","key":"pone.0354902.ref018","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1111\/lapo.12164","article-title":"The law in computation: What machine learning, artificial intelligence, and big data mean for law and society scholarship","volume":"43","author":"T DoCarmo","year":"2021","journal-title":"Law Policy"},{"key":"pone.0354902.ref019","first-page":"55","article-title":"The dilemma of discretion in administrative automation and its resolving pathways","volume":"43","author":"Y He","year":"2024","journal-title":"Cyber Secur Data Gov"},{"key":"pone.0354902.ref020","first-page":"108","article-title":"On the basis of the legitimacy of digital administration","volume":"45","author":"Q Li","year":"2023","journal-title":"Glob Law Rev"},{"issue":"1","key":"pone.0354902.ref021","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1111\/rego.12369","article-title":"How to regulate algorithmic decision\u2010making: a framework of regulatory requirements for different applications","volume":"16","author":"TD Krafft","year":"2020","journal-title":"Regul Gov"},{"key":"pone.0354902.ref022","doi-asserted-by":"crossref","first-page":"105718","DOI":"10.1016\/j.clsr.2022.105718","article-title":"Averting enfeeblement and fostering empowerment: algorithmic rights and the right to good administration","volume":"46","author":"M Laukyte","year":"2022","journal-title":"Comput Law Secur Rev"},{"key":"pone.0354902.ref023","first-page":"19","article-title":"Algorithmic risks and legal regulations of digital administration: French experience and Chinese significance","volume":"4","author":"Y Yang","year":"2024","journal-title":"Adm Law Rev"},{"key":"pone.0354902.ref024","volume-title":"Rule of law assessment and rule of law big data","author":"T Meng","year":"2020"},{"issue":"2","key":"pone.0354902.ref025","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1093\/ojls\/gqab032","article-title":"Rethinking administrative law for algorithmic decision making","volume":"42","author":"R Williams","year":"2021","journal-title":"Oxf J Leg Stud"},{"issue":"3","key":"pone.0354902.ref026","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1111\/1468-2230.12412","article-title":"The rule of law and automation of government decision\u2010making","volume":"82","author":"M Zalnieriute","year":"2019","journal-title":"Mod Law Rev"},{"key":"pone.0354902.ref027","first-page":"94","article-title":"A study of technical due process regulation of automated administration","volume":"42","author":"L Zhao","year":"2024","journal-title":"Sci Law"},{"key":"pone.0354902.ref028","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195189285.001.0001","author":"CR Sunstein","year":"2006","journal-title":"Infotopia: how many minds produce knowledge. Oxford, UK: Oxford University Press"},{"issue":"4","key":"pone.0354902.ref029","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1017\/lst.2019.9","article-title":"Administrative law and the machines of government: judicial review of automated public-sector decision-making","volume":"39","author":"J Cobbe","year":"2019","journal-title":"Legal Stud"},{"key":"pone.0354902.ref030","volume-title":"Automating inequality: how high-tech tools profile, police, and punish the poor","author":"V Eubanks","year":"2018"},{"issue":"1","key":"pone.0354902.ref031","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1628\/aoer-2018-0002","article-title":"Regulierung intelligenter systeme","volume":"143","author":"T Wischmeyer","year":"2018","journal-title":"A\u00f6R"},{"issue":"2","key":"pone.0354902.ref032","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1007\/s10506-023-09356-9","article-title":"The black box problem revisited. Real and imaginary challenges for automated legal decision making","volume":"32","author":"B Bro\u017cek","year":"2023","journal-title":"Artif Intell Law"},{"key":"pone.0354902.ref033","doi-asserted-by":"crossref","first-page":"1048","DOI":"10.53637\/WCGG2401","article-title":"Addressing disconnection: automated decision-making, administrative law and regulatory reform","volume":"44","author":"A Huggins","year":"2021","journal-title":"UNSWLJ"},{"key":"pone.0354902.ref034","volume-title":"Qian 27 Xing Zhong No.113 issued by Qiannan Buyi and Miao Autonomous Prefecture Intermediate People\u2019s Court in Guizhou Province","author":"The Administrative Judgment","year":"2016"},{"key":"pone.0354902.ref035","first-page":"50","article-title":"The basic logic of legitimacy certification of digital administration","volume":"38","author":"J Chen","year":"2023","journal-title":"Legal Forum"},{"key":"pone.0354902.ref036","first-page":"1249","article-title":"Technological due process","volume":"85","author":"DK Citron","year":"2008","journal-title":"Wash Univ Law Rev"},{"issue":"2","key":"pone.0354902.ref037","first-page":"364","article-title":"Impoverished algorithms: misguided governments, flawed technologies, and social control","volume":"46","author":"S Valentine","year":"2019","journal-title":"Fordham Urban Law J"},{"key":"pone.0354902.ref038"},{"key":"pone.0354902.ref039","volume-title":"Yue Xing Zhong No.995 of Guangdong Provincial High People\u2019s Court in the case of administrative reconsideration dispute over work-related injury appraisal between a company in Shenzhen and the People\u2019s Government of Guangdong Province","author":"The Administrative Judgment","year":"2019"},{"key":"pone.0354902.ref040","volume-title":"Evaluation theory, models, and applications","author":"DL Stufflebeam","year":"2013","edition":"2"},{"key":"pone.0354902.ref041","unstructured":"Relevant content from ISO 37114:2025 Smart community infrastructure-Responsiveness assessment and maturity model."},{"key":"pone.0354902.ref042","volume-title":"The new public service: serving, not steering","author":"JV Denhardt","year":"2015","edition":"4"},{"key":"pone.0354902.ref043","first-page":"152","article-title":"Structural changes and value integration of administrative procedures in the era of digital government","volume":"1","author":"X Wang","year":"2025","journal-title":"Zhejiang Acad J"},{"key":"pone.0354902.ref044","volume-title":"Rule of law assessment and rule of law big data","author":"T Meng","year":"2020"},{"key":"pone.0354902.ref045","unstructured":"Relevant provisions from the Notice of the State Council on Issuing the Implementation Outline for Comprehensively Promoting Law-Based Administration, the Government Ruled by Law, the Notice of the State Council on Standardizing Administrative Approval by Departments of the State Council to Improve Work Related to Administrative Approval(hereinafter referred to as the Standardize and Improve Approval), and the Guiding Opinions on Deepening Approval Services for Public Convenience(hereinafter referred to as Deepening Approval Services)."},{"key":"pone.0354902.ref046","unstructured":"Relevant provisions of Articles 13, 14, 15, 16 and 17 of the Administrative Licensing Law."},{"key":"pone.0354902.ref047","doi-asserted-by":"crossref","unstructured":"Relevant provisions of Articles 22, 23, 24, 25 and 26 of the Administrative Licensing Law.","DOI":"10.1089\/07300310360521252"},{"key":"pone.0354902.ref048","unstructured":"Relevant provisions of Articles 81, 84, 85, 86, 87, 93 and 95 of the Legislation Law."},{"key":"pone.0354902.ref049","unstructured":"Relevant provisions of Articles 109,110,111 and 112 of the Legislation Law, as well as relevant provisions of the Regulation on the Recordation and Review of Regulations and Rules and Decision of the Standing Committee of the National People\u2019s Congress on Improving and Strengthening the Recordation Review System."},{"issue":"2","key":"pone.0354902.ref050","first-page":"355","article-title":"Automated governance","volume":"101","author":"I Ajunwa","year":"2023","journal-title":"North Carolina Law Rev"},{"key":"pone.0354902.ref051","unstructured":"Relevant provisions of the Implementation Plan on Effectively Solving the Difficulties of the Elderly in Using Intelligent Technologies."},{"key":"pone.0354902.ref052","first-page":"59","article-title":"The challenges of algorithmic decision-making to administrative due process and its responses","volume":"5","author":"X Feng","year":"2024","journal-title":"Acad Exch"},{"key":"pone.0354902.ref053","first-page":"251","article-title":"Administrative law and the governance of automated decision-making: a critical look at Canada\u2019s directive on automated decision-making","volume":"54","author":"T Scassa","year":"2021","journal-title":"U.B.C. Law Rev"},{"key":"pone.0354902.ref054","unstructured":"Relevant provisions of the Data Security Law, and Articles 14 and 36 of the Open Government Information Regulation."},{"key":"pone.0354902.ref055","unstructured":"Relevant provisions of Article 13 and Article 14 of the Personal Information Protection Law, Article 38 of the Data Security Law, and Article 15 of the Open Government Information Regulation."},{"key":"pone.0354902.ref056","first-page":"1249","article-title":"Technological due process","volume":"85","author":"DK Citron","year":"2008","journal-title":"Wash Univ Law Rev"},{"key":"pone.0354902.ref057","author":"T Wischmeyer","year":"2020","journal-title":"Regul Artif Intell. Berlin, Germany: Springer"},{"key":"pone.0354902.ref058","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1177\/0275074019856123","article-title":"Artificial intelligence, discretion, and bureaucracy","volume":"49","author":"JB Bullock","year":"2019","journal-title":"Am Rev Public Adm"},{"issue":"1","key":"pone.0354902.ref059","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1111\/rego.12437","article-title":"Algorithmic regulation: a maturing concept for investigating regulationofandthroughalgorithms","volume":"16","author":"L Ulbricht","year":"2021","journal-title":"Regul Gov"},{"key":"pone.0354902.ref060","unstructured":"Relevant provisions of The Fiscal Code of Germany, Article 22 of the EU General Data Protection Regulation, and Articles 24 and 44 of the Personal Information Protection Law."},{"key":"pone.0354902.ref061","first-page":"112","article-title":"The development of digital government and the response of administrative law","volume":"45","author":"J Wang","year":"2023","journal-title":"Mod Law Sci"},{"key":"pone.0354902.ref062","first-page":"64","article-title":"Technological due process: the double variation of procedural law & programming algorithms in the age of AI","volume":"5","author":"D Liu","year":"2020","journal-title":"J Comp Law"},{"key":"pone.0354902.ref063","first-page":"150","article-title":"The construction of procedural control for the application of automation in administrative punishment","volume":"6","author":"B Guan","year":"2021","journal-title":"Qinghai Soc Sci"},{"issue":"6","key":"pone.0354902.ref064","doi-asserted-by":"crossref","first-page":"979","DOI":"10.1108\/AJIM-04-2020-0099","article-title":"Developing a model to identify the antecedents and consequences of user satisfaction with digital libraries","volume":"72","author":"N Soltani-Nejad","year":"2020","journal-title":"AJIM"},{"key":"pone.0354902.ref065","unstructured":"Relevant provisions of the Deepening Approval Services, the Government Ruled by Law, and the Digital Government."},{"key":"pone.0354902.ref066","first-page":"800","article-title":"Algorithmic accountability in the administrative state","volume":"37","author":"DF Engstrom","year":"2020","journal-title":"Yale J Regul"},{"key":"pone.0354902.ref067","unstructured":"Relevant provisions on supervision and inspection in the Administrative License Law."},{"key":"pone.0354902.ref068","unstructured":"Relevant provisions of the Administrative Reconsideration Law."},{"key":"pone.0354902.ref069","unstructured":"Relevant provisions of the Internal Supervision Regulations of the Communist Party of China."},{"key":"pone.0354902.ref070","unstructured":"Provisions on the inspection of the implementation of laws and regulations in the Supervision of Standing Committees of People\u2019s Congresses at Various Levels Law."},{"key":"pone.0354902.ref071","unstructured":"Relevant provisions of the Oversight Law."},{"key":"pone.0354902.ref072","first-page":"12","article-title":"On the perfection of supervision system of administrative law enforcement","volume":"10","author":"B Zhang","year":"2024","journal-title":"Adm Reform"},{"key":"pone.0354902.ref073","unstructured":"Relevant provisions of the standardize and improve approval, and the quality of administrative law enforcement. 2023."},{"key":"pone.0354902.ref074","volume-title":"Other people\u2019s money: and how the bankers use it","author":"LD Brandeis","year":"1914"},{"issue":"21","key":"pone.0354902.ref075","doi-asserted-by":"crossref","first-page":"1017","DOI":"10.1628\/002268817X15076228061792","article-title":"Algorithmen als Herausforderung f\u00fcr die Rechtsordnung","volume":"72","author":"M Martini","year":"2017","journal-title":"JuristenZeitung"},{"issue":"3","key":"pone.0354902.ref076","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/MSP.2018.2701152","article-title":"Enslaving the algorithm: from a \u201cright to an explanation\u201d to a \u201cright to better decisions\u201d?","volume":"16","author":"L Edwards","year":"2018","journal-title":"IEEE Secur Privacy"},{"key":"pone.0354902.ref077","first-page":"87","article-title":"The legal control of automated administrative licensing review","volume":"44","author":"M Tang","year":"2022","journal-title":"Mod Law Sci"},{"issue":"2","key":"pone.0354902.ref078","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1177\/0306312717699716","article-title":"The right to a human in the loop: political constructions of computer automation and personhood","volume":"47","author":"ML Jones","year":"2017","journal-title":"Soc Stud Sci"},{"issue":"4","key":"pone.0354902.ref079","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1177\/0275074013483167","article-title":"Reflections on \u201cPublic administrative theory and the separation of powers\u201d","volume":"43","author":"DH Rosenbloom","year":"2013","journal-title":"Am Rev Public Adm"},{"issue":"07","key":"pone.0354902.ref080","first-page":"91","article-title":"Organizational law structure of independent regulators in personal information protection","volume":"40","author":"T Zhang","year":"2022","journal-title":"Hebei Law Sci"},{"issue":"01","key":"pone.0354902.ref081","first-page":"99","article-title":"How does research on collaborative governance differ in a Chinese context? A systematic review","volume":"7","author":"X Shan","year":"2025","journal-title":"China Public Adm Rev"},{"issue":"1","key":"pone.0354902.ref082","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1111\/psj.12310","article-title":"Why are cross-sectoral forums important to actors? Forum contributions to cooperation, learning, and resource distribution","volume":"47","author":"M Fischer","year":"2019","journal-title":"Policy Stud J"},{"issue":"9","key":"pone.0354902.ref083","doi-asserted-by":"crossref","first-page":"1333","DOI":"10.1080\/14719037.2014.930505","article-title":"A systematic review of co-creation and co-production: embarking on the social innovation journey","volume":"17","author":"WH Voorberg","year":"2014","journal-title":"Public Manag Rev"},{"issue":"01","key":"pone.0354902.ref084","first-page":"12","article-title":"Law in books and law in action","volume":"44","author":"R Pound","year":"1910","journal-title":"Am Law Rev"},{"key":"pone.0354902.ref085","volume-title":"Research on the legitimacy of law","author":"F Tang","year":"2019"},{"issue":"3","key":"pone.0354902.ref086","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1111\/1468-2230.12934","article-title":"The rule of law and full\u2010bodied promulgation","volume":"88","author":"J Milton","year":"2024","journal-title":"Mod Law Rev"},{"issue":"01","key":"pone.0354902.ref087","first-page":"110","article-title":"The reform of administrative law calls for the optimal administration theory","volume":"12","author":"Y Tian","year":"2018","journal-title":"North Legal Sci"},{"issue":"3","key":"pone.0354902.ref088","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1177\/00323217231166285","article-title":"Deliberating like a state: locating public administration within the deliberative system","volume":"72","author":"R Dean","year":"2023","journal-title":"Political Stud"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0354902","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T17:22:12Z","timestamp":1790356932000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0354902"}},"subtitle":[],"editor":[{"given":"Bifeng","family":"Zhu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,9,25]]},"references-count":88,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9,25]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0354902","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,25]]}}}