{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T04:50:20Z","timestamp":1782449420951,"version":"3.54.5"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2020,8]]},"abstract":"<jats:p>\n            Machine learning (ML) is at the forefront of the rising popularity of data-driven software applications. The resulting rapid proliferation of ML technology, explosive data growth, and shortage of data science expertise have caused the industry to face increasingly challenging demands to keep up with fast-paced develop-and-deploy model lifecycles. Recent academic and industrial research efforts have started to address this problem through automated machine learning (AutoML) pipelines and have focused on model performance as the first-order design objective. We present Oracle AutoML, a novel\n            <jats:italic toggle=\"yes\">iteration-free<\/jats:italic>\n            AutoML pipeline designed to not only provide accurate models, but also in a shorter runtime. We are able to achieve these objectives by eliminating the need to continuously iterate over various pipeline configurations. In our feed-forward approach, each pipeline stage makes decisions based on metalearned proxy models that can predict candidate pipeline configuration performances before building the full final model. Our approach, which builds and tunes only the best candidate pipeline, achieves better scores at a fraction of the time compared to state-of-the-art open source AutoML tools, such as H2O and Auto-sklearn. This makes Oracle AutoML a prime candidate for addressing current industry challenges.\n          <\/jats:p>","DOI":"10.14778\/3415478.3415542","type":"journal-article","created":{"date-parts":[[2020,9,14]],"date-time":"2020-09-14T18:46:40Z","timestamp":1600109200000},"page":"3166-3180","source":"Crossref","is-referenced-by-count":44,"title":["Oracle AutoML"],"prefix":"10.14778","volume":"13","author":[{"given":"Anatoly","family":"Yakovlev","sequence":"first","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hesam Fathi","family":"Moghadam","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ali","family":"Moharrer","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingxiao","family":"Cai","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikan","family":"Chavoshi","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Venkatanathan","family":"Varadarajan","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sandeep R.","family":"Agrawal","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sam","family":"Idicula","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tomas","family":"Karnagel","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sanjay","family":"Jinturkar","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nipun","family":"Agarwal","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,8]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"https:\/\/aws.amazon.com\/blogs\/aws\/amazon-sagemaker-autopilot-fully-managed-automatic-machine-learning\/","year":"2019","unstructured":"Amazon. Sagemaker. https:\/\/aws.amazon.com\/blogs\/aws\/amazon-sagemaker-autopilot-fully-managed-automatic-machine-learning\/, 2019."},{"key":"e_1_2_1_2_1","volume-title":"New automated machine learning capabilities in azure machine learning service, https:\/\/azure.microsoft.com\/en-us\/blog\/new-automated-machine-learning-capabilities-in-azure-machine-learning-service\/","author":"Anumalasetty K.","year":"2018","unstructured":"K. Anumalasetty. New automated machine learning capabilities in azure machine learning service, https:\/\/azure.microsoft.com\/en-us\/blog\/new-automated-machine-learning-capabilities-in-azure-machine-learning-service\/, 2018."},{"key":"e_1_2_1_3_1","volume-title":"Benchmarking automatic machine learning frameworks. arXiv preprint arXiv:1808.06492","author":"Balaji A.","year":"2018","unstructured":"A. Balaji and A. Allen. Benchmarking automatic machine learning frameworks. arXiv preprint arXiv:1808.06492, 2018."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/2188385.2188395"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-8b375195-003"},{"key":"e_1_2_1_6_1","first-page":"115","volume-title":"Proceedings of the 30th International Conference on International Conference on Machine Learning -","volume":"28","author":"Bergstra J.","unstructured":"J. Bergstra, D. Yamins, and D. D. Cox. Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures. In Proceedings of the 30th International Conference on International Conference on Machine Learning - Volume 28, ICML'13, pages I-115--I-123. JMLR.org, 2013."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/2188385.2188387"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-09823-4_45"},{"key":"e_1_2_1_9_1","volume-title":"Smote: synthetic minority over-sampling technique. Journal of artificial intelligence research, 16:321--357","author":"Chawla N. V.","year":"2002","unstructured":"N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer. Smote: synthetic minority over-sampling technique. Journal of artificial intelligence research, 16:321--357, 2002."},{"key":"e_1_2_1_10_1","volume-title":"Sampling techniques-3","author":"Cochran W. G.","year":"1977","unstructured":"W. G. Cochran. Sampling techniques-3. 1977."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1321440.1321461"},{"key":"e_1_2_1_12_1","first-page":"1437","volume-title":"International Conference on Machine Learning","author":"Falkner S.","year":"2018","unstructured":"S. Falkner, A. Klein, and F. Hutter. Bohb: Robust and efficient hyperparameter optimization at scale. In International Conference on Machine Learning, pages 1437--1446, 2018."},{"key":"e_1_2_1_13_1","first-page":"2755","volume-title":"Proceedings of the 28th International Conference on Neural Information Processing Systems -","volume":"2","author":"Feurer M.","year":"2015","unstructured":"M. Feurer, A. Klein, K. Eggensperger, J. T. Springenberg, M. Blum, and F. Hutter. Efficient and robust automated machine learning. In Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 2, NIPS'15, pages 2755--2763, Cambridge, MA, USA, 2015. MIT Press."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/2887007.2887164"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISIT.2017.8007079"},{"key":"e_1_2_1_16_1","first-page":"3348","volume-title":"Advances in Neural Information Processing Systems 31","author":"Fusi N.","year":"2018","unstructured":"N. Fusi, R. Sheth, and M. Elibol. Probabilistic matrix factorization for automated machine learning. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31, pages 3348--3357. Curran Associates, Inc., 2018."},{"key":"e_1_2_1_17_1","volume-title":"An open source automl benchmark. arXiv preprint arXiv:1907.00909","author":"Gijsbers P.","year":"2019","unstructured":"P. Gijsbers, E. LeDell, J. Thomas, S. Poirier, B. Bischl, and J. Vanschoren. An open source automl benchmark. arXiv preprint arXiv:1907.00909, 2019."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2011.07.005"},{"key":"e_1_2_1_19_1","volume-title":"May","author":"Gonz\u00e1lez J.","year":"2015","unstructured":"J. Gonz\u00e1lez, Z. Dai, P. Hennig, and N. D. Lawrence. Batch Bayesian Optimization via Local Penalization. ArXiv e-prints, May 2015."},{"key":"e_1_2_1_20_1","volume-title":"January","author":"Hall P.","year":"2018","unstructured":"P. Hall, M. Kurka, and A. Bartz. Using H2O Driverless AI, January 2018."},{"key":"e_1_2_1_21_1","article-title":"Learning from imbalanced data","author":"He H.","year":"2008","unstructured":"H. He and E. A. Garcia. Learning from imbalanced data. IEEE Transactions on Knowledge & Data Engineering, (9):1263--1284, 2008.","journal-title":"IEEE Transactions on Knowledge & Data Engineering, (9):1263--1284"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25566-3_40"},{"key":"e_1_2_1_23_1","first-page":"528","volume-title":"Artificial Intelligence and Statistics","author":"Klein A.","year":"2017","unstructured":"A. Klein, S. Falkner, S. Bartels, P. Hennig, and F. Hutter. Fast bayesian optimization of machine learning hyperparameters on large datasets. In Artificial Intelligence and Statistics, pages 528--536, 2017."},{"issue":"2","key":"e_1_2_1_24_1","first-page":"111","article-title":"Data preprocessing for supervised leaning","volume":"1","author":"Kotsiantis S.","year":"2006","unstructured":"S. Kotsiantis, D. Kanellopoulos, and P. Pintelas. Data preprocessing for supervised leaning. International Journal of Computer Science, 1(2):111--117, 2006.","journal-title":"International Journal of Computer Science"},{"key":"e_1_2_1_25_1","volume-title":"Jan.","author":"Kotthoff L.","year":"2017","unstructured":"L. Kotthoff, C. Thornton, H. H. Hoos, F. Hutter, and K. Leyton-Brown. Auto-weka 2.0: Automatic model selection and hyperparameter optimization in weka. J. Mach. Learn. Res., 18(1):826--830, Jan. 2017."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3136625"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3242042"},{"key":"e_1_2_1_28_1","volume-title":"A system for massively parallel hyperparameter tuning. arXiv:1810.05934v5","author":"Li L.","year":"2018","unstructured":"L. Li, K. Jamieson, A. Rostamizadeh, E. Gonina, M. Hardt, B. Recht, and A. Talwalkar. A system for massively parallel hyperparameter tuning. arXiv:1810.05934v5, 2018."},{"issue":"5","key":"e_1_2_1_29_1","first-page":"607","article-title":"Ease.ml: Towards multi-tenant resource sharing for machine learning workloads","volume":"11","author":"Li T.","year":"2018","unstructured":"T. Li, J. Zhong, J. Liu, W. Wu, and C. Zhang. Ease.ml: Towards multi-tenant resource sharing for machine learning workloads. PVLDB, 11(5):607--620, 2018.","journal-title":"PVLDB"},{"key":"e_1_2_1_30_1","first-page":"2737","volume-title":"Advances in Neural Information Processing Systems","author":"Lian X.","year":"2015","unstructured":"X. Lian, Y. Huang, Y. Li, and J. Liu. Asynchronous parallel stochastic gradient for nonconvex optimization. In Advances in Neural Information Processing Systems, pages 2737--2745, 2015."},{"key":"e_1_2_1_31_1","volume-title":"Asynchronous decentralized parallel stochastic gradient descent. arXiv preprint arXiv:1710.06952","author":"Lian X.","year":"2017","unstructured":"X. Lian, W. Zhang, C. Zhang, and J. Liu. Asynchronous decentralized parallel stochastic gradient descent. arXiv preprint arXiv:1710.06952, 2017."},{"key":"e_1_2_1_32_1","volume-title":"Lightgbm v2.2.3 python package documentation. https:\/\/github.com\/microsoft\/LightGBM\/blob\/v2.2.3\/docs\/Features.rst","year":"2018","unstructured":"Lightgbm. Lightgbm v2.2.3 python package documentation. https:\/\/github.com\/microsoft\/LightGBM\/blob\/v2.2.3\/docs\/Features.rst, 2018."},{"key":"e_1_2_1_33_1","first-page":"469","volume-title":"International Conference on Machine Learning","author":"Liu J.","year":"2014","unstructured":"J. Liu, S. Wright, C. R\u00e9, V. Bittorf, and S. Sridhar. An asynchronous parallel stochastic coordinate descent algorithm. In International Conference on Machine Learning, pages 469--477, 2014."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13721-016-0125-6"},{"key":"e_1_2_1_35_1","volume-title":"Auto-sklearn git repository. https:\/\/matplotlib.org\/api\/_as_gen\/matplotlib.pyplot.boxplot.html","year":"2019","unstructured":"matplotlib. Auto-sklearn git repository. https:\/\/matplotlib.org\/api\/_as_gen\/matplotlib.pyplot.boxplot.html, 2019."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2002.1183917"},{"key":"e_1_2_1_37_1","first-page":"12","article-title":"Alors: An algorithm recommender system","volume":"244","author":"Msr M.","year":"2016","unstructured":"M. Msr and M. Sebag. Alors: An algorithm recommender system. Artificial Intelligence, 244, 12 2016.","journal-title":"Artificial Intelligence"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908812.2908918"},{"key":"e_1_2_1_39_1","unstructured":"Oracle Inc. The Oracle AutoML Pipeline. https:\/\/docs.cloud.oracle.com\/en-us\/iaas\/tools\/ads-sdk\/1.0.0\/user_guide\/automl\/overview.html 2020."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1137\/15M1024950"},{"key":"e_1_2_1_42_1","first-page":"6845","volume-title":"Advances in Neural Information Processing Systems","author":"Perrone V.","year":"2018","unstructured":"V. Perrone, R. Jenatton, M. W. Seeger, and C. Archambeau. Scalable hyperparameter transfer learning. In Advances in Neural Information Processing Systems, pages 6845--6855, 2018."},{"key":"e_1_2_1_43_1","first-page":"743","volume-title":"Proceedings of the Seventeenth International Conference on Machine Learning, ICML '00","author":"Pfahringer B.","year":"2000","unstructured":"B. Pfahringer, H. Bensusan, and C. G. Giraud-Carrier. Meta-learning by landmarking various learning algorithms. In Proceedings of the Seventeenth International Conference on Machine Learning, ICML '00, pages 743--750, San Francisco, CA, USA, 2000. Morgan Kaufmann Publishers Inc."},{"key":"e_1_2_1_44_1","volume-title":"https:\/\/mljar.com\/blog\/automl-comparison\/","author":"Poski P.","year":"2017","unstructured":"P. Poski. Automl comparison. https:\/\/mljar.com\/blog\/automl-comparison\/, 2017."},{"key":"e_1_2_1_45_1","first-page":"693","volume-title":"Advances in neural information processing systems","author":"Recht B.","year":"2011","unstructured":"B. Recht, C. Re, S. Wright, and F. Niu. Hogwild: A lock-free approach to parallelizing stochastic gradient descent. In Advances in neural information processing systems, pages 693--701, 2011."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-012-5286-7"},{"key":"e_1_2_1_47_1","volume-title":"Data age 2025: The evolution of data to life-critical dont focus on big data. Focus on the Data Thats Big Sponsored by Seagate The Evolution of Data to Life-Critical Dont Focus on Big Data","author":"Reinsel D.","year":"2017","unstructured":"D. Reinsel, J. Gantz, and J. Rydning. Data age 2025: The evolution of data to life-critical dont focus on big data. Focus on the Data Thats Big Sponsored by Seagate The Evolution of Data to Life-Critical Dont Focus on Big Data, 2017."},{"key":"e_1_2_1_48_1","volume-title":"The algorithm selection problem. Advances in computers, 15(65--118):5","author":"Rice J. R.","year":"1976","unstructured":"J. R. Rice et al. The algorithm selection problem. Advances in computers, 15(65--118):5, 1976."},{"key":"e_1_2_1_49_1","volume-title":"Definition of sklearn metrics log_loss score. https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.log_loss.html","year":"2019","unstructured":"scikit-learn. Definition of sklearn metrics log_loss score. https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.log_loss.html, 2019."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2494218"},{"key":"e_1_2_1_51_1","volume-title":"Sklearn v0.20 home page. https:\/\/scikit-learn.org\/0.20\/","year":"2018","unstructured":"sklearn. Sklearn v0.20 home page. https:\/\/scikit-learn.org\/0.20\/, 2018."},{"key":"e_1_2_1_52_1","first-page":"2951","volume-title":"Proceedings of the 25th International Conference on Neural Information Processing Systems -","volume":"2","author":"Snoek J.","year":"2012","unstructured":"J. Snoek, H. Larochelle, and R. P. Adams. Practical bayesian optimization of machine learning algorithms. In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 2, NIPS'12, pages 2951--2959, USA, 2012. Curran Associates Inc."},{"key":"e_1_2_1_53_1","first-page":"2171","volume-title":"Proceedings of the 32Nd International Conference on International Conference on Machine Learning -","volume":"37","author":"Snoek J.","year":"2015","unstructured":"J. Snoek, O. Rippel, K. Swersky, R. Kiros, N. Satish, N. Sundaram, M. M. A. Patwary, P. Prabhat, and R. P. Adams. Scalable bayesian optimization using deep neural networks. In Proceedings of the 32Nd International Conference on International Conference on Machine Learning - Volume 37, ICML'15, pages 2171--2180. JMLR.org, 2015."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806777.2806945"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2007.04.009"},{"key":"e_1_2_1_56_1","volume-title":"IAL@PKDD\/ECML","author":"Sun-Hosoya L.","year":"2018","unstructured":"L. Sun-Hosoya, I. Guyon, and M. Sebag. Activmetal: Algorithm recommendation with active meta learning. In IAL@PKDD\/ECML, 2018."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487629"},{"key":"e_1_2_1_58_1","first-page":"769","article-title":"Two modifications of cnn","volume":"6","author":"Tomek I.","year":"1976","unstructured":"I. Tomek. Two modifications of cnn. IEEE Trans. Systems, Man and Cybernetics, 6:769--772, 1976.","journal-title":"IEEE Trans. Systems, Man and Cybernetics"},{"key":"e_1_2_1_59_1","volume-title":"Towards automated machine learning: Evaluation and comparison of automl approaches and tools. arXiv preprint arXiv:1908.05557","author":"Truong A.","year":"2019","unstructured":"A. Truong, A. Walters, J. Goodsitt, K. Hines, B. Bruss, and R. Farivar. Towards automated machine learning: Evaluation and comparison of automl approaches and tools. arXiv preprint arXiv:1908.05557, 2019."},{"issue":"2","key":"e_1_2_1_60_1","first-page":"58","article-title":"The problem of concept drift: definitions and related work. Computer Science Department","volume":"106","author":"Tsymbal A.","year":"2004","unstructured":"A. Tsymbal. The problem of concept drift: definitions and related work. Computer Science Department, Trinity College Dublin, 106(2):58, 2004.","journal-title":"Trinity College Dublin"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2641190.2641198"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-23534-9_20"},{"key":"e_1_2_1_63_1","first-page":"8356","volume-title":"Advances in Neural Information Processing Systems","author":"Wong C.","year":"2018","unstructured":"C. Wong, N. Houlsby, Y. Lu, and A. Gesmundo. Transfer learning with neural automl. In Advances in Neural Information Processing Systems, pages 8356--8365, 2018."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-015-0892-3"},{"key":"e_1_2_1_65_1","volume-title":"Xgboost v0.18 python package documentation. https:\/\/xgboost.readthedocs.io\/en\/release_0.8_\/","year":"2018","unstructured":"XGBoost. Xgboost v0.18 python package documentation. https:\/\/xgboost.readthedocs.io\/en\/release_0.8_\/, 2018."},{"key":"e_1_2_1_66_1","volume-title":"Asynchronous parallel adaptive stochastic gradient methods. arXiv preprint arXiv:2002.09095","author":"Xu Y.","year":"2020","unstructured":"Y. Xu, C. Sutcher-Shepard, Y. Xu, and J. Chen. Asynchronous parallel adaptive stochastic gradient methods. arXiv preprint arXiv:2002.09095, 2020."},{"key":"e_1_2_1_67_1","series-title":"Proceedings of Machine Learning Research","first-page":"1077","volume-title":"Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics","author":"Yogatama D.","year":"2014","unstructured":"D. Yogatama and G. Mann. Efficient Transfer Learning Method for Automatic Hyperparameter Tuning. In S. Kaski and J. Corander, editors, Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics, volume 33 of Proceedings of Machine Learning Research, pages 1077--1085, Reykjavik, Iceland, 22-25 Apr 2014. PMLR."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3415478.3415542","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,17]],"date-time":"2025-09-17T02:24:53Z","timestamp":1758075893000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3415478.3415542"}},"subtitle":["a fast and predictive AutoML pipeline"],"short-title":[],"issued":{"date-parts":[[2020,8]]},"references-count":67,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2020,8]]}},"alternative-id":["10.14778\/3415478.3415542"],"URL":"https:\/\/doi.org\/10.14778\/3415478.3415542","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2020,8]]}}}