{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:27:27Z","timestamp":1750220847320,"version":"3.41.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"5s","license":[{"start":{"date-parts":[[2019,10,8]],"date-time":"2019-10-08T00:00:00Z","timestamp":1570492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2019,10,31]]},"abstract":"<jats:p>\n            Design Space Exploration (DSE) techniques for complex embedded systems must cope with a huge variety of applications and target architectures as well as a wide spectrum of objectives and constraints. In particular, existing design automation approaches are either problem-independent, in that they do not exploit any knowledge about the optimization problem at hand, or are tailored to specific a priori assumptions about the problem and\/or a specific set of design objectives. While the latter are only applicable within a very limited scope of design problems, the former may struggle to deliver high-quality solutions for problems with large design spaces and\/or complex design objectives. As a remedy, we propose\n            <jats:italic>Importance-Guided Order Rearrangement (IGOR)<\/jats:italic>\n            as a novel approach for DSE of embedded systems. Instead of relying on an a\u00a0priori problem knowledge, IGOR uses a machine-learning-inspired technique to dynamically analyze the importance of design decisions, i.e., the impact that these decisions\u2014within the specific problem that is being optimized\u2014have on the quality of explored problem solutions w.r.t. the given design objectives. Throughout the DSE, IGOR uses this information to guide the optimization towards the most promising regions of the design space. Experimental results for a variety of applications from different domains of embedded computing and for different optimization scenarios give evidence that the proposed approach is both scalable and adaptable, as it can be used for the optimization of systems described by several thousands constraints, where it outperforms both problem-specific and problem-independent optimization approaches and achieves \u03b5-dominance improvements of up to 95%.\n          <\/jats:p>","DOI":"10.1145\/3358204","type":"journal-article","created":{"date-parts":[[2019,10,10]],"date-time":"2019-10-10T13:13:05Z","timestamp":1570713185000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["IGOR, Get Me the Optimum! Prioritizing Important Design Decisions During the DSE of Embedded Systems"],"prefix":"10.1145","volume":"18","author":[{"given":"Fedor","family":"Smirnov","sequence":"first","affiliation":[{"name":"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU), Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0350-4784","authenticated-orcid":false,"given":"Behnaz","family":"Pourmohseni","sequence":"additional","affiliation":[{"name":"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU), Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8006-8843","authenticated-orcid":false,"given":"Michael","family":"Gla\u00df","sequence":"additional","affiliation":[{"name":"Universit\u00e4t Ulm, Ulm, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6285-5862","authenticated-orcid":false,"given":"J\u00fcrgen","family":"Teich","sequence":"additional","affiliation":[{"name":"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU), Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,10,8]]},"reference":[{"volume-title":"Guiding genetic algorithms using importance measures for reliable design of embedded systems","author":"Aliee Hananeh","key":"e_1_2_1_1_1","unstructured":"Hananeh Aliee , Stefan Vitzethum , Michael Gla\u00df , J\u00fcrgen Teich , and Emanuele Borgonovo . 2016. Guiding genetic algorithms using importance measures for reliable design of embedded systems . In DFT. IEEE. Hananeh Aliee, Stefan Vitzethum, Michael Gla\u00df, J\u00fcrgen Teich, and Emanuele Borgonovo. 2016. Guiding genetic algorithms using importance measures for reliable design of embedded systems. In DFT. IEEE."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2010.2049053"},{"key":"e_1_2_1_3_1","volume-title":"System-level synthesis using evolutionary algorithms. Design Automation for Embedded Systems","author":"Blickle Tobias","year":"1998","unstructured":"Tobias Blickle , J\u00fcrgen Teich , and Lothar Thiele . 1998. System-level synthesis using evolutionary algorithms. Design Automation for Embedded Systems ( 1998 ), 23--58. Tobias Blickle, J\u00fcrgen Teich, and Lothar Thiele. 1998. System-level synthesis using evolutionary algorithms. Design Automation for Embedded Systems (1998), 23--58."},{"key":"e_1_2_1_4_1","first-page":"77","article-title":"Learning evaluation functions to improve optimization by local search","author":"Boyan Justin","year":"2000","unstructured":"Justin Boyan and Andrew W. Moore . 2000 . Learning evaluation functions to improve optimization by local search . Journal of Machine Learning Research 1 , Nov (2000), 77 -- 112 . Justin Boyan and Andrew W. Moore. 2000. Learning evaluation functions to improve optimization by local search. Journal of Machine Learning Research 1, Nov (2000), 77--112.","journal-title":"Journal of Machine Learning Research 1"},{"volume-title":"Classification and Regression Trees","author":"Breiman Leo","key":"e_1_2_1_5_1","unstructured":"Leo Breiman . 2017. Classification and Regression Trees . Routledge . Leo Breiman. 2017. Classification and Regression Trees. Routledge."},{"key":"e_1_2_1_6_1","volume-title":"Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: A survey of the state of the art. Computer Methods in Applied Mechanics and Engineering 191, 11","author":"Coello Coello Carlos A.","year":"2002","unstructured":"Carlos A. Coello Coello . 2002. Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: A survey of the state of the art. Computer Methods in Applied Mechanics and Engineering 191, 11 ( 2002 ). Carlos A. Coello Coello. 2002. Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: A survey of the state of the art. Computer Methods in Applied Mechanics and Engineering 191, 11 (2002)."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/368273.368557"},{"key":"e_1_2_1_8_1","volume-title":"A fast and elitist multiobjective genetic algorithm: NSGA-II","author":"Deb Kalyanmoy","year":"2002","unstructured":"Kalyanmoy Deb , Amrit Pratap , Sameer Agarwal , and TAMT Meyarivan . 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II . IEEE Transactions on Evolutionary Computation ( 2002 ), 182--197. Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and TAMT Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation (2002), 182--197."},{"key":"e_1_2_1_9_1","unstructured":"Robert Dick. 2010. Embedded system synthesis benchmarks suite (E3S). http:\/\/ziyang.eecs.umich.edu\/ dickrp\/e3sdd\/.  Robert Dick. 2010. Embedded system synthesis benchmarks suite (E3S). http:\/\/ziyang.eecs.umich.edu\/ dickrp\/e3sdd\/."},{"key":"e_1_2_1_10_1","unstructured":"Michael Gla\u00df Felix Reimann Martin Lukasiewycz and Faramarz Khosravi. 2014. JReliability - The Java-based Reliability Library.  Michael Gla\u00df Felix Reimann Martin Lukasiewycz and Faramarz Khosravi. 2014. JReliability - The Java-based Reliability Library."},{"volume-title":"Hybrid Optimization Techniques for System-Level Design Space Exploration","author":"Gla\u00df Michael","key":"e_1_2_1_11_1","unstructured":"Michael Gla\u00df , J\u00fcrgen Teich , Martin Lukasiewycz , and Felix Reimann . 2017. Hybrid Optimization Techniques for System-Level Design Space Exploration . Springer Netherlands , Dordrecht , 217--246. Michael Gla\u00df, J\u00fcrgen Teich, Martin Lukasiewycz, and Felix Reimann. 2017. Hybrid Optimization Techniques for System-Level Design Space Exploration. Springer Netherlands, Dordrecht, 217--246."},{"key":"e_1_2_1_12_1","volume-title":"EMO","author":"Ito Taishi","year":"2019","unstructured":"Taishi Ito , Hern\u00e1n Aguirre , Kiyoshi Tanaka , Arnaud Liefooghe , Bilel Derbel , and S\u00e9bastien Verel . [n.d.]. Estimating relevance of variables for effective recombination . In EMO 2019 . Springer. Taishi Ito, Hern\u00e1n Aguirre, Kiyoshi Tanaka, Arnaud Liefooghe, Bilel Derbel, and S\u00e9bastien Verel. [n.d.]. Estimating relevance of variables for effective recombination. In EMO 2019. Springer."},{"key":"e_1_2_1_13_1","volume-title":"NASA: A generic infrastructure for system-level MP-SoC design space exploration. In ESTIMedia","author":"Jia Zai Jian","year":"2010","unstructured":"Zai Jian Jia , Andy D. Pimentel , Mark Thompson , Tom\u00e1s Bautista , and Antonio N\u00fa\u00f1ez . 2010 . NASA: A generic infrastructure for system-level MP-SoC design space exploration. In ESTIMedia . IEEE. Zai Jian Jia, Andy D. Pimentel, Mark Thompson, Tom\u00e1s Bautista, and Antonio N\u00fa\u00f1ez. 2010. NASA: A generic infrastructure for system-level MP-SoC design space exploration. In ESTIMedia. IEEE."},{"key":"e_1_2_1_14_1","volume-title":"Partha Pratim Pande, Diana Marculescu, and Radu Marculescu.","author":"Joardar Biresh","year":"2018","unstructured":"Biresh Joardar , Ryan Kim , Janardhan Rao Doppa , Partha Pratim Pande, Diana Marculescu, and Radu Marculescu. 2018 . Learning-based application-agnostic 3D NoCe design for heterogeneous manycore systems. IEEE Trans. Comput . (2018). Biresh Joardar, Ryan Kim, Janardhan Rao Doppa, Partha Pratim Pande, Diana Marculescu, and Radu Marculescu. 2018. Learning-based application-agnostic 3D NoCe design for heterogeneous manycore systems. IEEE Trans. Comput. (2018)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSD.2013.61"},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Faramarz Khosravi Felix Reimann Michael Gla\u00df and J\u00fcrgen Teich. 2014. Multi-objective local-search optimization using reliability importance measuring. In DAC. ACM.  Faramarz Khosravi Felix Reimann Michael Gla\u00df and J\u00fcrgen Teich. 2014. Multi-objective local-search optimization using reliability importance measuring. In DAC. ACM.","DOI":"10.1145\/2593069.2593164"},{"key":"e_1_2_1_17_1","volume-title":"Combining convergence and diversity in evolutionary multiobjective optimization. Evolutionary Computation","author":"Laumanns Marco","year":"2002","unstructured":"Marco Laumanns , Lothar Thiele , Kalyanmoy Deb , and Eckart Zitzler . 2002. Combining convergence and diversity in evolutionary multiobjective optimization. Evolutionary Computation ( 2002 ). Marco Laumanns, Lothar Thiele, Kalyanmoy Deb, and Eckart Zitzler. 2002. Combining convergence and diversity in evolutionary multiobjective optimization. Evolutionary Computation (2002)."},{"key":"e_1_2_1_18_1","volume-title":"The sat4j library, release 2.2, system description. Journal on Satisfiability, Boolean Modeling and Computation 7","author":"Berre Daniel Le","year":"2010","unstructured":"Daniel Le Berre and Anne Parrain . 2010. The sat4j library, release 2.2, system description. Journal on Satisfiability, Boolean Modeling and Computation 7 ( 2010 ). Daniel Le Berre and Anne Parrain. 2010. The sat4j library, release 2.2, system description. Journal on Satisfiability, Boolean Modeling and Computation 7 (2010)."},{"key":"e_1_2_1_19_1","volume-title":"Carloni","author":"Liu Hung-Yi","year":"2013","unstructured":"Hung-Yi Liu and Luca P . Carloni . 2013 . On learning-based methods for design-space exploration with high-level synthesis. In DAC. ACM. Hung-Yi Liu and Luca P. Carloni. 2013. On learning-based methods for design-space exploration with high-level synthesis. In DAC. ACM."},{"key":"e_1_2_1_20_1","volume-title":"IEEE Congress on Evolutionary Computation.","author":"Lukasiewycz Martin","year":"2007","unstructured":"Martin Lukasiewycz , Michael Gla\u00df , Christian Haubelt , and Jurgen Teich . 2007 . SAT-decoding in evolutionary algorithms for discrete constrained optimization problems . In IEEE Congress on Evolutionary Computation. Martin Lukasiewycz, Michael Gla\u00df, Christian Haubelt, and Jurgen Teich. 2007. SAT-decoding in evolutionary algorithms for discrete constrained optimization problems. In IEEE Congress on Evolutionary Computation."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of GECCO.","author":"Lukasiewycz Martin","year":"2011","unstructured":"Martin Lukasiewycz , Michael Gla\u00df , Felix Reimann , and J\u00fcrgen Teich . 2011 . Opt4J - A modular framework for meta-heuristic optimization . In Proceedings of GECCO. Martin Lukasiewycz, Michael Gla\u00df, Felix Reimann, and J\u00fcrgen Teich. 2011. Opt4J - A modular framework for meta-heuristic optimization. In Proceedings of GECCO."},{"key":"e_1_2_1_22_1","volume-title":"Fahmy","author":"Lukasiewycz Martin","year":"2014","unstructured":"Martin Lukasiewycz , Shanker Shreejith , and Suhaib A . Fahmy . 2014 . System simulation and optimization using reconfigurable hardware. In Proceedings of ISIC. Martin Lukasiewycz, Shanker Shreejith, and Suhaib A. Fahmy. 2014. System simulation and optimization using reconfigurable hardware. In Proceedings of ISIC."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/DATE.2009.5090711"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2018.8342014"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.191995"},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Berkin Ozisikyilmaz Gokhan Memik and Alok Choudhary. 2008. Efficient system design space exploration using machine learning techniques. In DAC. ACM.  Berkin Ozisikyilmaz Gokhan Memik and Alok Choudhary. 2008. Efficient system design space exploration using machine learning techniques. In DAC. ACM.","DOI":"10.1145\/1391469.1391712"},{"volume-title":"Optimization Strategies in Design Space Exploration","author":"Panerati Jacopo","key":"e_1_2_1_27_1","unstructured":"Jacopo Panerati , Donatella Sciuto , and Giovanni Beltrame . 2017. Optimization Strategies in Design Space Exploration . Springer Netherlands , Dordrecht , 1--29. Jacopo Panerati, Donatella Sciuto, and Giovanni Beltrame. 2017. Optimization Strategies in Design Space Exploration. Springer Netherlands, Dordrecht, 1--29."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"volume-title":"Automatic operating point distillation for hybrid mapping methodologies","author":"Pourmohseni Behnaz","key":"e_1_2_1_29_1","unstructured":"Behnaz Pourmohseni , Michael Gla\u00df , and J\u00fcrgen Teich . 2017. Automatic operating point distillation for hybrid mapping methodologies . In DATE. IEEE. Behnaz Pourmohseni, Michael Gla\u00df, and J\u00fcrgen Teich. 2017. Automatic operating point distillation for hybrid mapping methodologies. In DATE. IEEE."},{"key":"e_1_2_1_30_1","volume-title":"31st Euromicro Conference on Real-Time Systems (ECRTS 2019) (Leibniz International Proceedings in Informatics (LIPIcs))","volume":"133","author":"Pourmohseni Behnaz","year":"2019","unstructured":"Behnaz Pourmohseni , Fedor Smirnov , Stefan Wildermann , and J\u00fcrgen Teich . 2019 . Isolation-aware timing analysis and design space exploration for predictable and composable many-core systems . In 31st Euromicro Conference on Real-Time Systems (ECRTS 2019) (Leibniz International Proceedings in Informatics (LIPIcs)) , Vol. 133 . Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik. Behnaz Pourmohseni, Fedor Smirnov, Stefan Wildermann, and J\u00fcrgen Teich. 2019. Isolation-aware timing analysis and design space exploration for predictable and composable many-core systems. In 31st Euromicro Conference on Real-Time Systems (ECRTS 2019) (Leibniz International Proceedings in Informatics (LIPIcs)), Vol. 133. Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik."},{"key":"e_1_2_1_31_1","unstructured":"Felix Reimann Martin Lukasiewycz Michael Gla\u00df and Fedor Smirnov. 2018. OpenDSE -- Open Design Space Exploration Framework. http:\/\/opendse.sourceforge.net\/.  Felix Reimann Martin Lukasiewycz Michael Gla\u00df and Fedor Smirnov. 2018. OpenDSE -- Open Design Space Exploration Framework. http:\/\/opendse.sourceforge.net\/."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3195970.3195995"},{"volume-title":"Learning variable importance to guide recombination on many-objective optimization","author":"Sagawa Miyako","key":"e_1_2_1_33_1","unstructured":"Miyako Sagawa , Hern\u00e1n Aguirre , Fabio Daolio , Arnaud Liefooghe , Bilel Derbel , S\u00e9bastien Verel , and Kiyoshi Tanaka . 2017. Learning variable importance to guide recombination on many-objective optimization . In IIAI-AAI. IEEE. Miyako Sagawa, Hern\u00e1n Aguirre, Fabio Daolio, Arnaud Liefooghe, Bilel Derbel, S\u00e9bastien Verel, and Kiyoshi Tanaka. 2017. Learning variable importance to guide recombination on many-objective optimization. In IIAI-AAI. IEEE."},{"key":"e_1_2_1_34_1","volume-title":"Embedded system design for automotive applications. Computer 40, 10","author":"Sangiovanni-Vincentelli Alberto","year":"2007","unstructured":"Alberto Sangiovanni-Vincentelli and Marco Di Natale . 2007. Embedded system design for automotive applications. Computer 40, 10 ( 2007 ). Alberto Sangiovanni-Vincentelli and Marco Di Natale. 2007. Embedded system design for automotive applications. Computer 40, 10 (2007)."},{"key":"e_1_2_1_35_1","volume-title":"Accelerating throughput-aware runtime mapping for heterogeneous MPSoCs. ACM TODAES","author":"Singh Amit Kumar","year":"2013","unstructured":"Amit Kumar Singh , Akash Kumar , and Thambipillai Srikanthan . 2013. Accelerating throughput-aware runtime mapping for heterogeneous MPSoCs. ACM TODAES ( 2013 ). Amit Kumar Singh, Akash Kumar, and Thambipillai Srikanthan. 2013. Accelerating throughput-aware runtime mapping for heterogeneous MPSoCs. ACM TODAES (2013)."},{"key":"e_1_2_1_36_1","unstructured":"Fedor Smirnov. 2019. IGOR. https:\/\/github.com\/FedorSmirnov89\/IGOR.  Fedor Smirnov. 2019. IGOR. https:\/\/github.com\/FedorSmirnov89\/IGOR."},{"key":"e_1_2_1_37_1","unstructured":"Fedor Smirnov. 2019. MDR. https:\/\/github.com\/FedorSmirnov89\/MDR.  Fedor Smirnov. 2019. MDR. https:\/\/github.com\/FedorSmirnov89\/MDR."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5220\/0007797802420253"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3207719.3207725"},{"key":"e_1_2_1_40_1","unstructured":"Alice Smith Alice E. Smith David W. Coit Thomas Baeck David Fogel and Zbigniew Michalewicz. 1997. Penalty Functions.  Alice Smith Alice E. Smith David W. Coit Thomas Baeck David Fogel and Zbigniew Michalewicz. 1997. Penalty Functions."},{"key":"e_1_2_1_41_1","volume-title":"Reliability optimization of series-parallel systems with a choice of redundancy strategies using a genetic algorithm. Reliability Engineering 8 System Safety 93, 4","author":"Tavakkoli-Moghaddam Reza","year":"2008","unstructured":"Reza Tavakkoli-Moghaddam , Jalal Safari , and Farrokh Sassani . 2008. Reliability optimization of series-parallel systems with a choice of redundancy strategies using a genetic algorithm. Reliability Engineering 8 System Safety 93, 4 ( 2008 ). Reza Tavakkoli-Moghaddam, Jalal Safari, and Farrokh Sassani. 2008. Reliability optimization of series-parallel systems with a choice of redundancy strategies using a genetic algorithm. Reliability Engineering 8 System Safety 93, 4 (2008)."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSOC.2005.1595650"},{"key":"e_1_2_1_43_1","volume-title":"SPEA2: Improving the strength Pareto evolutionary algorithm. TIK-report 103","author":"Zitzler Eckart","year":"2001","unstructured":"Eckart Zitzler , Marco Laumanns , and Lothar Thiele . 2001. SPEA2: Improving the strength Pareto evolutionary algorithm. TIK-report 103 ( 2001 ). Eckart Zitzler, Marco Laumanns, and Lothar Thiele. 2001. SPEA2: Improving the strength Pareto evolutionary algorithm. TIK-report 103 (2001)."},{"key":"e_1_2_1_44_1","volume-title":"Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach","author":"Zitzler Eckart","year":"1999","unstructured":"Eckart Zitzler and Lothar Thiele . 1999. Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach . IEEE Transactions on Evolutionary Computation 3.4 3, 4 ( 1999 ), 257--271. Eckart Zitzler and Lothar Thiele. 1999. Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach. IEEE Transactions on Evolutionary Computation 3.4 3, 4 (1999), 257--271."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2248418.2248436"}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3358204","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3358204","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:07Z","timestamp":1750202587000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3358204"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,8]]},"references-count":45,"journal-issue":{"issue":"5s","published-print":{"date-parts":[[2019,10,31]]}},"alternative-id":["10.1145\/3358204"],"URL":"https:\/\/doi.org\/10.1145\/3358204","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"type":"print","value":"1539-9087"},{"type":"electronic","value":"1558-3465"}],"subject":[],"published":{"date-parts":[[2019,10,8]]},"assertion":[{"value":"2019-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-10-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}