{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:33:29Z","timestamp":1750307609152,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":52,"publisher":"ACM","license":[{"start":{"date-parts":[[2008,8,19]],"date-time":"2008-08-19T00:00:00Z","timestamp":1219104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2008,8,19]]},"DOI":"10.1145\/1774674.1774696","type":"proceedings-article","created":{"date-parts":[[2010,4,27]],"date-time":"2010-04-27T12:45:48Z","timestamp":1272372348000},"page":"135-142","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Measurement techniques for multiagent systems"],"prefix":"10.1145","author":[{"given":"Robert N.","family":"Lass","sequence":"first","affiliation":[{"name":"Drexel University, Philadelphia, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Evan A.","family":"Sultanik","sequence":"additional","affiliation":[{"name":"Drexel University, Philadelphia, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William C.","family":"Regli","sequence":"additional","affiliation":[{"name":"Drexel University, Philadelphia, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2008,8,19]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"2004 Performance Metrics for Intelligent Systems Workshop","author":"Anderson Michael L.","year":"2004","unstructured":"Michael L. Anderson . A flexible approach to quantifying various dimensions of environmental complexity . In 2004 Performance Metrics for Intelligent Systems Workshop , 2004 . Michael L. Anderson. A flexible approach to quantifying various dimensions of environmental complexity. In 2004 Performance Metrics for Intelligent Systems Workshop, 2004."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/98457.98518"},{"key":"e_1_3_2_1_3_1","volume-title":"2004 Performance Metrics for Intelligent Systems Workshop","author":"Balakirsky S.","year":"2004","unstructured":"S. Balakirsky and T. R. Kramer . Comparing -- algorithms: Rules of thumb and an example . In 2004 Performance Metrics for Intelligent Systems Workshop , 2004 . S. Balakirsky and T. R. Kramer. Comparing -- algorithms: Rules of thumb and an example. In 2004 Performance Metrics for Intelligent Systems Workshop, 2004."},{"key":"e_1_3_2_1_4_1","volume-title":"2006 Performance Metrics for Intelligent Systems Workshop","author":"Balakirsky S.","year":"2006","unstructured":"S. Balakirsky , C. Scrapper , S. Carpin , and M. Lewis . Usarsim: Providing a framework for multi-robot performance evaluation . In 2006 Performance Metrics for Intelligent Systems Workshop , 2006 . S. Balakirsky, C. Scrapper, S. Carpin, and M. Lewis. Usarsim: Providing a framework for multi-robot performance evaluation. In 2006 Performance Metrics for Intelligent Systems Workshop, 2006."},{"key":"e_1_3_2_1_5_1","first-page":"8","volume-title":"Proceedings of the Autonomy Control Software Workshop at Autonomous Agents (Agents 2019 99)","author":"Barber KS","year":"1999","unstructured":"KS Barber and CE Martin . Agent autonomy : Specification, measurement, and dynamic adjustment . Proceedings of the Autonomy Control Software Workshop at Autonomous Agents (Agents 2019 99) , pages 8 -- 15 , 1999 . KS Barber and CE Martin. Agent autonomy: Specification, measurement, and dynamic adjustment. Proceedings of the Autonomy Control Software Workshop at Autonomous Agents (Agents 2019 99), pages 8--15, 1999."},{"key":"e_1_3_2_1_6_1","first-page":"528","volume-title":"The Goal Question Metric Approach","author":"Basili V.","year":"1994","unstructured":"V. Basili , G. Caldiera , and H. D. Rombach . The Goal Question Metric Approach , pages 528 -- 532 . John Wiley and Sons, Inc. , 1994 . V. Basili, G. Caldiera, and H. D. Rombach. The Goal Question Metric Approach, pages 528--532. John Wiley and Sons, Inc., 1994."},{"key":"e_1_3_2_1_7_1","volume-title":"William M. Mongan, William C. Regli, Randy Reitmeyer, Jeff K. Salvage, Evan A. Sultanik, and Todd Urness. Agent Systems Reference Model","author":"Bloom Brandon","year":"2006","unstructured":"Brandon Bloom , Christopher J. Dugan , Tedd Gimber , Bernard Goren , Andrew Hight , Moshe Kam , Joseph B. Kopena , Robert N. Lass , Israel Mayk , Spiros Mancoridis , Pragnesh Jay Modi , William M. Mongan, William C. Regli, Randy Reitmeyer, Jeff K. Salvage, Evan A. Sultanik, and Todd Urness. Agent Systems Reference Model . Drexel University , Philadelphia, PA , 2006 . http:\/\/gicl.cs.drexel.edu\/people\/regli\/reference_model-v1a.pdf. Brandon Bloom, Christopher J. Dugan, Tedd Gimber, Bernard Goren, Andrew Hight, Moshe Kam, Joseph B. Kopena, Robert N. Lass, Israel Mayk, Spiros Mancoridis, Pragnesh Jay Modi, William M. Mongan, William C. Regli, Randy Reitmeyer, Jeff K. Salvage, Evan A. Sultanik, and Todd Urness. Agent Systems Reference Model. Drexel University, Philadelphia, PA, 2006. http:\/\/gicl.cs.drexel.edu\/people\/regli\/reference_model-v1a.pdf."},{"key":"e_1_3_2_1_8_1","volume-title":"2006 Performance Metrics for Intelligent Systems Workshop","author":"Brendle Bruce","year":"2006","unstructured":"Bruce Brendle . 3d data registrnation based on human perception . In 2006 Performance Metrics for Intelligent Systems Workshop , 2006 . Bruce Brendle. 3d data registrnation based on human perception. In 2006 Performance Metrics for Intelligent Systems Workshop, 2006."},{"key":"e_1_3_2_1_9_1","volume-title":"2004 Performance Metrics for Intelligent Systems Workshop","author":"Burke Jennifer L.","year":"2004","unstructured":"Jennifer L. Burke , Robin R. Murphy , Dawn R. Riddle , and Thomas Fincannon . Task performance metrcis in human-robot interaction: Taking a systems approach . In 2004 Performance Metrics for Intelligent Systems Workshop , 2004 . Jennifer L. Burke, Robin R. Murphy, Dawn R. Riddle, and Thomas Fincannon. Task performance metrcis in human-robot interaction: Taking a systems approach. In 2004 Performance Metrics for Intelligent Systems Workshop, 2004."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1160633.1160900"},{"key":"e_1_3_2_1_11_1","volume-title":"2004 Performance Metrics for Intelligent Systems Workshop","author":"Chellappa Rama","year":"2004","unstructured":"Rama Chellappa and Amit K . Roy Chowdhury. An information theoretic evaluation criterion for 3d reconstruction algorithms . In 2004 Performance Metrics for Intelligent Systems Workshop , 2004 . Rama Chellappa and Amit K. Roy Chowdhury. An information theoretic evaluation criterion for 3d reconstruction algorithms. In 2004 Performance Metrics for Intelligent Systems Workshop, 2004."},{"key":"e_1_3_2_1_12_1","volume-title":"Empirical methods for artificial intelligence","author":"Cohen Paul R.","year":"1995","unstructured":"Paul R. Cohen . Empirical methods for artificial intelligence . MIT Press Cambridge , MA , USA, 1995 . Paul R. Cohen. Empirical methods for artificial intelligence. MIT Press Cambridge, MA, USA, 1995."},{"key":"e_1_3_2_1_13_1","volume-title":"2004 Performance Metrics for Intelligent Systems Workshop","author":"Commuri Sesh","year":"2004","unstructured":"Sesh Commuri , Yushan Li , Dean Hougen , and Rafael Fierro . Evaluating intelligence in unmanned ground vehicle teams . In 2004 Performance Metrics for Intelligent Systems Workshop , 2004 . Sesh Commuri, Yushan Li, Dean Hougen, and Rafael Fierro. Evaluating intelligence in unmanned ground vehicle teams. In 2004 Performance Metrics for Intelligent Systems Workshop, 2004."},{"key":"e_1_3_2_1_14_1","unstructured":"BBN Corporation. Cognitive Agent Architecture (Cougaar). http:\/\/www.cougaar.org\/.  BBN Corporation. Cognitive Agent Architecture (Cougaar). http:\/\/www.cougaar.org\/."},{"key":"e_1_3_2_1_15_1","volume-title":"Mobile Ad hoc Networking (MANET): Routing Protocol Performance Issues and Evaluation Considerations. RFC","author":"Corson S.","year":"1999","unstructured":"S. Corson and J. Macker . Mobile Ad hoc Networking (MANET): Routing Protocol Performance Issues and Evaluation Considerations. RFC 2501, January 1999 . S. Corson and J. Macker. Mobile Ad hoc Networking (MANET): Routing Protocol Performance Issues and Evaluation Considerations. RFC 2501, January 1999."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1082473.1082633"},{"key":"e_1_3_2_1_17_1","volume-title":"IJCAI '07: Proceedings of the 21st International Joint Conference on Artificial Intelligence","author":"Euzenat J\u00e9r\u00f4me","year":"2007","unstructured":"J\u00e9r\u00f4me Euzenat . emantic precision and recall for ontology alignment evaluation . In IJCAI '07: Proceedings of the 21st International Joint Conference on Artificial Intelligence , 2007 . J\u00e9r\u00f4me Euzenat. emantic precision and recall for ontology alignment evaluation. In IJCAI '07: Proceedings of the 21st International Joint Conference on Artificial Intelligence, 2007."},{"key":"e_1_3_2_1_18_1","first-page":"85","volume-title":"Performance Metrics for Intelligent Systems Workshop","author":"Ference Jack J.","year":"2006","unstructured":"Jack J. Ference , Sandor Szabo , and Wassim G. Najm . Performance evaluation of integrated vehicle-based safety systems . In Performance Metrics for Intelligent Systems Workshop , pages 85 -- 89 . NIST Special Publication , 2006 . Jack J. Ference, Sandor Szabo, and Wassim G. Najm. Performance evaluation of integrated vehicle-based safety systems. In Performance Metrics for Intelligent Systems Workshop, pages 85--89. NIST Special Publication, 2006."},{"key":"e_1_3_2_1_19_1","volume-title":"2006 Performance Metrics for Intelligent Systems Workshop","author":"Foedisch M.","year":"2006","unstructured":"M. Foedisch , C. Schlenoff , and R. Madhavan . Performance analysis of symbolic road recognition for on-road driving . In 2006 Performance Metrics for Intelligent Systems Workshop , 2006 . M. Foedisch, C. Schlenoff, and R. Madhavan. Performance analysis of symbolic road recognition for on-road driving. In 2006 Performance Metrics for Intelligent Systems Workshop, 2006."},{"key":"e_1_3_2_1_20_1","volume-title":"2004 Performance Metrics for Intelligent Systems Workshop","author":"Freed Michael","year":"2004","unstructured":"Michael Freed , Robert Harris , and Michael Shafto . Measuring autonomous uav surveillence . In 2004 Performance Metrics for Intelligent Systems Workshop , 2004 . Michael Freed, Robert Harris, and Michael Shafto. Measuring autonomous uav surveillence. In 2004 Performance Metrics for Intelligent Systems Workshop, 2004."},{"key":"e_1_3_2_1_21_1","volume-title":"2004 Performance Metrics for Intelligent Systems Workshop","author":"Freedy A.","year":"2004","unstructured":"A. Freedy , J. McDonough , R. Jacobs , E. Freedy , S. Thayer , and G. Weltman . A mixed initiative human-robots team performance assessment system for use in operational and training environments . In 2004 Performance Metrics for Intelligent Systems Workshop , 2004 . A. Freedy, J. McDonough, R. Jacobs, E. Freedy, S. Thayer, and G. Weltman. A mixed initiative human-robots team performance assessment system for use in operational and training environments. In 2004 Performance Metrics for Intelligent Systems Workshop, 2004."},{"key":"e_1_3_2_1_22_1","unstructured":"Agent Technology Group. A-globe. http:\/\/agents.felk.cvut.cz\/aglobe\/.  Agent Technology Group. A-globe. http:\/\/agents.felk.cvut.cz\/aglobe\/."},{"key":"e_1_3_2_1_23_1","unstructured":"Andreas Haeberlen Alan Mislove Ansley Post and Peter Druschel. Fallacies in evaluating decentralized systems.  Andreas Haeberlen Alan Mislove Ansley Post and Peter Druschel. Fallacies in evaluating decentralized systems."},{"key":"e_1_3_2_1_24_1","volume-title":"Parallel Computers: Theory and Practice","author":"Hollingsworth Jeffrey K.","year":"1995","unstructured":"Jeffrey K. Hollingsworth , James Lumpp , and Barton P. Miller . Techniques for performance measurement of parellel programs . In Parallel Computers: Theory and Practice . IEEE Press , 1995 . Jeffrey K. Hollingsworth, James Lumpp, and Barton P. Miller. Techniques for performance measurement of parellel programs. In Parallel Computers: Theory and Practice. IEEE Press, 1995."},{"key":"e_1_3_2_1_25_1","first-page":"4","volume-title":"Proceedings of the 1992 ACM\/IEEE conference on Supercomputing","author":"Jeffrey","year":"1992","unstructured":"Jeffrey K. Hollingsworth and Barton P. Miller. Parallel program performance metrics: A comparison and validation . In Proceedings of the 1992 ACM\/IEEE conference on Supercomputing , pages 4 -- 13 , Los Alamitos, CA, USA , 1992 . IEEE Computer Society Press. Jeffrey K. Hollingsworth and Barton P. Miller. Parallel program performance metrics: A comparison and validation. In Proceedings of the 1992 ACM\/IEEE conference on Supercomputing, pages 4--13, Los Alamitos, CA, USA, 1992. IEEE Computer Society Press."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1660877.1660883"},{"key":"e_1_3_2_1_27_1","unstructured":"Telocom Italia. Java Agent DEvelopment Framework (JADE). http:\/\/jade.tilab.com\/.  Telocom Italia. Java Agent DEvelopment Framework (JADE). http:\/\/jade.tilab.com\/."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/313451.313535"},{"key":"e_1_3_2_1_29_1","unstructured":"Rick Jones. Netperf. http:\/\/www.netperf.org\/netperf\/NetperfPage.html.  Rick Jones. Netperf. http:\/\/www.netperf.org\/netperf\/NetperfPage.html."},{"key":"e_1_3_2_1_30_1","volume-title":"2006 Performance Metrics for Intelligent Systems Workshop","author":"Kannan Balajee","year":"2006","unstructured":"Balajee Kannan and Lynne E. Parker . Fault tolerance based metrics for evaluating system performance in multi-robot teams . In 2006 Performance Metrics for Intelligent Systems Workshop , 2006 . Balajee Kannan and Lynne E. Parker. Fault tolerance based metrics for evaluating system performance in multi-robot teams. In 2006 Performance Metrics for Intelligent Systems Workshop, 2006."},{"key":"e_1_3_2_1_31_1","first-page":"247","volume-title":"Performance Metrics for Intelligent Systems Workshop","author":"Jeffrey","year":"2006","unstructured":"Jeffrey A. Kramer and Robin R. Murphy. Endurance testing for safety, security and rescue robots . In Performance Metrics for Intelligent Systems Workshop , pages 247 -- 254 . NIST Special Publication , 2006 . Jeffrey A. Kramer and Robin R. Murphy. Endurance testing for safety, security and rescue robots. In Performance Metrics for Intelligent Systems Workshop, pages 247--254. NIST Special Publication, 2006."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009686016775"},{"key":"e_1_3_2_1_33_1","volume-title":"2006 Performance Metrics for Intelligent Systems Workshop","author":"Lundberg C.","year":"2006","unstructured":"C. Lundberg , H. I. Christensen , and R. Reinhold . Intellectual performance using dynamical expert knowledge in seismic environments . In 2006 Performance Metrics for Intelligent Systems Workshop , 2006 . C. Lundberg, H. I. Christensen, and R. Reinhold. Intellectual performance using dynamical expert knowledge in seismic environments. In 2006 Performance Metrics for Intelligent Systems Workshop, 2006."},{"key":"e_1_3_2_1_34_1","volume-title":"Distributed Algorithms. Morgan Kaufmann","author":"Lynch Nancy A.","year":"1996","unstructured":"Nancy A. Lynch . Distributed Algorithms. Morgan Kaufmann , 1996 . Nancy A. Lynch. Distributed Algorithms. Morgan Kaufmann, 1996."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/1018409.1018777"},{"key":"e_1_3_2_1_36_1","volume-title":"Comparing performance of distributed constraints processing algorithms","author":"Meisels A.","year":"2002","unstructured":"A. Meisels , E. Kaplansky , I. Razgon , and R. Zivan . Comparing performance of distributed constraints processing algorithms , 2002 . A. Meisels, E. Kaplansky, I. Razgon, and R. Zivan. Comparing performance of distributed constraints processing algorithms, 2002."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/860575.860602"},{"key":"e_1_3_2_1_38_1","volume-title":"2006 Performance Metrics for Intelligent Systems Workshop","author":"Molino V.","year":"2006","unstructured":"V. Molino , R. Madhavan , E. Messina , T. Downs , A. Jacoff , and S. Balakirsky . Treversability metrics for urban search and rescue robots on rough terrain . In 2006 Performance Metrics for Intelligent Systems Workshop , 2006 . V. Molino, R. Madhavan, E. Messina, T. Downs, A. Jacoff, and S. Balakirsky. Treversability metrics for urban search and rescue robots on rough terrain. In 2006 Performance Metrics for Intelligent Systems Workshop, 2006."},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of PERMIS, 2003","author":"Olsen Dan R.","year":"2003","unstructured":"Dan R. Olsen . and Michael A. Goodrich . Metrics for evaluating human-robot interactions . Proceedings of PERMIS, 2003 , 2003 . Dan R. Olsen. and Michael A. Goodrich. Metrics for evaluating human-robot interactions. Proceedings of PERMIS, 2003, 2003."},{"key":"e_1_3_2_1_40_1","volume-title":"CP 2004 - Fifth International Workshop on Distributed Constraint Reasoning (DCR2004)","author":"Petcu Adrian","year":"2004","unstructured":"Adrian Petcu and Boi Faltings . A distributed, complete method for multi-agent constraint optimization . In CP 2004 - Fifth International Workshop on Distributed Constraint Reasoning (DCR2004) , Toronto, Canada , September 2004 . Adrian Petcu and Boi Faltings. A distributed, complete method for multi-agent constraint optimization. In CP 2004 - Fifth International Workshop on Distributed Constraint Reasoning (DCR2004), Toronto, Canada, September 2004."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022279618991"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/WIIAT.2008.427"},{"key":"e_1_3_2_1_43_1","unstructured":"Emin Gun Sirer. Sextant deployment (accessed 10\/31\/2007). http:\/\/www.cs.cornell.edu\/People\/egs\/sextant\/deployment.php.  Emin Gun Sirer. Sextant deployment (accessed 10\/31\/2007). http:\/\/www.cs.cornell.edu\/People\/egs\/sextant\/deployment.php."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.1980.1675516"},{"key":"e_1_3_2_1_45_1","first-page":"263","volume-title":"Performance Metrics for Intelligent Systems Workshop","author":"Stanton Brian","year":"2006","unstructured":"Brian Stanton , Brian Antonishek , and Jean Scholtz . Development of an evaluation method for acceptable usability . In Performance Metrics for Intelligent Systems Workshop , pages 263 -- 267 . NIST Special Publication , 2006 . Brian Stanton, Brian Antonishek, and Jean Scholtz. Development of an evaluation method for acceptable usability. In Performance Metrics for Intelligent Systems Workshop, pages 263--267. NIST Special Publication, 2006."},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1121241.1121249"},{"key":"e_1_3_2_1_47_1","volume-title":"Science","author":"Stevens S. S.","year":"1946","unstructured":"S. S. Stevens . On the theory of scales of measurement . Science , 1946 . S. S. Stevens. On the theory of scales of measurement. Science, 1946."},{"key":"e_1_3_2_1_48_1","volume-title":"The Ninth Annual Workshop on Distributed Constraint Reasoning","author":"Sultanik Evan A.","year":"2007","unstructured":"Evan A. Sultanik , Robert N. Lass , and William C. Regli . DCOPolis: A framework for simulating and deploying distributed constraint optimization algorithms . In The Ninth Annual Workshop on Distributed Constraint Reasoning , September 2007 . Evan A. Sultanik, Robert N. Lass, and William C. Regli. DCOPolis: A framework for simulating and deploying distributed constraint optimization algorithms. In The Ninth Annual Workshop on Distributed Constraint Reasoning, September 2007."},{"key":"e_1_3_2_1_49_1","first-page":"69","volume-title":"Performance Metrics for Intelligent Systems Workshop","author":"Tunstel Edward","year":"2006","unstructured":"Edward Tunstel . Performance metrics for operational mars rovers . In Performance Metrics for Intelligent Systems Workshop , pages 69 -- 76 . NIST Special Publication , 2006 . Edward Tunstel. Performance metrics for operational mars rovers. In Performance Metrics for Intelligent Systems Workshop, pages 69--76. NIST Special Publication, 2006."},{"key":"e_1_3_2_1_50_1","volume-title":"Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann","author":"Ian","year":"2005","unstructured":"Ian H. Witten and Eibe Frank . Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann , 2005 . Ian H. Witten and Eibe Frank. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, 2005."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/69.729707"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCOM.1980.1094702"}],"event":{"name":"PerMIS '08: Performance Metrics for Intelligent Systems","sponsor":["NIST National Institute of Standards & Technology","SIGAI ACM Special Interest Group on Artificial Intelligence"],"location":"Gaithersburg Maryland","acronym":"PerMIS '08"},"container-title":["Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1774674.1774696","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1774674.1774696","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T12:45:37Z","timestamp":1750250737000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1774674.1774696"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,8,19]]},"references-count":52,"alternative-id":["10.1145\/1774674.1774696","10.1145\/1774674"],"URL":"https:\/\/doi.org\/10.1145\/1774674.1774696","relation":{},"subject":[],"published":{"date-parts":[[2008,8,19]]},"assertion":[{"value":"2008-08-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}