{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T16:41:15Z","timestamp":1776357675988,"version":"3.51.2"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2008,3,5]],"date-time":"2008-03-05T00:00:00Z","timestamp":1204675200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100002850","name":"Fondo Nacional de Desarrollo Cient\u00edfico y Tecnol\u00f3gico","doi-asserted-by":"publisher","award":["1.11E+14"],"award-info":[{"award-number":["1.11E+14"]}],"id":[{"id":"10.13039\/501100002850","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2012,2]]},"abstract":"<jats:p>Collaborative systems evaluation is always necessary to determine the impact a solution will have on the individuals, groups, and the organization. Several methods of evaluation have been proposed. These methods comprise a variety of approaches with various goals. Thus, the need for a strategy to select the most appropriate method for a specific case is clear. This research work presents a detailed framework to evaluate collaborative systems according to given variables and performance levels. The proposal assumes that evaluation is an evolving process during the system lifecycle. Therefore, the framework, illustrated with two examples, is complemented with a collection of guidelines to evaluate collaborative systems according to product development status.<\/jats:p>","DOI":"10.1145\/2089125.2089128","type":"journal-article","created":{"date-parts":[[2012,3,6]],"date-time":"2012-03-06T13:18:22Z","timestamp":1331039902000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["Structuring dimensions for collaborative systems evaluation"],"prefix":"10.1145","volume":"44","author":[{"given":"Pedro","family":"Antunes","sequence":"first","affiliation":[{"name":"University of Lisbon"}]},{"given":"Valeria","family":"Herskovic","sequence":"additional","affiliation":[{"name":"University of Chile, Santiago"}]},{"given":"Sergio F.","family":"Ochoa","sequence":"additional","affiliation":[{"name":"University of Chile, Santiago"}]},{"given":"Jose A.","family":"Pino","sequence":"additional","affiliation":[{"name":"University of Chile, Santiago"}]}],"member":"320","published-online":{"date-parts":[[2008,3,5]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39850-9_10"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/11853862_6"},{"key":"e_1_2_1_3_1","first-page":"523","article-title":"Addressing the conflicting dimension of groupware: A case study in software requirements validation","volume":"25","author":"Antunes P.","year":"2006","unstructured":"Antunes , P. , Ramires , J. , and Resp\u00edcio , A. 2006 . Addressing the conflicting dimension of groupware: A case study in software requirements validation . Comput. Informatics 25 , 523 -- 546 . Antunes, P., Ramires, J., and Resp\u00edcio, A. 2006. Addressing the conflicting dimension of groupware: A case study in software requirements validation. Comput. Informatics 25, 523--546.","journal-title":"Comput. Informatics"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/646133.680157"},{"key":"e_1_2_1_5_1","volume-title":"Eds","author":"Baecker R. M.","year":"1995","unstructured":"Baecker , R. M. , Grudin , J. , Buxton , W. , and Greenberg , S. , Eds . 1995 . Human-computer Interaction : Toward the Year 2000. Morgan Kaufmann , San Francisco, CA, 1995. Baecker, R. M., Grudin, J., Buxton, W., and Greenberg, S., Eds. 1995. Human-computer Interaction: Toward the Year 2000. Morgan Kaufmann, San Francisco, CA, 1995."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/266838.266860"},{"key":"e_1_2_1_7_1","first-page":"4","article-title":"Towards formal evaluation of collaborative work and its application to information retrieval. Info","volume":"11","author":"Baeza-Yates R.","year":"2006","unstructured":"Baeza-Yates , R. and Pino , J. 2006 . Towards formal evaluation of collaborative work and its application to information retrieval. Info . Res. 11 , 4 . Baeza-Yates, R. and Pino, J. 2006. Towards formal evaluation of collaborative work and its application to information retrieval. Info. Res. 11, 4.","journal-title":"Res."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/645350.650731"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/587078.587093"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.84220"},{"key":"e_1_2_1_11_1","volume-title":"John Wiley & Sons","author":"Bias R.","unstructured":"Bias , R. 1994. The pluralistic usability walkthrough: coordinated empathies . Usability Inspection Methods. J. Nielsen and R. Mack, Eds., John Wiley & Sons , New York , 63--76. Bias, R. 1994. The pluralistic usability walkthrough: coordinated empathies. Usability Inspection Methods. J. Nielsen and R. Mack, Eds., John Wiley & Sons, New York, 63--76."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.1998.11518217"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 37th Annual Hawaii International Conference on Systems Sciences, IEEE Computer Society Press.","author":"Briggs R.","unstructured":"Briggs , R. , Qureshi , S. , and Reinig , B . 2004. Satisfaction attainment theory as a model for value creation . In Proceedings of the 37th Annual Hawaii International Conference on Systems Sciences, IEEE Computer Society Press. Briggs, R., Qureshi, S., and Reinig, B. 2004. Satisfaction attainment theory as a model for value creation. In Proceedings of the 37th Annual Hawaii International Conference on Systems Sciences, IEEE Computer Society Press."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/358886.358895"},{"key":"e_1_2_1_15_1","volume-title":"Making use: Scenario-Based Design of Human-Computer Interactions","author":"Carroll J.","unstructured":"Carroll , J. 2000. Making use: Scenario-Based Design of Human-Computer Interactions . The MIT Press , Cambridge, MA . Carroll, J. 2000. Making use: Scenario-Based Design of Human-Computer Interactions. The MIT Press, Cambridge, MA."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/566981.566990"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028014.1028063"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/323216.323362"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-9236(94)90079-5"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/259963.260065"},{"key":"e_1_2_1_21_1","first-page":"1","article-title":"Evaluating shared workspace performance using human information processing models. Info","volume":"14","author":"Ferreira A.","year":"2009","unstructured":"Ferreira , A. , Antunes , P. , and Pino , J. 2009 . Evaluating shared workspace performance using human information processing models. Info . Res. 14 , 1 , 388. Ferreira, A., Antunes, P., and Pino, J. 2009. Evaluating shared workspace performance using human information processing models. Info. Res. 14, 1, 388.","journal-title":"Res."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.1998.11518216"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357074"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/329693.329696"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the IEEE International Workshops on Enabling Technologies Infrastructures for Collaborative Enterprises, 98--103","author":"Gutwin C.","unstructured":"Gutwin , C. and Greenberg , S . 2000. The mechanics of collaboration: Developing low cost usability evaluation methods for shared workspaces . In Proceedings of the IEEE International Workshops on Enabling Technologies Infrastructures for Collaborative Enterprises, 98--103 . Gutwin, C. and Greenberg, S. 2000. The mechanics of collaboration: Developing low cost usability evaluation methods for shared workspaces. In Proceedings of the IEEE International Workshops on Enabling Technologies Infrastructures for Collaborative Enterprises, 98--103."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/240080.240298"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1099203.1099219"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031607.1031624"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Herskovic V. Pino J. A. Ochoa S. F. and \n      Antunes P\n  . \n  2007\n  . Evaluation methods for groupware systems. \n  In Proceedings of CRIWG Lecture Notes in Computer Science vol. \n  4715 328--336.   Herskovic V. Pino J. A. Ochoa S. F. and Antunes P. 2007. Evaluation methods for groupware systems. In Proceedings of CRIWG Lecture Notes in Computer Science vol. 4715 328--336.","DOI":"10.1007\/978-3-540-74812-0_26"},{"key":"e_1_2_1_30_1","unstructured":"Hix D. and Hartson H. R. 1993. Developing User Interfaces: Ensuring Usability Through Product and Process. John Wiley & Sons Inc. New York NY.   Hix D. and Hartson H. R. 1993. Developing User Interfaces: Ensuring Usability Through Product and Process. John Wiley & Sons Inc. New York NY."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/WETICE.2005.5"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/192844.193065"},{"key":"e_1_2_1_33_1","unstructured":"Hughes J. Sharrock W. Rodden T. O'Brien J. Rouncefield M. and Calvey D. 1994b. Field Studies and CSCW. Lancaster University Lancaster U.K.  Hughes J. Sharrock W. Rodden T. O'Brien J. Rouncefield M. and Calvey D. 1994b. Field Studies and CSCW. Lancaster University Lancaster U.K."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 48th Annual Meeting Human Factors and Ergonomics Society, 2451--2455","author":"Humphries W.","unstructured":"Humphries , W. , Neale , D. , Mccrickard , D. , and Carroll , J . 2004. Laboratory simulation methods for studying complex collaborative tasks . In Proceedings of the 48th Annual Meeting Human Factors and Ergonomics Society, 2451--2455 . Humphries, W., Neale, D., Mccrickard, D., and Carroll, J. 2004. Laboratory simulation methods for studying complex collaborative tasks. In Proceedings of the 48th Annual Meeting Human Factors and Ergonomics Society, 2451--2455."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the ACM Conference on Computer Supported Cooperative Work.","author":"Inkpen K.","unstructured":"Inkpen , K. , Mandryk , R. , Dimicco , J. , and Scott , S . 2004. Methodology for evaluating collaboration behaviour in co-located environments . In Proceedings of the ACM Conference on Computer Supported Cooperative Work. Inkpen, K., Mandryk, R., Dimicco, J., and Scott, S. 2004. Methodology for evaluating collaboration behaviour in co-located environments. In Proceedings of the ACM Conference on Computer Supported Cooperative Work."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985705"},{"key":"e_1_2_1_37_1","volume-title":"Groups: Interaction and Performance","author":"Mcgrath J.","year":"1984","unstructured":"Mcgrath , J. 1984 . Groups: Interaction and Performance . Prentice-Hall , Englewood Cliffs, NJ . Mcgrath, J. 1984. Groups: Interaction and Performance. Prentice-Hall, Englewood Cliffs, NJ."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the Conference on Computer Support For Collaborative Learning. 425--433","author":"Neale D.","unstructured":"Neale , D. and Carroll , J . 1999. Multi-faceted evaluation for complex, distributed activities . In Proceedings of the Conference on Computer Support For Collaborative Learning. 425--433 . Neale, D. and Carroll, J. 1999. Multi-faceted evaluation for complex, distributed activities. In Proceedings of the Conference on Computer Support For Collaborative Learning. 425--433."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031607.1031626"},{"key":"e_1_2_1_40_1","volume-title":"Unified Theories of Cognition","author":"Newell A.","unstructured":"Newell , A. 1990. Unified Theories of Cognition . Harvard University Press, Cambridge , MA. Newell, A. 1990. Unified Theories of Cognition. Harvard University Press, Cambridge, MA."},{"key":"e_1_2_1_41_1","volume-title":"Usability engineering at a discount","author":"Nielsen J.","unstructured":"Nielsen , J. 1989. Usability engineering at a discount . In Designing and Using Human-Computer Interfaces and Knowledge Based Systems, G. Salvendy and M. Smith, Eds., Elsevier Science Publishers , Amsterdam , 394--401. Nielsen, J. 1989. Usability engineering at a discount. In Designing and Using Human-Computer Interfaces and Knowledge Based Systems, G. Salvendy and M. Smith, Eds., Elsevier Science Publishers, Amsterdam, 394--401."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/259963.260531"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/97243.97281"},{"key":"e_1_2_1_44_1","unstructured":"Ochoa S. Pino J. Bravo G. Dujovne N. and Neyem A. 2008. Mobile shared workspaces to support construction inspection activities. In Collaborative Decision Making: Perspectives and Challenges P. Zarate J. Belaud G. Camileri and F. Ravat Eds. IOS Press Amsterdam 211--220.   Ochoa S. Pino J. Bravo G. Dujovne N. and Neyem A. 2008. Mobile shared workspaces to support construction inspection activities. In Collaborative Decision Making: Perspectives and Challenges P. Zarate J. Belaud G. Camileri and F. Ravat Eds. IOS Press Amsterdam 211--220."},{"key":"e_1_2_1_45_1","volume-title":"Tools for Thinking","author":"Pidd M.","unstructured":"Pidd , M. 1996. Tools for Thinking . J. Wiley & Sons , Chichester . Pidd, M. 1996. Tools for Thinking. J. Wiley & Sons, Chichester."},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the 9th IEEE WETICE Infrastructure for Collaborative Enterprises, 86--91","author":"Pinelle D.","unstructured":"Pinelle , D. and Gutwin , C . 2000. A review of groupware evaluations . In Proceedings of the 9th IEEE WETICE Infrastructure for Collaborative Enterprises, 86--91 . Pinelle, D. and Gutwin, C. 2000. A review of groupware evaluations. In Proceedings of the 9th IEEE WETICE Infrastructure for Collaborative Enterprises, 86--91."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/503376.503458"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-007-0145-4"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/966930.966932"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-9236(89)90007-9"},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","unstructured":"Plowman L. Rogers Y. and Ramage M. 1995. What are workplace studies for&quest; In Proceedings of the 4th European Conference on Computer-Supported Cooperative Work 309--324.   Plowman L. Rogers Y. and Ramage M. 1995. What are workplace studies for&quest; In Proceedings of the 4th European Conference on Computer-Supported Cooperative Work 309--324.","DOI":"10.1007\/978-94-011-0349-7_20"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-7373(92)90039-N"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140137408931355"},{"key":"e_1_2_1_54_1","volume-title":"The Human Contribution: Unsafe Acts, Accidents and Heroic Recoveries","author":"Reason J.","unstructured":"Reason , J. 2008. The Human Contribution: Unsafe Acts, Accidents and Heroic Recoveries . Ashgate , Surrey, UK . Reason, J. 2008. The Human Contribution: Unsafe Acts, Accidents and Heroic Recoveries. Ashgate, Surrey, UK."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/0953-5438(96)87697-1"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/142750.142869"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the Participatory Design Conference, 195--196","author":"Ruhleder K.","unstructured":"Ruhleder , K. and Jordan , B . 1998. Video-based interaction analysis (VBIA) in distributed settings: a tool for analyzing multiple-site, technology-supported interactions . In Proceedings of the Participatory Design Conference, 195--196 . Ruhleder, K. and Jordan, B. 1998. Video-based interaction analysis (VBIA) in distributed settings: a tool for analyzing multiple-site, technology-supported interactions. In Proceedings of the Participatory Design Conference, 195--196."},{"key":"e_1_2_1_58_1","volume-title":"Perspectives of Curriculum Evaluation","author":"Scriven M.","unstructured":"Scriven , M. 1967. The methodology of evaluation . In Perspectives of Curriculum Evaluation , R. Tyler, R. Gagne, and M. Scriven, Eds., Rand McNally , Chicago , 39--83. Scriven, M. 1967. The methodology of evaluation. In Perspectives of Curriculum Evaluation, R. Tyler, R. Gagne, and M. Scriven, Eds., Rand McNally, Chicago, 39--83."},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the IEEE International Workshop on Enabling Technologies, 114--119","author":"Sonnenwald D.","unstructured":"Sonnenwald , D. , Maglaughlin , K. , and Whitton , M . 2001. Using innovation diffusion theory to guide collaboration technology evaluation: work in progress . In Proceedings of the IEEE International Workshop on Enabling Technologies, 114--119 . Sonnenwald, D., Maglaughlin, K., and Whitton, M. 2001. Using innovation diffusion theory to guide collaboration technology evaluation: work in progress. In Proceedings of the IEEE International Workshop on Enabling Technologies, 114--119."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/500286.500306"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.738345"},{"key":"e_1_2_1_62_1","volume-title":"Plans and Situated Actions: The Problem of Human-Machine Communication","author":"Suchman L.","unstructured":"Suchman , L. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication . Cambridge University Press , Cambridge, U.K. Suchman, L. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, Cambridge, U.K."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-7373(91)90039-A"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/192844.193066"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the 3rd European Conference on Computer Supported Cooperative Work\u2014ECSCW 93","author":"Urquijo S.","unstructured":"Urquijo , S. , Scrivener , S. , and Palmen , H . 1993. The use of breakdown analysis in synchronous CSCW system design . In Proceedings of the 3rd European Conference on Computer Supported Cooperative Work\u2014ECSCW 93 , 289--302. Urquijo, S., Scrivener, S., and Palmen, H. 1993. The use of breakdown analysis in synchronous CSCW system design. In Proceedings of the 3rd European Conference on Computer Supported Cooperative Work\u2014ECSCW 93, 289--302."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/347642.347781"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/0001-6918(95)00065-8"},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of the 12th International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, 153--158","author":"Veld M. A. A. H. I. T.","unstructured":"Veld , M. A. A. H. I. T. , Andriessen , J. H. E. , and Verburg , R. M . 2003. E-MAGINE: The development of an evaluation method to assess groupware applications . In Proceedings of the 12th International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, 153--158 . Veld, M. A. A. H. I. T., Andriessen, J. H. E., and Verburg, R. M. 2003. E-MAGINE: The development of an evaluation method to assess groupware applications. In Proceedings of the 12th International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, 153--158."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/WETICE.2005.36"},{"key":"e_1_2_1_70_1","unstructured":"Wharton C. Rieman J. Lewis C. and Polson P. 1994. The cognitive walkthrough method: a practictioner's guide. In Usability Inspection Methods J. Nielsen and R. Mack Eds. John Wiley & Sons New York 105--140.   Wharton C. Rieman J. Lewis C. and Polson P. 1994. The cognitive walkthrough method: a practictioner's guide. In Usability Inspection Methods J. Nielsen and R. Mack Eds. John Wiley & Sons New York 105--140."},{"key":"e_1_2_1_71_1","unstructured":"Yourdon E. 1978. Structured Walkthroughs. Yourdon Inc New York.   Yourdon E. 1978. Structured Walkthroughs. Yourdon Inc New York."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2089125.2089128","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2089125.2089128","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:56:10Z","timestamp":1750254970000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2089125.2089128"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,3,5]]},"references-count":71,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2012,2]]}},"alternative-id":["10.1145\/2089125.2089128"],"URL":"https:\/\/doi.org\/10.1145\/2089125.2089128","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,3,5]]},"assertion":[{"value":"2010-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-03-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}