{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T17:03:12Z","timestamp":1778605392576,"version":"3.51.4"},"reference-count":83,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2016,12,7]],"date-time":"2016-12-07T00:00:00Z","timestamp":1481068800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"funder":[{"name":"Defense Advanced Research Projects Agency (US","award":["FA8750-07-D-0185\/0004"],"award-info":[{"award-number":["FA8750-07-D-0185\/0004"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Knowl Inf Syst"],"published-print":{"date-parts":[[2017,8]]},"DOI":"10.1007\/s10115-016-1011-3","type":"journal-article","created":{"date-parts":[[2016,12,7]],"date-time":"2016-12-07T07:49:56Z","timestamp":1481096996000},"page":"379-409","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Evaluating intelligent knowledge systems: experiences with a user-adaptive assistant agent"],"prefix":"10.1007","volume":"52","author":[{"given":"Pauline M.","family":"Berry","sequence":"first","affiliation":[]},{"given":"Thierry","family":"Donneau-Golencer","sequence":"additional","affiliation":[]},{"given":"Khang","family":"Duong","sequence":"additional","affiliation":[]},{"given":"Melinda","family":"Gervasio","sequence":"additional","affiliation":[]},{"given":"Bart","family":"Peintner","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1814-3515","authenticated-orcid":false,"given":"Neil","family":"Yorke-Smith","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2016,12,7]]},"reference":[{"key":"1011_CR1","unstructured":"Ackerman S (2011) The iPhone 4S\u2019 talking assistant is a military veteran. Wired, 2011. www.wired.com\/2011\/10\/siri-darpa-iphone\/ . Retrieved 26 Jan 2015"},{"key":"1011_CR2","unstructured":"Ambite JL, Barish G, Knoblock CA, Muslea M, Oh J, Minton S (2002) Getting from here to there: Interactive planning and agent execution for optimizing travel. In: Proceedings of fourteenth conference on innovative applications of artificial intelligence (IAAI\u201902), pp 862\u2013869"},{"key":"1011_CR3","unstructured":"Ambite J-L, Chaudhri VK, Fikes R, Jenkins J, Mishra S, Muslea M, Uribe T, Yang G (2006) Design and implementation of the CALO Query Manager. In: Proceedings of eighteenth conference on innovative applications of artificial intelligence (IAAI\u201906), pp 1751\u20131758"},{"issue":"3","key":"1011_CR4","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1017\/S0269888998003038","volume":"13","author":"R Aylett","year":"1998","unstructured":"Aylett R, Brazier F, Jennings N, Luck M, Nwana H, Preist C (1998) Agent systems and applications. Knowl Eng Rev 13(3):303\u2013308","journal-title":"Knowl Eng Rev"},{"key":"1011_CR5","doi-asserted-by":"crossref","unstructured":"Azvine B, Djian D, Tsui KC, Wobcke W (2000) The intelligent assistant: an overview. In: Intelligent systems and soft computing: prospects, tools and applications. Lecture notes in computer science, vol 1804. Springer, New York, NY, pp 215\u2013238","DOI":"10.1007\/10720181_9"},{"key":"1011_CR6","doi-asserted-by":"crossref","unstructured":"Bank J, Cain Z, Shoham Y, Suen C, Ariely D (2012) Turning personal calendars into scheduling assistants. In: Extended abstracts of twenty-fourth conference on human factors in computing systems (CHI\u201912)","DOI":"10.1145\/2212776.2223854"},{"key":"1011_CR7","unstructured":"Berry PM, Gervasio M, Peintner B, Yorke-Smith N (2007) Balancing the needs of personalization and reasoning in a user-centric scheduling assistant. Technical note 561, AI Center, SRI International"},{"key":"1011_CR8","unstructured":"Berry PM, Donneau-Golencer T, Duong K, Gervasio MT, Peintner B, Yorke-Smith N (2009a) Evaluating user-adaptive systems: lessons from experiences with a personalized meeting scheduling assistant. In: Proceedings of twenty-first conf. on innovative applications of artificial intelligence (IAAI\u201909), pp 40\u201346"},{"key":"1011_CR9","unstructured":"Berry PM, Donneau-Golencer T, Duong K, Gervasio MT, Peintner B, Yorke-Smith N (2009b) Mixed-initiative negotiation: facilitating useful interaction between agent\/owner pairs. In: Proceedings of AAMAS\u201909 workshop on mixed-initiative multiagent systems, pp 8\u201318"},{"issue":"4","key":"1011_CR10","doi-asserted-by":"crossref","first-page":"40:1","DOI":"10.1145\/1989734.1989744","volume":"2","author":"PM Berry","year":"2011","unstructured":"Berry PM, Gervasio M, Peintner B, Yorke-Smith N (2011) PTIME: personalized assistance for calendaring. ACM Trans Intell Syst Technol 2(4):40:1\u201340:22","journal-title":"ACM Trans Intell Syst Technol"},{"key":"1011_CR11","unstructured":"Bosker B (2013a) Tempo smart calendar app boasts Siri pedigree and a calendar that thinks for itself. The Huffington Post. www.huffingtonpost.com\/2013\/02\/13\/tempo-smart-calendar-app_n_2677927.html . Retrieved 30 June 2016"},{"key":"1011_CR12","unstructured":"Bosker B (2013b) SIRI RISING: the inside story of Siri\u2019s origins\u2014and why she could overshadow the iPhone. The Huffington Post. www.huffingtonpost.com\/2013\/01\/22\/siri-do-engine-apple-iphone_n_2499165.html . Retrieved 10 June 2013"},{"issue":"5","key":"1011_CR13","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1142\/S0218213011000310","volume":"20","author":"T Bosse","year":"2011","unstructured":"Bosse T, Memon ZA, Oorburg R, Treur J, Umair M, de Vos M (2011) A software environment for an adaptive human-aware software agent supporting attention-demanding tasks. Int J Artif Intell Tools 20(5):819\u2013846","journal-title":"Int J Artif Intell Tools"},{"issue":"4\u20135","key":"1011_CR14","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1504\/IJCEELL.2004.005729","volume":"14","author":"P Brusilovsky","year":"2004","unstructured":"Brusilovsky P, Karagiannidis C, Sampson D (2004) Layered evaluation of adaptive learning systems. Int J Contin Eng Educ Lifelong Learn 14(4\u20135):402\u2013421","journal-title":"Int J Contin Eng Educ Lifelong Learn"},{"issue":"1\u20132","key":"1011_CR15","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1023\/A:1011143116306","volume":"11","author":"P Brusilowsky","year":"2001","unstructured":"Brusilowsky P (2001) Adaptive hypermedia. User Modell User Adapt Interact 11(1\u20132):87\u2013110","journal-title":"User Modell User Adapt Interact"},{"key":"1011_CR16","doi-asserted-by":"crossref","unstructured":"Brzozowski M, Carattini K, Klemmer SR, Mihelich P, Hu J, Ng AY (2006) groupTime: preference-based group scheduling. In: Proceedings of eighteenth conference on human factors in computing systems (CHI\u201906), pp 1047\u20131056","DOI":"10.1145\/1124772.1124929"},{"key":"1011_CR17","unstructured":"Campbell M (2009) Talking paperclip inspires less irksome virtual assistant. New Scientist, 29 July 2009"},{"key":"1011_CR18","volume-title":"Interfacing thought: cognitive aspects of human-computer interaction","author":"JM Carroll","year":"1987","unstructured":"Carroll JM, Rosson MB (1987) Interfacing thought: cognitive aspects of human-computer interaction. MIT Press, Cambridge"},{"issue":"2","key":"1011_CR19","first-page":"11","volume":"23","author":"H Chalupsky","year":"2002","unstructured":"Chalupsky H, Gil Y, Knoblock CA, Lerman K, Oh J, Pynadath DV, Russ TA, Tambe M (2002) Electric elves: agent technology for supporting human organizations. AI Mag 23(2):11\u201324","journal-title":"AI Mag"},{"key":"1011_CR20","unstructured":"Cheyer A, Park J, Giuli R (2005) IRIS: integrate, relate, infer, share. In: Proceedings of 4th international semantic web conference on workshop on the semantic desktop, p\u00a015"},{"issue":"3","key":"1011_CR21","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1177\/1098214010369170","volume":"31","author":"CA Christie","year":"2010","unstructured":"Christie CA, Fleischer DN (2010) Insight into evaluation practice: a content analysis of designs and methods used in evaluation studies published in North American evaluation-focused journals. Am J Eval 31(3):326\u2013346","journal-title":"Am J Eval"},{"key":"1011_CR22","volume-title":"Empirical methods for artificial intelligence","author":"P Cohen","year":"1995","unstructured":"Cohen P (1995) Empirical methods for artificial intelligence. MIT Press, Cambridge"},{"issue":"3","key":"1011_CR23","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1109\/21.31069","volume":"19","author":"P Cohen","year":"1989","unstructured":"Cohen P, Howe AE (1989) Toward AI research methodology: three case studies in evaluation. IEEE Trans Syst Man Cybern 19(3):634\u2013646","journal-title":"IEEE Trans Syst Man Cybern"},{"issue":"4","key":"1011_CR24","first-page":"35","volume":"9","author":"PR Cohen","year":"1988","unstructured":"Cohen PR, Howe AE (1988) How evaluation guides AI research: the message still counts more than the medium. AI Mag 9(4):35\u201343","journal-title":"AI Mag"},{"key":"1011_CR25","first-page":"197","volume-title":"Readings in agents","author":"PR Cohen","year":"1994","unstructured":"Cohen PR, Cheyer AJ, Wang M, Baeg SC (1994) An open agent architecture. In: Huhns MN, Singh MP (eds) Readings in agents. Morgan Kaufmann, San Francisco, pp 197\u2013204"},{"issue":"5","key":"1011_CR26","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1007\/s11257-008-9051-3","volume":"18","author":"H Cramer","year":"2008","unstructured":"Cramer H, Evers V, Ramlal S, Someren M, Rutledge L, Stash N, Aroyo L, Wielinga B (2008) The effects of transparency on trust in and acceptance of a content-based art recommender. User Model User Adap Int 18(5):455\u2013496","journal-title":"User Model User Adap Int"},{"key":"1011_CR27","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1287\/mnsc.35.8.982","volume":"35","author":"FD Davis","year":"1989","unstructured":"Davis FD, Bagozzi RP, Warshaw PR (1989) User acceptance of computer technology: a comparison of two theoretical models. Manag Sci 35:982\u20131003","journal-title":"Manag Sci"},{"key":"1011_CR28","doi-asserted-by":"crossref","unstructured":"Deans B, Keifer K, Nitz K et al (2009) SKIPAL phase 2 final technical report. Technical report 1981, SPAWAR Systems Center Pacific, San Diego","DOI":"10.21236\/ADA513645"},{"key":"1011_CR29","volume-title":"Interacting with adaptive systemsInteractive collaborative information systems, volume 281 of studies in computational intelligence","author":"V Evers","year":"2010","unstructured":"Evers V, Cramer H, Someren M, Wielinga B (2010) Interacting with adaptive systemsInteractive collaborative information systems, volume 281 of studies in computational intelligence. Springer, Heidelberg"},{"key":"1011_CR30","unstructured":"Freed M, Carbonell J, Gordon G, Hayes J, Myers B, Siewiorek D, Smith S, Steinfeld A, Tomasic A (2008) RADAR: a personal assistant that learns to reduce email overload. In: Proceedings of twenty-third AAAI conference on artificial intelligence (AAAI\u201908), pp 1287\u20131293"},{"issue":"1","key":"1011_CR31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/S0269888905000299","volume":"20","author":"C Gena","year":"2005","unstructured":"Gena C (2005) Methods and techniques for the evaluation of user-adaptive systems. Knowl Eng Rev 20(1):1\u201337","journal-title":"Knowl Eng Rev"},{"issue":"3","key":"1011_CR32","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1016\/0377-2217(95)00176-X","volume":"89","author":"M Grabisch","year":"1996","unstructured":"Grabisch M (1996) The application of fuzzy integrals in multicriteria decision making. Eur J Oper Res 89(3):445\u2013456","journal-title":"Eur J Oper Res"},{"issue":"3","key":"1011_CR33","doi-asserted-by":"crossref","first-page":"73","DOI":"10.5465\/AMP.2010.52842952","volume":"24","author":"ME Graebner","year":"2010","unstructured":"Graebner ME, Eisenhardt KM, Roundy PT (2010) Success and failure in technology acquisitions: lessons for buyers and sellers. Acad Manag Perspect 24(3):73\u201392","journal-title":"Acad Manag Perspect"},{"key":"1011_CR34","doi-asserted-by":"crossref","unstructured":"Greenberg S, Buxton B (2008) Usability evaluation considered harmful (some of the time). In: Proceedings of twentieth conference on human factors in computing systems (CHI\u201908), pp 111\u2013120","DOI":"10.1145\/1357054.1357074"},{"issue":"1","key":"1011_CR35","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1007\/s40593-015-0043-2","volume":"26","author":"J Greer","year":"2016","unstructured":"Greer J, Mark M (2016) Evaluation methods for intelligent tutoring systems revisited. Int J Artif Intell Educ 26(1):387\u2013392","journal-title":"Int J Artif Intell Educ"},{"key":"1011_CR36","doi-asserted-by":"crossref","unstructured":"Grudin J, Palen L (1995) Why groupware succeeds: discretion or mandate? In: Proceedings of 4th European conference on computer-supported cooperative work (ECSCW\u201995), pp 263\u2013278","DOI":"10.1007\/978-94-011-0349-7_17"},{"key":"1011_CR37","doi-asserted-by":"crossref","unstructured":"Hall J, Zeleznikow J (2001) Acknowledging insufficiency in the evaluation of legal knowledge-based systems: Strategies towards a broad based evaluation model. In: Proceedings of 8th international conference on artificial intelligence and law (ICAIL\u201901), pp 147\u2013156","DOI":"10.1145\/383535.383553"},{"key":"1011_CR38","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1080\/07421222.2002.11045716","volume":"19","author":"LM Hitt","year":"2002","unstructured":"Hitt LM, Wu DJ, Zhou X (2002) ERP investment: business impact and productivity measures. J Manag Inf Syst 19:71\u201398","journal-title":"J Manag Inf Syst"},{"issue":"4","key":"1011_CR39","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1016\/S0953-5438(99)00006-5","volume":"12","author":"K H\u00f6\u00f6k","year":"2000","unstructured":"H\u00f6\u00f6k K (2000) Steps to take before intelligent user interfaces become real. Interact Comput 12(4):409\u2013426","journal-title":"Interact Comput"},{"key":"1011_CR40","unstructured":"Horvitz E, Breese J, Heckerman D, Hovel D, Rommelse K (1998) The Lumi\u00e8re project: Bayesian user modeling for inferring the goals and needs of software users. In: Proceedings of 14th conference on uncertainty in artificial intelligence (UAI\u201998), pp 256\u2013266"},{"issue":"4","key":"1011_CR41","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1609\/aimag.v30i4.2274","volume":"30","author":"AD Jameson","year":"2009","unstructured":"Jameson AD (2009) Understanding and dealing with usability side effects of intelligent processing. AI Mag 30(4):23\u201340","journal-title":"AI Mag"},{"key":"1011_CR42","doi-asserted-by":"crossref","unstructured":"Joachims T (2002) Optimizing search engines using clickthrough data. In: Proceedings of 22nd ACM conference on knowledge discovery and data mining (KDD\u201902), pp 133\u2013142","DOI":"10.1145\/775047.775067"},{"issue":"1","key":"1011_CR43","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1007\/s10115-015-0848-1","volume":"47","author":"\u00d6 Kafali","year":"2016","unstructured":"Kafali \u00d6, Yolum P (2016) PISAGOR: a proactive software agent for monitoring interactions. Knowl Inf Syst 47(1):215\u2013239","journal-title":"Knowl Inf Syst"},{"key":"1011_CR44","unstructured":"Kahney L (2010) MS Office helper not dead yet. Wired, 19 April 2001. www.wired.com\/science\/discoveries\/news\/2001\/04\/43065?currentPage=all . Retrieved 8 Oct 2010"},{"issue":"1\u20132","key":"1011_CR45","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1080\/10447310709336953","volume":"22","author":"J Kjeldskov","year":"2007","unstructured":"Kjeldskov J, Skov MB (2007) Studying usability in sitro: simulating real world phenomena in controlled environments. Int J Hum Comput Interact 22(1\u20132):7\u201336","journal-title":"Int J Hum Comput Interact"},{"key":"1011_CR46","doi-asserted-by":"crossref","unstructured":"Klimt B, Yang Y (2004) The Enron corpus: a new dataset for email classification research. In: Proceedings of 15th European conference on machine learning (ECML\u201904), number 3201 in lecture notes in computer science. Springer, pp 217\u2013226","DOI":"10.1007\/978-3-540-30115-8_22"},{"key":"1011_CR47","unstructured":"Knoblock CA (2006) Beyond the elves: making intelligent agents intelligent. In: Proceedings of AAAI 2006 spring symposium on what went wrong and why: lessons from AI research and applications, p 40"},{"key":"1011_CR48","unstructured":"Kokalitcheva K (2015) Salesforce acquires \u201csmart\u201d calendar app Tempo, which is shutting down. Fortune. www.fortune.com\/2015\/05\/29\/salesforces-acquires-tempo\/ . Retrieved 30 June 2016"},{"key":"1011_CR49","doi-asserted-by":"crossref","unstructured":"Kozierok R, Maes P (1993) A learning interface agent for scheduling meetings. In: Proceedings of international workshop on intelligent user interfaces (IUI\u201993), pp 81\u201388","DOI":"10.1145\/169891.169908"},{"key":"1011_CR50","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1007\/978-3-540-79355-7_7","volume-title":"New challenges in applied intelligence technologies","author":"A Krzywicki","year":"2008","unstructured":"Krzywicki A, Wobcke W (2008) Closed pattern mining for the discovery of user preferences in a calendar assistant. In: Nguyen NT, Katarzyniak R (eds) New challenges in applied intelligence technologies. Springer, New York, pp 67\u201376"},{"key":"1011_CR51","doi-asserted-by":"crossref","unstructured":"Langley P (1999) User modeling in adaptive interfaces. In: Proceedings of 7th international conference on user modeling (UM\u201999), pp 357\u2013370","DOI":"10.1007\/978-3-7091-2490-1_48"},{"key":"1011_CR52","volume-title":"Research methods in human\u2013computer interaction","author":"J Lazar","year":"2010","unstructured":"Lazar J, Feng JH, Hockheiser H (2010) Research methods in human\u2013computer interaction. Wiley, Chichester"},{"issue":"7","key":"1011_CR53","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1145\/176789.176792","volume":"37","author":"P Maes","year":"1994","unstructured":"Maes P (1994) Agents that reduce work and information overload. J ACM 37(7):30\u201340","journal-title":"J ACM"},{"key":"1011_CR54","volume-title":"The fifth generation: artificial intelligence and Japan\u2019s computer challenge to the world","author":"P McCorduck","year":"1983","unstructured":"McCorduck P, Feigenbaum EA (1983) The fifth generation: artificial intelligence and Japan\u2019s computer challenge to the world. Addison Wesley, Boston"},{"issue":"7","key":"1011_CR55","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1145\/176789.176798","volume":"37","author":"T Mitchell","year":"1994","unstructured":"Mitchell T, Caruana R, Freitag D, McDermott J, Zabowski D (1994) Experience with a learning personal assistant. Commun ACM 37(7):80\u201391","journal-title":"Commun ACM"},{"key":"1011_CR56","unstructured":"Modi PJ, Veloso MM, Smith SF, Oh J (2004) CMRadar: a personal assistant agent for calendar management. In: Proceedings of agent-oriented information systems workshop (AOIS\u201904), pp 169\u2013181"},{"key":"1011_CR57","unstructured":"Moffitt MD, Peintner B, Yorke-Smith N (2006) Multi-criteria optimization of temporal preferences. In: Proceedings of CP\u201906 workshop on preferences and soft constraints, pp 79\u201393"},{"issue":"2","key":"1011_CR58","first-page":"47","volume":"28","author":"KL Myers","year":"2007","unstructured":"Myers KL, Berry PM, Blythe J, Conley K, Gervasio M, McGuinness D, Morley D, Pfeffer A, Pollack M, Tambe M (2007) An intelligent personal assistant for task and time management. AI Mag 28(2):47\u201361","journal-title":"AI Mag"},{"issue":"4","key":"1011_CR59","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1145\/175276.175282","volume":"37","author":"J Nielsen","year":"1994","unstructured":"Nielsen J, Levy J (1994) Measuring usability: preference vs. performance. Commun ACM 37(4):66\u201375","journal-title":"Commun ACM"},{"issue":"7","key":"1011_CR60","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1145\/176789.176796","volume":"37","author":"DA Norman","year":"1994","unstructured":"Norman DA (1994) How might people interact with agents. Commun ACM 37(7):68\u201371","journal-title":"Commun ACM"},{"key":"1011_CR61","unstructured":"Oh J, Smith SF (2004) Learning user preferences in distributed calendar scheduling. In: Proceedings of 5th international conference on practice and theory of automated timetabling (PATAT\u201904), pp 3\u201316"},{"issue":"3","key":"1011_CR62","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1006\/ijhc.1994.1021","volume":"40","author":"R Oppermann","year":"1994","unstructured":"Oppermann R (1994) Adaptively supported adaptivity. Int J Hum Comput Stud 40(3):455\u2013472","journal-title":"Int J Hum Comput Stud"},{"key":"1011_CR63","doi-asserted-by":"crossref","unstructured":"Palen L (1999) Social, individual and technological issues for groupware calendar systems. In: Proceedings of eleventh conference on human factors in computing systems (CHI\u201999), pp 17\u201324","DOI":"10.1145\/302979.302982"},{"issue":"5","key":"1011_CR64","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1007\/s11257-010-9082-4","volume":"20","author":"A Paramythis","year":"2010","unstructured":"Paramythis A, Weibelzahl S, Masthoff J (2010) Layered evaluation of interactive adaptive systems: framework and formative methods. User Model User Adap Interact 20(5):383\u2013453","journal-title":"User Model User Adap Interact"},{"key":"1011_CR65","unstructured":"Peintner B, Dinger J, Rodriguez A, Myers K (2009) Task assistant: personalized task management for military environments. In: Proceedings of twenty-first conference on innovative applications of artificialintelligence (IAAI\u201909), pp 128\u2013134"},{"issue":"1","key":"1011_CR66","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1111\/j.1467-8640.2010.00371.x","volume":"27","author":"I Refanidis","year":"2011","unstructured":"Refanidis I, Alexiadis A (2011) Deployment and evaluation of Selfplanner, an automated individual task management system. Comput Intell 27(1):41\u201359","journal-title":"Comput Intell"},{"issue":"2","key":"1011_CR67","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1145\/1869397.1869401","volume":"1","author":"I Refanidis","year":"2010","unstructured":"Refanidis I, Yorke-Smith N (2010) A constraint-based approach to scheduling an individual\u2019s activities. ACM Trans Intell Syst Technol 1(2):121\u20131232","journal-title":"ACM Trans Intell Syst Technol"},{"key":"1011_CR68","unstructured":"Rychtyckyj N, Turski A (2008) Reasons for success (and failure) in the development and deployment of AI systems. In: Proceedings of AAAI\u201908 workshop on what went wrong and why: lessons from AI research and applications, pp 25\u201331"},{"key":"1011_CR69","doi-asserted-by":"crossref","unstructured":"Schaub F, K\u00f6nings B, Lang P, Wiedersheim B, Winkler C, Weber M (2014) PriCal: context-adaptive privacy in ambient calendar displays. In: Proc. of sixteeth international conference on pervasive and ubiquitous computing (UbiComp\u201914), pp 499\u2013510","DOI":"10.1145\/2632048.2632087"},{"issue":"4","key":"1011_CR70","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1007\/s00779-013-0695-6","volume":"18","author":"EM Shakshuki","year":"2014","unstructured":"Shakshuki EM, Hossain SM (2014) A personal meeting scheduling agent. Pers Ubiquit Comput 18(4):909\u2013922","journal-title":"Pers Ubiquit Comput"},{"key":"1011_CR71","doi-asserted-by":"crossref","unstructured":"Shen J, Li L, Dietterich TG, Herlocker JL (2006) A hybrid learning system for recognizing user tasks from desktop activities and email messages. In: Proceedings of eighteenth international conference on intelligent user interfaces (IUI\u201906), pp 86\u201392","DOI":"10.1145\/1111449.1111473"},{"key":"1011_CR72","unstructured":"SRI International (2013) CALO: cognitive assistant that learns and organizes. https:\/\/pal.sri.com . Retrieved 10 June 2013"},{"key":"1011_CR73","doi-asserted-by":"crossref","unstructured":"Steinfeld A, Bennett R, Cunningham K et al (2006) The RADAR test methodology: evaluating a multi-task machine learning system with humans in the loop. Report CMU-CS-06-125, Carnegie Mellon University","DOI":"10.21236\/ADA457300"},{"key":"1011_CR74","doi-asserted-by":"crossref","unstructured":"Steinfeld A, Bennett R, Cunningham K, et al. (2007a) Evaluation of an integrated multi-task machine learning system with humans in the loop. In: Proceedings of 7th NIST workshop on performance metrics for intelligent systems (PerMIS\u201907), pp 182\u2013188","DOI":"10.1145\/1660877.1660901"},{"key":"1011_CR75","doi-asserted-by":"crossref","unstructured":"Steinfeld A, Quinones P-A, Zimmerman J, Bennett SR, Siewiorek D (2007b) Survey measures for evaluation of cognitive assistants. In: Proceedins of 7th NIST workshop on performance metrics for intelligent systems (PerMIS\u201907), pp 189\u2013193","DOI":"10.1145\/1660877.1660902"},{"issue":"8","key":"1011_CR76","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1016\/j.ijhcs.2009.03.004","volume":"67","author":"S Stumpf","year":"2009","unstructured":"Stumpf S, Rajaram V, Li L, Wong W-K, Burnett M, Dietterich T, Sullivan E, Herlocker J (2009) Interacting meaningfully with machine learning systems: three experiments. Int J Hum Comput Stud 67(8):639\u2013662","journal-title":"Int J Hum Comput Stud"},{"key":"1011_CR77","unstructured":"Tambe M, Bowring E, Pearce JP, Varakantham P, Scerri P, Pynadath DV (2006) Electric Elves: what went wrong and why. In: Proceedings of AAAI 2006 spring symposium on what went wrong and why: lessons from AI research and applications, pp 34\u201339"},{"issue":"3","key":"1011_CR78","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1017\/S0269888908001379","volume":"23","author":"L Velsen Van","year":"2008","unstructured":"Van Velsen L, Van Der Geest T, Klaassen R, Steehouder M (2008) User-centered evaluation of adaptive and adaptable systems: a literature review. Knowl Eng Rev 23(3):261\u2013281","journal-title":"Knowl Eng Rev"},{"key":"1011_CR79","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1613\/jair.2075","volume":"27","author":"P Viappiani","year":"2006","unstructured":"Viappiani P, Faltings B, Pu P (2006) Preference-based search using example-critiquing with suggestions. J Artif Intell Res 27:465\u2013503","journal-title":"J Artif Intell Res"},{"key":"1011_CR80","volume-title":"SmartKom: foundations of multimodal dialogue systems. Cognitive technologies","year":"2006","unstructured":"Wahlster W (ed) (2006) SmartKom: foundations of multimodal dialogue systems. Cognitive technologies. Springer, New York"},{"key":"1011_CR81","unstructured":"Weber J, Yorke-Smith N (2008) Time management with adaptive reminders: two studies and their design implications. In: Working Notes of CHI\u201908 workshop: usable artificial intelligence, pp 5\u20138"},{"key":"1011_CR82","unstructured":"Wobcke W, Nguyen A, Ho VH, Krzywicki A (2007) The smart personal assistant: an overview. In: Proceedings of the AAAI spring symposium on interaction challenges for intelligent assistants, pp 135\u2013136"},{"issue":"1","key":"1011_CR83","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1142\/S0218213012500042","volume":"21","author":"N Yorke-Smith","year":"2012","unstructured":"Yorke-Smith N, Saadati S, Myers KL, Morley DN (2012) The design of a proactive personal agent for task management. Int J Artif Intell Tools 21(1):90\u2013119","journal-title":"Int J Artif Intell Tools"}],"container-title":["Knowledge and Information Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10115-016-1011-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10115-016-1011-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10115-016-1011-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,9,16]],"date-time":"2019-09-16T05:05:10Z","timestamp":1568610310000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10115-016-1011-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,12,7]]},"references-count":83,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2017,8]]}},"alternative-id":["1011"],"URL":"https:\/\/doi.org\/10.1007\/s10115-016-1011-3","relation":{},"ISSN":["0219-1377","0219-3116"],"issn-type":[{"value":"0219-1377","type":"print"},{"value":"0219-3116","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,12,7]]}}}