{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T16:20:47Z","timestamp":1759940447187,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":36,"publisher":"ACM","license":[{"start":{"date-parts":[[2015,10,17]],"date-time":"2015-10-17T00:00:00Z","timestamp":1445040000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2015,10,17]]},"DOI":"10.1145\/2806416.2806550","type":"proceedings-article","created":{"date-parts":[[2015,10,27]],"date-time":"2015-10-27T13:03:43Z","timestamp":1445951023000},"page":"143-152","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["External Knowledge and Query Strategies in Active Learning"],"prefix":"10.1145","author":[{"given":"Mahnoosh","family":"Kholghi","sequence":"first","affiliation":[{"name":"Queensland University of Technology (QUT), Brisbane, Australia"}]},{"given":"Laurianne","family":"Sitbon","sequence":"additional","affiliation":[{"name":"Queensland University of Technology (QUT), Brisbane, Australia"}]},{"given":"Guido","family":"Zuccon","sequence":"additional","affiliation":[{"name":"Queensland University of Technology (QUT), Brisbane, Australia"}]},{"given":"Anthony","family":"Nguyen","sequence":"additional","affiliation":[{"name":"The Australian e-Health Research Centre, CSIRO, Brisbane, Australia"}]}],"member":"320","published-online":{"date-parts":[[2015,10,17]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proceedings of the American Medical Informatics Association Annual Symposium, 17--21","author":"Aronson A. R.","year":"2001","unstructured":"A. R. Aronson . Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program . In Proceedings of the American Medical Informatics Association Annual Symposium, 17--21 , 2001 . A. R. Aronson. Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. In Proceedings of the American Medical Informatics Association Annual Symposium, 17--21, 2001."},{"key":"e_1_3_2_1_2_1","volume-title":"De-identifying health records by means of active learning. Recall (micro), 97(97.55), 90--97","author":"Bostr\u00f6m H.","year":"2012","unstructured":"H. Bostr\u00f6m and H. Dalianis . De-identifying health records by means of active learning. Recall (micro), 97(97.55), 90--97 , 2012 . H. Bostr\u00f6m and H. Dalianis. De-identifying health records by means of active learning. Recall (micro), 97(97.55), 90--97, 2012."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2011.11.003"},{"key":"e_1_3_2_1_4_1","volume-title":"Progress in medical information management. Journal of the American Medical Association (JAMA), 243(8), 756--762","author":"Cote R. A.","year":"1980","unstructured":"R. A. Cote and S. Robboy . Progress in medical information management. Journal of the American Medical Association (JAMA), 243(8), 756--762 , 1980 . R. A. Cote and S. Robboy. Progress in medical information management. Journal of the American Medical Association (JAMA), 243(8), 756--762, 1980."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1619410.1619452"},{"key":"e_1_3_2_1_6_1","volume-title":"Active learning for clinical text classification: is it better than random sampling? Journal of the American Medical Informatics Association (JAMIA), 19(5), 809--816","author":"Figueroa R. L.","year":"2012","unstructured":"R. L. Figueroa , Q. Zeng-Treitler , L. H. Ngo , S. Goryachev , and E. P. Wiechmann . Active learning for clinical text classification: is it better than random sampling? Journal of the American Medical Informatics Association (JAMIA), 19(5), 809--816 , 2012 . R. L. Figueroa, Q. Zeng-Treitler, L. H. Ngo, S. Goryachev, and E. P. Wiechmann. Active learning for clinical text classification: is it better than random sampling? Journal of the American Medical Informatics Association (JAMIA), 19(5), 809--816, 2012."},{"key":"e_1_3_2_1_7_1","volume-title":"Automated encoding of clinical documents based on natural language processing. Journal of the American Medical Informatics Association (JAMIA), 11(5), 392--402","author":"Friedman C.","year":"2004","unstructured":"C. Friedman , L. Shagina , Y. Lussier , and G. Hripcsak . Automated encoding of clinical documents based on natural language processing. Journal of the American Medical Informatics Association (JAMIA), 11(5), 392--402 , 2004 . C. Friedman, L. Shagina, Y. Lussier, and G. Hripcsak. Automated encoding of clinical documents based on natural language processing. Journal of the American Medical Informatics Association (JAMIA), 11(5), 392--402, 2004."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"M. Jiang Y. Chen M. Liu S. T. Rosenbloom S. Mani J. C. Denny and H. Xu. A study of machine-learning-based approaches to extract clinical entities and their assertions from discharge summaries. Journal of the American Medical Informatics Association (JAMIA) 18(5) 601--606 2011.  M. Jiang Y. Chen M. Liu S. T. Rosenbloom S. Mani J. C. Denny and H. Xu. A study of machine-learning-based approaches to extract clinical entities and their assertions from discharge summaries. Journal of the American Medical Informatics Association (JAMIA) 18(5) 601--606 2011.","DOI":"10.1136\/amiajnl-2011-000163"},{"key":"e_1_3_2_1_10_1","volume-title":"Overview of the share\/clef ehealth evaluation lab","author":"Kelly L.","year":"2014","unstructured":"L. Kelly , L. Goeuriot , H. Suominen , T. Schreck , G. Leroy , D. L. Mowery , S. Velupillai , W. W. Chapman , D. Martinez , and G. Zuccon . Overview of the share\/clef ehealth evaluation lab 2014 . In Information Access Evaluation. Multilinguality, Multimodality, and Interaction , 172--191, 2014. L. Kelly, L. Goeuriot, H. Suominen, T. Schreck, G. Leroy, D. L. Mowery, S. Velupillai, W. W. Chapman, D. Martinez, and G. Zuccon. Overview of the share\/clef ehealth evaluation lab 2014. In Information Access Evaluation. Multilinguality, Multimodality, and Interaction, 172--191, 2014."},{"key":"e_1_3_2_1_11_1","volume-title":"Journal of the American Medical Informatics Association (JAMIA)","author":"Kholghi M.","year":"2015","unstructured":"M. Kholghi , L. Sitbon , G. Zuccon , and A. Nguyen . Active learning: a step towards automating medical concept extraction . Journal of the American Medical Informatics Association (JAMIA) , 2015 {In Press}. M. Kholghi, L. Sitbon, G. Zuccon, and A. Nguyen. Active learning: a step towards automating medical concept extraction. Journal of the American Medical Informatics Association (JAMIA), 2015 {In Press}."},{"key":"e_1_3_2_1_12_1","volume-title":"Proceedings of the 12th Australasian Data Mining Conference (AusDM 2014) (Vol. 158): Conferences in Research and Practice in Information Technology","author":"Kholghi M.","year":"2014","unstructured":"M. Kholghi , L. Sitbon , G. Zuccon , and A. Nguyen . Factors influencing robustness and effectiveness of conditional random fields in active learning frameworks . In Proceedings of the 12th Australasian Data Mining Conference (AusDM 2014) (Vol. 158): Conferences in Research and Practice in Information Technology , 2014 . M. Kholghi, L. Sitbon, G. Zuccon, and A. Nguyen. Factors influencing robustness and effectiveness of conditional random fields in active learning frameworks. In Proceedings of the 12th Australasian Data Mining Conference (AusDM 2014) (Vol. 158): Conferences in Research and Practice in Information Technology, 2014."},{"key":"e_1_3_2_1_13_1","volume-title":"Pereira. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML), 282--289","author":"Lafferty J. D.","year":"2001","unstructured":"J. D. Lafferty , A. McCallum , and F. C. N. Pereira. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML), 282--289 , 2001 . J. D. Lafferty, A. McCallum, and F. C. N. Pereira. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML), 282--289, 2001."},{"key":"e_1_3_2_1_14_1","volume-title":"Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2013)","author":"Leaman R.","year":"2013","unstructured":"R. Leaman , R. Khare , and Z. Lu . NCBI at 2013 ShARe\/CLEF eHealth Shared Task: disorder normalization in clinical notes with DNorm . Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2013) , 2013 . R. Leaman, R. Khare, and Z. Lu. NCBI at 2013 ShARe\/CLEF eHealth Shared Task: disorder normalization in clinical notes with DNorm. Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2013), 2013."},{"key":"e_1_3_2_1_15_1","volume-title":"Proceedings of the 18th International Conference on Machine Learning (ICML), 148--156","author":"Lewis D. D.","year":"1994","unstructured":"D. D. Lewis and J. Catlett . Heterogenous Uncertainty Sampling for Supervised Learning . In Proceedings of the 18th International Conference on Machine Learning (ICML), 148--156 , 1994 . D. D. Lewis and J. Catlett. Heterogenous Uncertainty Sampling for Supervised Learning. In Proceedings of the 18th International Conference on Machine Learning (ICML), 148--156, 1994."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0038-1634945"},{"key":"e_1_3_2_1_17_1","unstructured":"A. K. McCallum. MALLET: A Machine Learning for Language Toolkit. http:\/\/mallet.cs.umass.edu 2002.  A. K. McCallum. MALLET: A Machine Learning for Language Toolkit. http:\/\/mallet.cs.umass.edu 2002."},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the Health Informatics Conference (HIC), 188--193","author":"Nguyen A. N.","year":"2009","unstructured":"A. N. Nguyen , M. J. Lawley , D. P. Hansen , and S. Colquist . A simple pipeline application for identifying and negating SNOMED clinical terminology in free text . In Proceedings of the Health Informatics Conference (HIC), 188--193 , 2009 . A. N. Nguyen, M. J. Lawley, D. P. Hansen, and S. Colquist. A simple pipeline application for identifying and negating SNOMED clinical terminology in free text. In Proceedings of the Health Informatics Conference (HIC), 188--193, 2009."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"L. Ohno-Machado P. Nadkarni and K. Johnson. Natural language processing: algorithms and tools to extract computable information from EHRs and from the biomedical literature. Journal of the American Medical Informatics Association (JAMIA) 20(5) 805 2013.  L. Ohno-Machado P. Nadkarni and K. Johnson. Natural language processing: algorithms and tools to extract computable information from EHRs and from the biomedical literature. Journal of the American Medical Informatics Association (JAMIA) 20(5) 805 2013.","DOI":"10.1136\/amiajnl-2013-002214"},{"key":"e_1_3_2_1_20_1","volume-title":"CLEF 2013 Evaluation Labs and Workshops: Working Notes","author":"Pradhan S.","year":"2013","unstructured":"S. Pradhan , N. Elhadad , B. South , D. Martinez , L. Christensen , A. Vogel , H. Suominen , W. W. Chapman , and G. Savova . Task 1: ShARe\/CLEF ehealth evaluation lab 2013 . CLEF 2013 Evaluation Labs and Workshops: Working Notes , 2013 . S. Pradhan, N. Elhadad, B. South, D. Martinez, L. Christensen, A. Vogel, H. Suominen, W. W. Chapman, and G. Savova. Task 1: ShARe\/CLEF ehealth evaluation lab 2013. CLEF 2013 Evaluation Labs and Workshops: Working Notes, 2013."},{"key":"e_1_3_2_1_21_1","volume-title":"Evaluating the state of the art in disorder recognition and normalization of the clinical narrative. Journal of the American Medical Informatics Association (JAMIA), 22(1), 143--154","author":"Pradhan S.","year":"2015","unstructured":"S. Pradhan , N. Elhadad , B. South , D. Martinez , L. Christensen , A. Vogel , H. Suominen , W. W. Chapman , and G. Savova . Evaluating the state of the art in disorder recognition and normalization of the clinical narrative. Journal of the American Medical Informatics Association (JAMIA), 22(1), 143--154 , 2015 . S. Pradhan, N. Elhadad, B. South, D. Martinez, L. Christensen, A. Vogel, H. Suominen, W. W. Chapman, and G. Savova. Evaluating the state of the art in disorder recognition and normalization of the clinical narrative. Journal of the American Medical Informatics Association (JAMIA), 22(1), 143--154, 2015."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2007.94"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3115\/977035.977059"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"G. K. Savova J. J. Masanz P. V. Ogren J. Zheng S. Sohn K. C. Kipper-Schuler and C. G. Chute. Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture component evaluation and applications. Journal of the American Medical Informatics Association (JAMIA) 17(5) 507--513 2010.  G. K. Savova J. J. Masanz P. V. Ogren J. Zheng S. Sohn K. C. Kipper-Schuler and C. G. Chute. Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture component evaluation and applications. Journal of the American Medical Informatics Association (JAMIA) 17(5) 507--513 2010.","DOI":"10.1136\/jamia.2009.001560"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/647967.741626"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-01560-1","volume-title":"Active learning, (Vol. 6): Morgan & Claypool Publishers","author":"Settles B.","year":"2012","unstructured":"B. Settles . Active learning, (Vol. 6): Morgan & Claypool Publishers , 2012 . B. Settles. Active learning, (Vol. 6): Morgan & Claypool Publishers, 2012."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613855"},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the NIPS Workshop on Cost-Sensitive Learning, 1--10","author":"Settles B.","year":"2008","unstructured":"B. Settles , M. Craven , and L. Friedland . Active learning with real annotation costs . In Proceedings of the NIPS Workshop on Cost-Sensitive Learning, 1--10 , 2008 . B. Settles, M. Craven, and L. Friedland. Active learning with real annotation costs. In Proceedings of the NIPS Workshop on Cost-Sensitive Learning, 1--10, 2008."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/130385.130417"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1948.tb01338.x"},{"key":"e_1_3_2_1_31_1","volume-title":"Overview of the ShARe\/CLEF eHealth Evaluation Lab","author":"Suominen H.","year":"2013","unstructured":"H. Suominen , S. Salanter\u00e4 , S. Velupillai , W. W. Chapman , G. Savova , N. Elhadad , S. Pradhan , B. South , D. Mowery , G. F. Jones , J. Leveling , L. Kelly , L. Goeuriot , D. Martinez , and G. Zuccon . Overview of the ShARe\/CLEF eHealth Evaluation Lab 2013 . In Information Access Evaluation. Multilinguality, Multimodality, and Visualization (Vol . 8138), 212--231, 2013. H. Suominen, S. Salanter\u00e4, S. Velupillai, W. W. Chapman, G. Savova, N. Elhadad, S. Pradhan, B. South, D. Mowery, G. F. Jones, J. Leveling, L. Kelly, L. Goeuriot, D. Martinez, and G. Zuccon. Overview of the ShARe\/CLEF eHealth Evaluation Lab 2013. In Information Access Evaluation. Multilinguality, Multimodality, and Visualization (Vol. 8138), 212--231, 2013."},{"key":"e_1_3_2_1_32_1","volume-title":"Identifying patient smoking status from medical discharge records. Journal of the American Medical Informatics Association (JAMIA), 15(1), 14--24","author":"Goldstein I.","year":"2008","unstructured":"\u00d6. Uzuner, I. Goldstein , Y. Luo , and I. Kohane . Identifying patient smoking status from medical discharge records. Journal of the American Medical Informatics Association (JAMIA), 15(1), 14--24 , 2008 . \u00d6. Uzuner, I. Goldstein, Y. Luo, and I. Kohane. Identifying patient smoking status from medical discharge records. Journal of the American Medical Informatics Association (JAMIA), 15(1), 14--24, 2008."},{"key":"e_1_3_2_1_33_1","volume-title":"Extracting medication information from clinical text. Journal of the American Medical Informatics Association (JAMIA), 17(5), 514--518","author":"Solti I.","year":"2010","unstructured":"\u00d6. Uzuner, I. Solti , and E. Cadag . Extracting medication information from clinical text. Journal of the American Medical Informatics Association (JAMIA), 17(5), 514--518 , 2010 . \u00d6. Uzuner, I. Solti, and E. Cadag. Extracting medication information from clinical text. Journal of the American Medical Informatics Association (JAMIA), 17(5), 514--518, 2010."},{"key":"e_1_3_2_1_34_1","volume-title":"2010 i2b2\/VA challenge on concepts, assertions, and relations in clinical text. Journal of the American Medical Informatics Association (JAMIA), 18(5), 552--556","author":"South B. R.","year":"2011","unstructured":"\u00d6. Uzuner, B. R. South , S. Shen , and S. L. DuVall . 2010 i2b2\/VA challenge on concepts, assertions, and relations in clinical text. Journal of the American Medical Informatics Association (JAMIA), 18(5), 552--556 , 2011 . \u00d6. Uzuner, B. R. South, S. Shen, and S. L. DuVall. 2010 i2b2\/VA challenge on concepts, assertions, and relations in clinical text. Journal of the American Medical Informatics Association (JAMIA), 18(5), 552--556, 2011."},{"key":"e_1_3_2_1_35_1","volume-title":"MedEx: a medication information extraction system for clinical narratives. Journal of the American Medical Informatics Association (JAMIA), 17(1), 19--24","author":"Xu H.","year":"2010","unstructured":"H. Xu , S. P. Stenner , S. Doan , K. B. Johnson , L. R. Waitman , and J. C. Denny . MedEx: a medication information extraction system for clinical narratives. Journal of the American Medical Informatics Association (JAMIA), 17(1), 19--24 , 2010 . H. Xu, S. P. Stenner, S. Doan, K. B. Johnson, L. R. Waitman, and J. C. Denny. MedEx: a medication information extraction system for clinical narratives. Journal of the American Medical Informatics Association (JAMIA), 17(1), 19--24, 2010."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11390-012-1306-0"},{"key":"e_1_3_2_1_37_1","volume-title":"Technical Report 1530: University of Wisconsin-Madison","author":"Zhu X.","year":"2007","unstructured":"X. Zhu . Semi-supervised learning literature survey. Technical Report 1530: University of Wisconsin-Madison , 2007 . X. Zhu. Semi-supervised learning literature survey. Technical Report 1530: University of Wisconsin-Madison, 2007."}],"event":{"name":"CIKM'15: 24th ACM International Conference on Information and Knowledge Management","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Melbourne Australia","acronym":"CIKM'15"},"container-title":["Proceedings of the 24th ACM International on Conference on Information and Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2806416.2806550","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2806416.2806550","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:43:43Z","timestamp":1750225423000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2806416.2806550"}},"subtitle":["a Study in Clinical Information Extraction"],"short-title":[],"issued":{"date-parts":[[2015,10,17]]},"references-count":36,"alternative-id":["10.1145\/2806416.2806550","10.1145\/2806416"],"URL":"https:\/\/doi.org\/10.1145\/2806416.2806550","relation":{},"subject":[],"published":{"date-parts":[[2015,10,17]]},"assertion":[{"value":"2015-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}