{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T21:56:35Z","timestamp":1775080595351,"version":"3.50.1"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,1,31]],"date-time":"2018-01-31T00:00:00Z","timestamp":1517356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CCF-0937133, IIS-1447416, DGE-1545362, IIS-1633363"],"award-info":[{"award-number":["CCF-0937133, IIS-1447416, DGE-1545362, IIS-1633363"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2018,2,28]]},"abstract":"<jats:p>Modern visual analytic tools promote human-in-the-loop analysis but are limited in their ability to direct the user toward interesting and promising directions of study. This problem is especially acute when the analysis task is exploratory in nature, e.g., the discovery of potentially coordinated relationships in massive text datasets. Such tasks are very common in domains like intelligence analysis and security forensics where the goal is to uncover surprising coalitions bridging multiple types of relations. We introduce new maximum entropy models to discover surprising chains of relationships leveraging count data about entity occurrences in documents. These models are embedded in a visual analytic system called MERCER (Maximum Entropy Relational Chain ExploRer) that treats relationship bundles as first class objects and directs the user toward promising lines of inquiry. We demonstrate how user input can judiciously direct analysis toward valid conclusions, whereas a purely algorithmic approach could be led astray. Experimental results on both synthetic and real datasets from the intelligence community are presented.<\/jats:p>","DOI":"10.1145\/3047017","type":"journal-article","created":{"date-parts":[[2018,2,1]],"date-time":"2018-02-01T13:10:52Z","timestamp":1517490652000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Interactive Discovery of Coordinated Relationship Chains with Maximum Entropy Models"],"prefix":"10.1145","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4392-1307","authenticated-orcid":false,"given":"Hao","family":"Wu","sequence":"first","affiliation":[{"name":"Virginia Tech, Arlington, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maoyuan","family":"Sun","sequence":"additional","affiliation":[{"name":"University of Massachusetts Dartmouth, Dartmouth, MA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peng","family":"Mi","sequence":"additional","affiliation":[{"name":"Virginia Tech"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nikolaj","family":"Tatti","sequence":"additional","affiliation":[{"name":"Aalto University, Aalto, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris","family":"North","sequence":"additional","affiliation":[{"name":"Virginia Tech, Blacksburg, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Naren","family":"Ramakrishnan","sequence":"additional","affiliation":[{"name":"Virginia Tech, Arlington, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,1,31]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btl099"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the. International Conference on Intelligent Systems for Molecular Biology. 75--85","author":"Califano Andrea","year":"2000","unstructured":"Andrea Califano , Gustavo Stolovitzky , and Yuhai Tu . 2000 . Analysis of gene expression microarrays for phenotype classification . In Proceedings of the. International Conference on Intelligent Systems for Molecular Biology. 75--85 . Andrea Califano, Gustavo Stolovitzky, and Yuhai Tu. 2000. Analysis of gene expression microarrays for phenotype classification. In Proceedings of the. International Conference on Intelligent Systems for Molecular Biology. 75--85."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-012-0284-8"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1497577.1497580"},{"key":"e_1_2_1_5_1","volume-title":"Church","author":"Cheng Yizong","year":"2000","unstructured":"Yizong Cheng and George M . Church . 2000 . Biclustering of expression data. In Proceedings of the 8th International Conference on Intelligent Systems for Molecular Biology. AAAI Press , 93--103. Yizong Cheng and George M. Church. 2000. Biclustering of expression data. In Proceedings of the 8th International Conference on Intelligent Systems for Molecular Biology. AAAI Press, 93--103."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1214\/aop\/1176996454"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177692379"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972795.45"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020497"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-010-0209-3"},{"key":"e_1_2_1_11_1","volume-title":"Discovery of relational association rules","author":"Dehaspe Luc","unstructured":"Luc Dehaspe and Hannu Toironen . 2000. Discovery of relational association rules . In Relational Data Mining, Sa\u0115so D\u0115zeroski (Ed.). Springer-Verlag , New York, NY , 189--208. Luc Dehaspe and Hannu Toironen. 2000. Discovery of relational association rules. In Relational Data Mining, Sa\u0115so D\u0115zeroski (Ed.). Springer-Verlag, New York, NY, 189--208."},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"S. Dzeroski and N. Lavrac. 2001. Relational Data Mining. Springer Berlin Germany.   S. Dzeroski and N. Lavrac. 2001. Relational Data Mining. Springer Berlin Germany.","DOI":"10.1007\/978-3-662-04599-2"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2013.269"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30214-8_22"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1297332.1297338"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1186\/1756-0500-2-124"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1186\/1748-7188-1-15"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1557019.1557065"},{"key":"e_1_2_1_19_1","volume-title":"Advances in Visual Computing","author":"Heinrich Julian","unstructured":"Julian Heinrich , Robert Seifert , Michael Burch , and Daniel Weiskopf . 2011. BiCluster viewer: A visualization tool for analyzing gene expression data . In Advances in Visual Computing . Springer , 641--652. Julian Heinrich, Robert Seifert, Michael Burch, and Daniel Weiskopf. 2011. BiCluster viewer: A visualization tool for analyzing gene expression data. In Advances in Visual Computing. Springer, 641--652."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0029509"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339742"},{"key":"e_1_2_1_22_1","unstructured":"F. Hughes and D. Schum. 2003. Discovery-Proof-Choice the Art and Science of the Process of Intelligence Analysis-Preparing for the Future of Intelligence Analysis. Joint Military Intelligence College Washington DC.  F. Hughes and D. Schum. 2003. Discovery-Proof-Choice the Art and Science of the Process of Intelligence Analysis-Preparing for the Future of Intelligence Analysis. Joint Military Intelligence College Washington DC."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRev.106.620"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1342320.1342322"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the IEEE Symposium on Visual Analytics Science and Technology (VAST\u201909)","author":"Gorg C.","year":"2009","unstructured":"Youn-ah Kang, C. Gorg , and John Stasko . 2009 . Evaluating visual analytics systems for investigative analysis: Deriving design principles from a case study . In Proceedings of the IEEE Symposium on Visual Analytics Science and Technology (VAST\u201909) . IEEE, 139--146. Youn-ah Kang, C. Gorg, and John Stasko. 2009. Evaluating visual analytics systems for investigative analysis: Deriving design principles from a case study. In Proceedings of the IEEE Symposium on Visual Analytics Science and Technology (VAST\u201909). IEEE, 139--146."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkh470"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401943"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2011.98"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34156-4_16"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40991-2_17"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150475"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01700.x"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/383779.383781"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCBB.2004.2"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2382577.2382580"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972801.79"},{"key":"e_1_2_1_37_1","unstructured":"G. Rasch. 1960. Probabilistic Models for Some Intelligence and Attainnment Tests. Danmarks paedagogiske Institut.  G. Rasch. 1960. Probabilistic Models for Some Intelligence and Attainnment Tests. Danmarks paedagogiske Institut."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btu120"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/17.suppl_1.S243"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2086737.2086744"},{"key":"e_1_2_1_41_1","volume-title":"Introduction to Machine Learning: Class Notes 67577. Retrieved","author":"Shashua Amnon","year":"2015","unstructured":"Amnon Shashua . 2008. Introduction to Machine Learning: Class Notes 67577. Retrieved October 2015 from http:\/\/arxiv.org\/pdf\/0904.3664.pdf. Amnon Shashua. 2008. Introduction to Machine Learning: Class Notes 67577. Retrieved October 2015 from http:\/\/arxiv.org\/pdf\/0904.3664.pdf."},{"key":"e_1_2_1_42_1","volume-title":"Suppl. 2","author":"Sheng Qizheng","year":"2003","unstructured":"Qizheng Sheng , Yves Moreau , and Bart De Moor . 2003. Biclustering microarray data by Gibbs sampling. Bioinformatics 19 , Suppl. 2 ( 2003 ), ii196--ii205. Qizheng Sheng, Yves Moreau, and Bart De Moor. 2003. Biclustering microarray data by Gibbs sampling. Bioinformatics 19, Suppl. 2 (2003), ii196--ii205."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2011.82"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA.2014.7058115"},{"key":"e_1_2_1_45_1","series-title":"Lecture Notes in Computer Science","volume-title":"Tijl De Bie, and Mario Boley","author":"Spyropoulou Eirini","year":"2013","unstructured":"Eirini Spyropoulou , Tijl De Bie, and Mario Boley . 2013 . Mining interesting patterns in multi-relational data with N-ary relationships. In Proceedings of the International Conference on Discovery Science, Lecture Notes in Computer Science , vol. 8140 . Springer-Verlag , Berlin, 217--232. Eirini Spyropoulou, Tijl De Bie, and Mario Boley. 2013. Mining interesting patterns in multi-relational data with N-ary relationships. In Proceedings of the International Conference on Discovery Science, Lecture Notes in Computer Science, vol. 8140. Springer-Verlag, Berlin, 217--232."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-013-0319-9"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1466620.1466622"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-15-S6-S4"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557337"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467813"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the ACM CHI workshop on Human Centered Machine Learning.","author":"Sun Maoyuan","year":"2016","unstructured":"Maoyuan Sun , Peng Mi , Hao Wu , Chris North , and Naren Ramakrishnan . 2016 . Usability challenges underlying bicluster interaction for sensemaking . In Proceedings of the ACM CHI workshop on Human Centered Machine Learning. Maoyuan Sun, Peng Mi, Hao Wu, Chris North, and Naren Ramakrishnan. 2016. Usability challenges underlying bicluster interaction for sensemaking. In Proceedings of the ACM CHI workshop on Human Centered Machine Learning."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346665"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.5555\/1146068.1711152"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-012-0275-9"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"45","author":"Lisa","unstructured":"Lisa C. Thomas and Christopher D. Wickens. 2001. Visual displays and cognitive tunneling: Frames of reference effects on spatial judgments and change detection . In Proceedings of the Human Factors and Ergonomics Society Annual Meeting , vol. 45 . SAGE Publications, 336--340. Lisa C. Thomas and Christopher D. Wickens. 2001. Visual displays and cognitive tunneling: Frames of reference effects on spatial judgments and change detection. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 45. SAGE Publications, 336--340."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30214-8_2"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1133905.1133916"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150495"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-014-0370-1"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2008.09.029"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2005.60"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1081870.1081912"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3047017","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3047017","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3047017","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:50:24Z","timestamp":1750218624000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3047017"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1,31]]},"references-count":62,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,2,28]]}},"alternative-id":["10.1145\/3047017"],"URL":"https:\/\/doi.org\/10.1145\/3047017","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1,31]]},"assertion":[{"value":"2015-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}