{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,8]],"date-time":"2025-11-08T22:51:57Z","timestamp":1762642317840,"version":"3.41.2"},"reference-count":51,"publisher":"Emerald","issue":"3","license":[{"start":{"date-parts":[[2020,2,14]],"date-time":"2020-02-14T00:00:00Z","timestamp":1581638400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["OIR"],"published-print":{"date-parts":[[2020,2,14]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>Through a two-stage survey, this paper examines how researchers judge the quality of answers on ResearchGate Q&amp;A, an academic social networking site.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>In the first-stage survey, 15 researchers from Library and Information Science (LIS) judged the quality of 157 answers to 15 questions and reported the criteria that they had used. The content of their reports was analyzed, and the results were merged with relevant criteria from the literature to form the second-stage survey questionnaire. This questionnaire was then completed by researchers recognized as accomplished at identifying high-quality LIS answers on ResearchGate Q&amp;A.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>Most of the identified quality criteria for academic answers\u2014such as relevance, completeness, and verifiability\u2014have previously been found applicable to generic answers. The authors also found other criteria, such as comprehensiveness, the answerer's scholarship, and value-added. Providing opinions was found to be the most important criterion, followed by completeness and value-added.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>The findings here show the importance of studying the quality of answers on academic social Q&amp;A platforms and reveal unique considerations for the design of such systems.<\/jats:p><\/jats:sec>","DOI":"10.1108\/oir-05-2019-0186","type":"journal-article","created":{"date-parts":[[2020,2,20]],"date-time":"2020-02-20T06:32:36Z","timestamp":1582180356000},"page":"603-623","source":"Crossref","is-referenced-by-count":16,"title":["Researchers' judgment criteria of high-quality answers on academic social Q&amp;A platforms"],"prefix":"10.1108","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9491-7519","authenticated-orcid":false,"given":"Lei","family":"Li","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9522-2914","authenticated-orcid":false,"given":"Chengzhi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daqing","family":"He","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jia Tina","family":"Du","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"issue":"3","key":"key2020061010571813600_ref001","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<149::AID-ASI5>3.0.CO;2-J","article-title":"User-defined relevance criteria: an exploratory study","volume":"45","year":"1994","journal-title":"Journal of the American Society for Information Science"},{"issue":"3","key":"key2020061010571813600_ref002","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1108\/14684521211241413","article-title":"Predictors of high\u2010quality answers","volume":"36","year":"2012","journal-title":"Online Information Review"},{"issue":"4\/5","key":"key2020061010571813600_ref003","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1108\/01435120110388779","article-title":"Quality versus quantity: contradictions in LIS journal publishing in China","volume":"22","year":"2001","journal-title":"Library Management"},{"volume-title":"Statistical Inference","year":"2002","key":"key2020061010571813600_ref004"},{"issue":"1","key":"key2020061010571813600_ref005","first-page":"26","article-title":"Using blog content depth and breadth to access and classify blogs","volume":"5","year":"2010","journal-title":"International Journal of Business and Information"},{"issue":"3-4","key":"key2020061010571813600_ref006","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/s11257-006-9013-6","article-title":"Design and evaluation of an adaptive incentive mechanism for sustained educational online communities","volume":"16","year":"2006","journal-title":"User Modeling and User-Adapted Interaction"},{"issue":"1","key":"key2020061010571813600_ref007","first-page":"1","article-title":"Developing a typology of online Q&A models and recommending the right model for each question type","volume":"49","year":"2012","journal-title":"Proceedings of the American Society for Information Science and Technology"},{"issue":"10","key":"key2020061010571813600_ref008","doi-asserted-by":"crossref","first-page":"2058","DOI":"10.1002\/asi.22902","article-title":"So fast so good: an analysis of answer quality and answer speed in community question-answering sites","volume":"64","year":"2013","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"key2020061010571813600_ref009","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1016\/j.chb.2015.08.057","article-title":"Helpfulness of user-generated reviews as a function of review sentiment, product type and information quality","volume":"54","year":"2016","journal-title":"Computers in Human Behavior"},{"issue":"13","key":"key2020061010571813600_ref010","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1002\/asi.20066","article-title":"Evaluating the quality of research publications: a pilot study of school librarianship","volume":"55","year":"2004","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"key2020061010571813600_ref011","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1287\/isre.3.1.60","article-title":"Information systems success: the quest for the dependent variable","volume":"3","year":"1992","journal-title":"Information Systems Research"},{"issue":"6","key":"key2020061010571813600_ref012","article-title":"Motivating scholars' responses in academic social networking sites: an empirical study on ResearchGate Q&A behavior","volume":"56","year":"2019","journal-title":"Information Processing & Management"},{"volume-title":"Managing Information Quality: Increasing the Value of Information in Knowledge-Intensive Products and Processes","year":"2006","key":"key2020061010571813600_ref013"},{"issue":"5","key":"key2020061010571813600_ref014","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1177\/0165551511415584","article-title":"A comparative assessment of answer quality on four question answering sites","volume":"37","year":"2011","journal-title":"Journal of Information Science"},{"issue":"6","key":"key2020061010571813600_ref015","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1108\/OIR-01-2016-0003","article-title":"Improving information quality of wikipedia articles with cooperative principle","volume":"41","year":"2017","journal-title":"Online Information Review"},{"issue":"1","key":"key2020061010571813600_ref016","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.ipm.2018.08.007","article-title":"Quality assessment of answers with user-identified criteria and data-driven features in social Q&A","volume":"56","year":"2019","journal-title":"Information Processing & Management"},{"issue":"1","key":"key2020061010571813600_ref017","first-page":"1","article-title":"Evaluating answer quality across knowledge domains: using textual and non-textual features in social Q&A","volume":"52","year":"2015","journal-title":"Proceedings of the Association for Information Science and Technology"},{"issue":"1","key":"key2020061010571813600_ref018","first-page":"1","article-title":"Changing communication on ResearchGate through interface updates","volume":"51","year":"2014","journal-title":"Proceedings of the American Society for Information Science and Technology"},{"first-page":"865","article-title":"Predictors of answer quality in online Q&A sites","year":"2008","key":"key2020061010571813600_ref019"},{"issue":"1","key":"key2020061010571813600_ref020","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1002\/asi.21652","article-title":"Prioritization of data quality dimensions and skills requirements in genome annotation work","volume":"63","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"volume-title":"Quality Information and Knowledge","year":"1998","key":"key2020061010571813600_ref021"},{"issue":"3","key":"key2020061010571813600_ref022","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1002\/asi.23692","article-title":"Information exchange on an academic social networking site: a multidiscipline comparison on ResearchGate Q&A","volume":"68","year":"2017","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"5","key":"key2020061010571813600_ref023","first-page":"890","article-title":"User participation in an academic social networking service: a survey of open group users on Mendeley","volume":"65","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"1","key":"key2020061010571813600_ref024","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1109\/MIC.2011.23","article-title":"What makes a high-quality user-generated answer?","volume":"15","year":"2011","journal-title":"IEEE Internet Computing"},{"issue":"11","key":"key2020061010571813600_ref025","article-title":"Academics and their online networks: exploring the role of academic social networking sites","volume":"19","year":"2014","journal-title":"First Monday"},{"key":"key2020061010571813600_ref026","article-title":"From social networks to publishing platforms: a review of the history and scholarship of academic social network sites","volume":"6","year":"2019","journal-title":"Frontiers in Education"},{"issue":"2","key":"key2020061010571813600_ref027","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1108\/PROG-11-2015-0073","article-title":"Social question and answer sites: the story so far","volume":"51","year":"2017","journal-title":"Program"},{"issue":"4","key":"key2020061010571813600_ref028","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1002\/asi.21026","article-title":"Users' relevance criteria for evaluating answers in a social Q and A site","volume":"60","year":"2009","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"4","key":"key2020061010571813600_ref029","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1002\/asi.23424","article-title":"Institutional and individual factors affecting scientists' data-sharing behaviors: a multilevel analysis","volume":"67","year":"2016","journal-title":"Journal of the Association for Information Science and Technology"},{"edition":"2nd ed.","volume-title":"Content Analysis: An Introduction to its Methodology","year":"2004","key":"key2020061010571813600_ref030"},{"key":"key2020061010571813600_ref031","first-page":"1453","article-title":"Answer quality characteristics and prediction on an academic Q&A site: a case study on ResearchGate","volume-title":"WWW (Companion Volume)","year":"2015"},{"key":"key2020061010571813600_ref032","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/978-3-319-39396-4_6","article-title":"Evaluating academic answer quality: a pilot study on ResearchGate Q&A","volume":"9751","year":"2016","journal-title":"Lecture Notes in Computer Science"},{"key":"key2020061010571813600_ref033","first-page":"334","article-title":"Low-quality product review detection in opinion summarization","year":"2007","journal-title":"Computational Linguistics"},{"issue":"6","key":"key2020061010571813600_ref034","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1016\/S0306-4573(03)00064-5","article-title":"Perceptions of credibility of scholarly information on the web","volume":"40","year":"2004","journal-title":"Information Processing & Management"},{"key":"key2020061010571813600_ref035","first-page":"5","article-title":"Evaluating E-contents beyond impact factor - a pilot study selected open access journals in library and information science","volume":"10","year":"2007","journal-title":"Journal of Electronic Publishing"},{"issue":"7513","key":"key2020061010571813600_ref036","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1038\/512126a","article-title":"Online collaboration: scientists and the social network","volume":"512","year":"2014","journal-title":"Nature"},{"issue":"10","key":"key2020061010571813600_ref037","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1002\/asi.24186","article-title":"Communication and self-presentation behavior on academic social networking sites: an exploratory case study on profiles and discussion threads on ResearchGate","volume":"70","year":"2019","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"3","key":"key2020061010571813600_ref038","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1086\/602592","article-title":"The nature of relevance in information retrieval: an empirical study","volume":"63","year":"1993","journal-title":"The Library Quarterly"},{"issue":"7","key":"key2020061010571813600_ref039","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1002\/asi.21546","article-title":"Judging the quality and credibility of information in internet discussion forums","volume":"62","year":"2011","journal-title":"Journal of the American Society for Information Science and Technology"},{"first-page":"411","article-title":"Evaluating and predicting answer quality in community QA","year":"2010","key":"key2020061010571813600_ref040"},{"issue":"2","key":"key2020061010571813600_ref041","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1002\/asi.23177","article-title":"Research project tasks, data, and perceptions of data quality in a condensed matter physics community","volume":"66","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"},{"first-page":"101","article-title":"Information quality discussions in Wikipedia","year":"2005","key":"key2020061010571813600_ref042"},{"issue":"6","key":"key2020061010571813600_ref043","article-title":"Data sharing by scientists: practices and perceptions","volume":"6","year":"2011","journal-title":"Plos One"},{"issue":"10","key":"key2020061010571813600_ref044","doi-asserted-by":"crossref","first-page":"2344","DOI":"10.1002\/asi.23598","article-title":"Trustworthiness and authority of scholarly information in a digital age: results of an international questionnaire","volume":"67","year":"2016","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"5","key":"key2020061010571813600_ref045","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1002\/asi.23236","article-title":"ResearchGate: disseminating, communicating, and measuring scholarship?","volume":"66","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"5","key":"key2020061010571813600_ref046","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1108\/EUM0000000007127","article-title":"Changes in relevance criteria and problem stages in task performance","volume":"56","year":"2000","journal-title":"Journal of Documentation"},{"issue":"5","key":"key2020061010571813600_ref047","first-page":"360","article-title":"Understanding interobserver agreement: the kappa statistic","volume":"37","year":"2005","journal-title":"Family Medicine"},{"issue":"1","key":"key2020061010571813600_ref048","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1108\/PROG-01-2015-0008","article-title":"Answer selection and expert finding in community question answering services","volume":"51","year":"2017","journal-title":"Program"},{"issue":"4","key":"key2020061010571813600_ref049","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/07421222.1996.11518099","article-title":"Beyond accuracy: what data quality means to data consumers","volume":"12","year":"1996","journal-title":"Journal of Management Information Systems"},{"issue":"5","key":"key2020061010571813600_ref050","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1177\/0165551511416065","article-title":"Information quality assessment of community generated content: a user study of Wikipedia","volume":"37","year":"2011","journal-title":"Journal of Information Science"},{"issue":"6","key":"key2020061010571813600_ref051","doi-asserted-by":"crossref","first-page":"880","DOI":"10.1108\/OIR-06-2017-0204","article-title":"Sexual health information-seeking behavior on a social media site: predictors of best answer selection","volume":"42","year":"2018","journal-title":"Online Information Review"}],"container-title":["Online Information Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/OIR-05-2019-0186\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/OIR-05-2019-0186\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:43:02Z","timestamp":1753396982000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/oir\/article\/44\/3\/603-623\/452526"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,14]]},"references-count":51,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,2,14]]}},"alternative-id":["10.1108\/OIR-05-2019-0186"],"URL":"https:\/\/doi.org\/10.1108\/oir-05-2019-0186","relation":{},"ISSN":["1468-4527"],"issn-type":[{"type":"print","value":"1468-4527"}],"subject":[],"published":{"date-parts":[[2020,2,14]]}}}