{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T13:12:13Z","timestamp":1781356333141,"version":"3.54.1"},"reference-count":122,"publisher":"MIS Quarterly","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,6,1]]},"abstract":"<jats:p>The notions of significance and relevance have provoked much controversy and confusion among those who conduct and those who are intended to be informed by quantitative research in the information systems (IS) field. The history of quantitative research in the IS field and beyond reveals not only disputes over the adequacy of statistical significance to warrant the scientific merits of research, but also pleas for drawing attention to practical significance, as well as a lack of distinction between relevance and practical significance. This essay offers a remedial, overarching account. We establish the position that statistical significance, practical significance, and relevance are distinct qualities, where the latter two transcend mere statistical concerns and respectively refer to the distinct matters of research impressiveness and real-world usefulness. Furthermore, we draw attention to the importance of proper communication of quantitative\/statistical analyses through a detailed examination of published IS research. Our examination gives rise to three major issues. The three issues are concerned with the proper communication of (1) research rigor, (2) practical significance, and (3) research relevance. We express our opinions with respect to the three issues and provide a number of recommendations.<\/jats:p>","DOI":"10.25300\/misq\/2020\/13932","type":"journal-article","created":{"date-parts":[[2021,1,14]],"date-time":"2021-01-14T15:20:49Z","timestamp":1610637649000},"page":"525-560","source":"Crossref","is-referenced-by-count":44,"title":["When Statistical Significance Is Not Enough: Investigating Relevance, Practical Significance, and Statistical Significance"],"prefix":"10.25300","volume":"44","author":[{"given":"Kaveh","family":"Mohajeri","sequence":"first","affiliation":[{"name":"IESEG School of Management, 3 rue de la Digue, 59000 Lille, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mostafa","family":"Mesgari","sequence":"additional","affiliation":[{"name":"College of Business Administration, Loyola Marymount University, 1 LMU Drive, Los Angeles, CA 90045-2659 U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Allen S.","family":"Lee","sequence":"additional","affiliation":[{"name":"School of Business, Virginia Commonwealth University, 301 West Main Street, Richmond, VA 23208-4000 U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10933","published-online":{"date-parts":[[2020,6,1]]},"reference":[{"key":"2025082211200841100_b1-02_13932_io_mohajerilee","volume-title":"Final Report of the AACSB Task Force on Impact of Research, The Association to Advance Collegiate Schools of Business","author":"AACSB International","year":"2008"},{"issue":"2","key":"2025082211200841100_b2-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"i","DOI":"10.17705\/1jais.00423","article-title":"Big Data Research in Information Systems: Toward an Inclusive Research Agenda","volume":"17","author":"Abbasi","year":"2016","journal-title":"Journal of the Association for Information Systems"},{"issue":"2","key":"2025082211200841100_b3-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"227","DOI":"10.2307\/249577","article-title":"Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication","volume":"16","author":"Adams","year":"1992","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b4-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1177\/1094428109333339","article-title":"Customer-Centric Science: Reporting Significant Research Results with Rigor, Relevance, and Practical Impact in Mind","volume":"13","author":"Aguinis","year":"2010","journal-title":"Organizational Research Methods"},{"issue":"3","key":"2025082211200841100_b5-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.25300\/MISQ\/2018\/13587","article-title":"Statistical Inference with PLSc Using Bootstrap Confidence Intervals","volume":"42","author":"Aguirre-Urreta","year":"2018","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b6-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/25148778","article-title":"IT Road Warriors: Balancing Work\u2013 Family Conflict, Job Autonomy, and Work Overload to Mitigate Turnover Intentions","volume":"31","author":"Ahuja","year":"2007","journal-title":"MIS Quarterly"},{"issue":"6","key":"2025082211200841100_b7-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"33","DOI":"10.3102\/0013189X035006033","article-title":"Standards for Reporting on Empirical Social Science Research in AERA Publications","volume":"35","author":"American Educational Research Association","year":"2006","journal-title":"Educational Researcher"},{"key":"2025082211200841100_b8-02_13932_io_mohajerilee","volume-title":"Publication Manual of the American Psychological Association","author":"American Psychological Association","year":"2010"},{"issue":"3","key":"2025082211200841100_b9-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"713","DOI":"10.25300\/MISQ\/2015\/39.3.10","article-title":"Exhaustion from Information System Career Experience: Implications for Turn-Away Intention","volume":"39","author":"Armstrong","year":"2015","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b10-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"807","DOI":"10.25300\/MISQ\/2016\/40:4.03","article-title":"Transformational Issues of Big Data and Analytics in Networked Business","volume":"40","author":"Baesens","year":"2016","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b11-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"31","DOI":"10.2307\/249677","article-title":"Modeling IT Ethics: A Study in Situational Ethics","volume":"22","author":"Banerjee","year":"1998","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b12-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"841","DOI":"10.25300\/MISQ\/2017\/41.3.08","article-title":"Repeated Interactions Versus Social Ties: Quantifying the Economic Value of Trust, Forgiveness, and Reputation Using a Field Experiment","volume":"41","author":"Bapna","year":"2017","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b13-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"57","DOI":"10.25300\/MISQ\/2016\/40.1.03","article-title":"Contract Design Choices and the Balance of Ex Ante and Ex Post Transaction Costs in Software Development Outsourcing","volume":"40","author":"Benaroch","year":"2016","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b14-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1080\/01621459.1938.10502329","article-title":"Some Difficulties of Interpretation Encountered in the Application of the Chi-Square Test","volume":"33","author":"Berkson","year":"1938","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2025082211200841100_b15-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/3250956","article-title":"Validation in Information Systems Research: A State-of-the-Art Assessment","volume":"25","author":"Boudreau","year":"2001","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b16-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1177\/014920630302900106","article-title":"Effect Size Estimation: Factors to Consider and Mistakes to Avoid","volume":"29","author":"Breaugh","year":"2003","journal-title":"Journal of Management"},{"issue":"4","key":"2025082211200841100_b17-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"837","DOI":"10.25300\/MISQ\/2015\/39.4.5","article-title":"What Do Users Have to Fear? Using Fear Appeals to Engender Threats and Fear that Motivate Protective Security Behaviors","volume":"39","author":"Boss","year":"2015","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b18-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1214\/ss\/1009213726","article-title":"Statistical Modeling: The Two Cultures","volume":"16","author":"Breiman","year":"2001","journal-title":"Statistical Science"},{"issue":"3","key":"2025082211200841100_b19-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"399","DOI":"10.2307\/25148690","article-title":"Model of Adoption of Technology in Households: A Baseline Model Test and Extension Incorporating Household Life Cycle","volume":"29","author":"Brown","year":"2005","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b20-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1177\/105381510502700307","article-title":"An Introduction to Clinical Significance: An Alternative Index of Intervention Effect for Group Experimental Designs","volume":"27","author":"Campbell","year":"2005","journal-title":"Journal of Early Intervention"},{"issue":"4","key":"2025082211200841100_b21-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"441","DOI":"10.2307\/249587","article-title":"User-Database Interface: The Effect of Abstraction Levels on Query Performance","volume":"17","author":"Chan","year":"1993","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b22-02_13932_io_mohajerilee","doi-asserted-by":"crossref","DOI":"10.1201\/b15238","volume-title":"Problem Solving: A Statistician\u2019s Guide","author":"Chatfield","year":"1995","edition":"2nd"},{"key":"2025082211200841100_b23-02_13932_io_mohajerilee","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen","year":"1977","edition":"Rev."},{"key":"2025082211200841100_b24-02_13932_io_mohajerilee","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen","year":"1988"},{"key":"2025082211200841100_b25-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1037\/0033-2909.112.1.155","article-title":"A Power Primer","volume":"112","author":"Cohen","year":"1992","journal-title":"Psychological Bulletin"},{"key":"2025082211200841100_b26-02_13932_io_mohajerilee","first-page":"287","article-title":"When Small Effect Sizes Tell a Big Story, and When Large Effect Sizes Don\u2019t","volume-title":"Statistical and Methodological Myths and Urban Legends: Doctrine, Verity and Fable in the Organizational and Social Sciences","author":"Cortina","year":"2009"},{"issue":"4","key":"2025082211200841100_b27-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1177\/0013164401614002","article-title":"A Primer on the Understanding, Use, and Calculation of Confidence Intervals that are Based on Central and Noncentral Distributions","volume":"61","author":"Cumming","year":"2001","journal-title":"Educational and Psychological Measurement"},{"issue":"3","key":"2025082211200841100_b28-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1002\/sce.3730610318","article-title":"Statistical Significance Versus Practical Significance","volume":"61","author":"Daniel","year":"1977","journal-title":"Science Education"},{"key":"2025082211200841100_b29-02_13932_io_mohajerilee","doi-asserted-by":"crossref","DOI":"10.17705\/1CAIS.00610","article-title":"Relevance in Information Systems Research","volume":"6","author":"Dennis","year":"2001","journal-title":"Communications of the Association for Information Systems"},{"key":"2025082211200841100_b30-02_13932_io_mohajerilee","doi-asserted-by":"crossref","DOI":"10.17705\/1CAIS.01716","article-title":"Beyond Rigor and Relevance Towards Responsibility and Reverberation: Information Systems Research That Really Matters","volume":"17","author":"Desouza","year":"2006","journal-title":"Communications of the Association for Information Systems"},{"key":"2025082211200841100_b31-02_13932_io_mohajerilee","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511761676","volume-title":"The Essential Guide to Effect Size: An Introduction to Statistical Power, Meta-Analysis and the Interpretation of Research Results","author":"Ellis","year":"2010"},{"key":"2025082211200841100_b32-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1177\/0959354398083002","article-title":"Replication\u2014A Step in the Right Direction","volume":"8","author":"Falk","year":"1998","journal-title":"Theory and Psychology"},{"key":"2025082211200841100_b33-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1177\/0959354395051004","article-title":"Significance Tests Die Hard: The Amazing Persistence of a Probabilistic Misconception","volume":"5","author":"Falk","year":"1995","journal-title":"Theory and Psychology"},{"issue":"2","key":"2025082211200841100_b34-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"393","DOI":"10.25300\/MISQ\/2015\/39.2.06","article-title":"Leading Collaboration in Online Communities","volume":"39","author":"Faraj","year":"2015","journal-title":"MIS Quarterly"},{"issue":"l","key":"2025082211200841100_b35-02_13932_io_mohajerilee","first-page":"1","article-title":"On the \u2018Probable Error\u2019 of a Coefficient of Correlation Deduced from a Small Sample","author":"Fisher","year":"1921","journal-title":"Metron"},{"key":"2025082211200841100_b36-02_13932_io_mohajerilee","volume-title":"Statistical Methods for Research Workers","author":"Fisher","year":"1925"},{"issue":"3","key":"2025082211200841100_b37-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"565","DOI":"10.25300\/MISQ\/2015\/39.3.03","article-title":"Vocal Minority and Silent Majority: How Do Online Ratings Reflect Population Perceptions of Quality?","volume":"39","author":"Gao","year":"2015","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b38-02_13932_io_mohajerilee","doi-asserted-by":"crossref","DOI":"10.17705\/1CAIS.00407","article-title":"Structural Equation Modeling and Regression: Guidelines for Research Practice","volume":"4","author":"Gefen","year":"2000","journal-title":"Communications of the Association for Information Systems"},{"issue":"2","key":"2025082211200841100_b39-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"321","DOI":"10.5465\/amj.2014.4002","article-title":"Big Data and Management","volume":"57","author":"George","year":"2014","journal-title":"Academy of Management Journal"},{"issue":"3","key":"2025082211200841100_b40-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1287\/isre.2016.0643","article-title":"Open Content, Linus\u2019 Law, and Neutral Point of View","volume":"27","author":"Greenstein","year":"2016","journal-title":"Information Systems Research"},{"issue":"1","key":"2025082211200841100_b41-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"247","DOI":"10.25300\/MISQ\/2016\/40.1.11","article-title":"The Creation of Social Value: Can an Online Health Community Reduce Rural\u2013 Urban Health Disparities?","volume":"40","author":"Goh","year":"2016","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b42-02_13932_io_mohajerilee","volume-title":"Effect Sizes for Research: A Broad Practical Approach","author":"Grissom","year":"2005"},{"key":"2025082211200841100_b43-02_13932_io_mohajerilee","volume-title":"Logic of Statistical Inference","author":"Hacking","year":"1965"},{"issue":"2","key":"2025082211200841100_b44-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"139","DOI":"10.2753\/MTP1069-6679190202","article-title":"PLS-SEM: Indeed a Silver Bullet","volume":"19","author":"Hair","year":"2011","journal-title":"Journal of Marketing Theory and Practice"},{"issue":"1","key":"2025082211200841100_b45-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"11","DOI":"10.2307\/258833","article-title":"What if the Academy Actually Mattered?","volume":"19","author":"Hambrick","year":"1994","journal-title":"Academy of Management Review"},{"issue":"4","key":"2025082211200841100_b46-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"909","DOI":"10.25300\/MISQ\/2015\/39.4.8","article-title":"Campus Emergency Notification Systems: An Examination of Factors Affecting Compliance with Alerts","volume":"39","author":"Han","year":"2015","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b47-02_13932_io_mohajerilee","doi-asserted-by":"crossref","DOI":"10.17705\/1CAIS.03441","article-title":"Value of IS Research: Is There a Crisis?","volume":"34","author":"Hassan","year":"2014","journal-title":"Communications of the Association for Information Systems"},{"issue":"2","key":"2025082211200841100_b48-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"435","DOI":"10.25300\/MISQ\/2015\/39.2.08","article-title":"Mobile Application Usability: Conceptualization and Instrument Development","volume":"39","author":"Hoehle","year":"2015","journal-title":"MIS Quarterly"},{"issue":"2","key":"2025082211200841100_b49-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"383","DOI":"10.25300\/MISQ\/2013\/37.2.04","article-title":"When Filling the Wait Makes it Feel Longer: A Paradigm Shift Perspective for Managing Online Delay","volume":"37","author":"Hong","year":"2013","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b50-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1065","DOI":"10.2307\/41703498","article-title":"Impact of User Satisfaction with Mandated CRM Use on Employee Service Quality","volume":"36","author":"Hsieh","year":"2012","journal-title":"MIS Quarterly"},{"issue":"2","key":"2025082211200841100_b51-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1177\/0013164402062002002","article-title":"A History of Effect Size Indices","volume":"62","author":"Huberty","year":"2002","journal-title":"Educational and Psychological Measurement"},{"issue":"2","key":"2025082211200841100_b52-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"175","DOI":"10.2307\/249764","article-title":"Work Experiences, Job Involvement, and Quality of Work Life among Information Systems Personnel","volume":"18","author":"Igbaria","year":"1994","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b53-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"615","DOI":"10.25300\/MISQ\/2015\/39.3.05","article-title":"Information Technology Use as a Learning Mechanism: The Impact of IT Use on Knowledge Transfer Effectiveness, Absorptive Capacity, and Franchisee Performance","volume":"39","author":"Iyengar","year":"2015","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b54-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"113","DOI":"10.25300\/MISQ\/2015\/39.1.06","article-title":"An Enhanced Fear Appeal Rhetorical Framework: Leveraging Threats to the Human Asset Through Sanctioning Rhetoric","volume":"39","author":"Johnston","year":"2015","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b55-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"667","DOI":"10.25300\/MISQ\/2015\/39.3.07","article-title":"Comparing Potential and Actual Innovators: An Empirical Study of Mobile Data Services Innovation","volume":"39","author":"Kankanhalli","year":"2015","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b56-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1037\/0022-006X.67.3.332","article-title":"The Meanings and Measurement of Clinical Significance","volume":"67","author":"Kazdin","year":"1999","journal-title":"Journal of Consulting and Clinical Psychology"},{"issue":"2","key":"2025082211200841100_b57-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1037\/a0028086","article-title":"On Effect Size","volume":"17","author":"Kelley","year":"2012","journal-title":"Psychological Methods"},{"key":"2025082211200841100_b58-02_13932_io_mohajerilee","volume-title":"Multiple Regression in Behavioral Research","author":"Kerlinger","year":"1973"},{"issue":"1","key":"2025082211200841100_b59-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"31","DOI":"10.2307\/249609","article-title":"Strategic Information Systems Revisited: A Study in Sustainability and Performance","volume":"18","author":"Kettinger","year":"1994","journal-title":"MIS Quarterly"},{"issue":"5","key":"2025082211200841100_b60-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1177\/0013164496056005002","article-title":"Practical Significance: A Concept Whose Time Has Come","volume":"56","author":"Kirk","year":"1996","journal-title":"Educational and Psychological Measurement"},{"issue":"2","key":"2025082211200841100_b61-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1177\/00131640121971185","article-title":"Promoting Good Statistical Practices: Some Suggestions","volume":"61","author":"Kirk","year":"2001","journal-title":"Educational and Psychological Measurement"},{"issue":"4","key":"2025082211200841100_b62-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1023\/A:1020764227390","article-title":"Capitalization Versus Expensing: Evidence on the Uncertainty of Future Earnings from Capital Expenditures Versus R&D Outlays","volume":"7","author":"Kothari","year":"2002","journal-title":"Review of Accounting Studies"},{"issue":"3","key":"2025082211200841100_b63-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"174","DOI":"10.2307\/254541","article-title":"The Management Theory Jungle","volume":"4","author":"Koontz","year":"1961","journal-title":"Academy of Management Journal"},{"issue":"3","key":"2025082211200841100_b64-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1287\/isre.14.3.221.16560","article-title":"Generalizing Generalizability in Information Systems Research","volume":"14","author":"Lee","year":"2003","journal-title":"Information Systems Research"},{"key":"2025082211200841100_b65-02_13932_io_mohajerilee","doi-asserted-by":"crossref","DOI":"10.1109\/HICSS.2012.416","article-title":"Linking Relevance to Practical Significance","author":"Lee","year":"2012"},{"issue":"4","key":"2025082211200841100_b66-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"747","DOI":"10.25300\/MISQ\/2015\/39.4.1","article-title":"Ambient Awareness and Knowledge Acquisition: Using Social Media to Learn \u2018Who Knows What\u2019 and \u2018Who Knows Whom,\u2019","volume":"39","author":"Leonardi","year":"2015","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b67-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1017\/S0140525X98391165","article-title":"The Critics Rebutted: A Pyrrhic Victory","volume":"21","author":"Lewandowsky","year":"1998","journal-title":"Behavioral and Brain Sciences"},{"key":"2025082211200841100_b68-02_13932_io_mohajerilee","volume-title":"Is More Always Better? Larger Samples and False Discoveries","author":"Lin","year":"2008"},{"issue":"4","key":"2025082211200841100_b69-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1287\/isre.2013.0480","article-title":"Research Commentary\u2014Too Big to Fail: Large Samples and the p-Value Problem","volume":"24","author":"Lin","year":"2013","journal-title":"Information Systems Research"},{"issue":"3","key":"2025082211200841100_b70-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"729","DOI":"10.25300\/MISQ\/2015\/39.3.11","article-title":"Friendships in Online Peer-To-Peer Lending: Pipes, Prisms, and Relational Herding","volume":"39","author":"Liu","year":"2015","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b71-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1201","DOI":"10.25300\/MISQ\/2014\/38.4.12","article-title":"Take Their Word for It: The Symbolic Role of Linguistic Style Matches in User Communities","volume":"38","author":"Ludwig","year":"2014","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b72-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1057\/ejis.2013.10","article-title":"\u2018Datafication\u2019: Making Sense of (Big) Data in a Complex World","volume":"22","author":"Lycett","year":"2013","journal-title":"European Journal of Information Systems"},{"issue":"13","key":"2025082211200841100_b73-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1466","DOI":"10.1016\/j.ejor.2006.04.051","article-title":"Comprehensible Credit Scoring Models Using Rule Extraction from Support Vector Machines","volume":"183","author":"Martens","year":"2007","journal-title":"European Journal of Operational Research"},{"issue":"1","key":"2025082211200841100_b74-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1","DOI":"10.25300\/MISQ\/2015\/39.1.01","article-title":"Motivating Employees to Explore Collaboration Technology in Team Contexts","volume":"39","author":"Maruping","year":"2015","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b75-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"591","DOI":"10.25300\/MISQ\/2015\/39.3.04","article-title":"Jamming with Social Media: How Cognitive Structuring of Organizing Vision Facets Affects IT Innovation Diffusion","volume":"39","author":"Miranda","year":"2015","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b76-02_13932_io_mohajerilee","doi-asserted-by":"crossref","DOI":"10.24251\/HICSS.2017.697","article-title":"Towards a Typology of Relevance","author":"Mohajeri","year":"2017"},{"issue":"4","key":"2025082211200841100_b77-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1057\/ejis.2016.2","article-title":"Utilizing Big Data Analytics for Information Systems Research: Challenges, Promises and Guidelines","volume":"25","author":"M\u00fcller","year":"2016","journal-title":"European Journal of Information Systems"},{"key":"2025082211200841100_b78-02_13932_io_mohajerilee","first-page":"175","article-title":"On the Use and Interpretation of Certain Test Criteria for Purposes of Statistical Inference","author":"Neyman","year":"1928","journal-title":"Biometrika (29A)"},{"issue":"2","key":"2025082211200841100_b79-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1037\/1082-989X.5.2.241","article-title":"Null Hypothesis Significance Testing: A Review of an Old and Continuing Controversy","volume":"5","author":"Nickerson","year":"2000","journal-title":"Psychological Methods"},{"key":"2025082211200841100_b80-02_13932_io_mohajerilee","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-04898-2_422","article-title":"Null-Hypothesis Significance Testing: Misconceptions","volume-title":"International Encyclopedia of Statistical Science","author":"Nickerson","year":"2011"},{"issue":"2","key":"2025082211200841100_b81-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"317","DOI":"10.25300\/MISQ\/2015\/39.2.03","article-title":"Disaster Experience and Hospital Information Systems: An Examination of Perceived Information Assurance, Risk, Resilience, and HIS Usefulness","volume":"39","author":"Park","year":"2015","journal-title":"MIS Quarterly"},{"issue":"195","key":"2025082211200841100_b82-02_13932_io_mohajerilee","first-page":"1","article-title":"On the Correlation of Characters Not Quantitatively Measurable","author":"Pearson","year":"1900","journal-title":"Philosophical Transactions of the Royal Society of London, Series A, Containing Papers of a Mathematical or Physical Character"},{"issue":"4","key":"2025082211200841100_b83-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"623","DOI":"10.2307\/25148814","article-title":"Specifying Formative Constructs in Information Systems Research","volume":"31","author":"Petter","year":"2007","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b84-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1037\/0033-2909.112.1.160","article-title":"When Small Effects Are Impressive","volume":"112","author":"Prentice","year":"1992","journal-title":"Psychological Bulletin"},{"issue":"4","key":"2025082211200841100_b85-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"865","DOI":"10.25300\/MISQ\/2015\/39.4.6","article-title":"Fit and Misfit of Plural Sourcing Strategies and IT-Enabled Process Integration Capabilities: Consequences of Firm Performance in the U.S. Electric Utility Industry","volume":"39","author":"Rai","year":"2015","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b86-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"787","DOI":"10.25300\/MISQ\/2015\/39.4.3","article-title":"Software Process Diversity: Conceptualization, Measurement, and Analysis of Impact on Project Performance","volume":"39","author":"Ramasubbu","year":"2015","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b87-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"7","DOI":"10.4018\/irmj.1998010101","article-title":"Beyond Rigor and Relevance: Producing Consumable Research about Information Systems","volume":"11","author":"Robey","year":"1998","journal-title":"Information Resources Management Journal"},{"issue":"1","key":"2025082211200841100_b88-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1080\/00220970309600879","article-title":"It\u2019s Not Effect Sizes So Much as Comments about Their Magnitude That Mislead Readers","volume":"72","author":"Robinson","year":"2003","journal-title":"Journal of Experimental Education"},{"issue":"1","key":"2025082211200841100_b89-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/25148826","article-title":"Toward Improving the Relevance of Information Systems Research to Practice: The Role of Applicability Checks","volume":"32","author":"Rosemann","year":"2008","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b90-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1037\/0003-066X.45.6.775","article-title":"How Are We Doing in Soft Psychology?","volume":"45","author":"Rosenthal","year":"1990","journal-title":"American Psychologist"},{"key":"2025082211200841100_b91-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1111\/j.1559-1816.1979.tb02713.x","article-title":"A Note on Percent Variance Explained as a Measure of the Importance of Effects","volume":"9","author":"Rosenthal","year":"1979","journal-title":"Journal of Applied Social Psychology"},{"issue":"3","key":"2025082211200841100_b92-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1037\/h0087427","article-title":"Effect Sizes for Experimenting Psychologists","volume":"57","author":"Rosnow","year":"2003","journal-title":"Canadian Journal of Experimental Psychology"},{"issue":"4","key":"2025082211200841100_b93-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"809","DOI":"10.25300\/MISQ\/2015\/39.4.4","article-title":"Information Technology Impacts on Firm Performance: An Extension of Kohli and Devaraj (2003)","volume":"39","author":"Sabherwal","year":"2015","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b94-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"911","DOI":"10.25300\/MISQ\/2016\/40.4.06","article-title":"Using Big Data to Model Time-Varying Effects for Marketing Resource (Re)Allocation","volume":"40","author":"Saboo","year":"2016","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b95-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"61","DOI":"10.25300\/MISQ\/2015\/39.1.04","article-title":"Investing in Information Systems: On the Behavioral and Institutional Search Mechanisms Underpinning Hospitals\u2019 IS Investment Decisions","volume":"39","author":"Salge","year":"2015","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b96-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"177","DOI":"10.25300\/MISQ\/2015\/39.1.08","article-title":"The Value of Self-Service: Long-Term Effects of Technology-Based Self-Service Usage on Customer Retention","volume":"39","author":"Scherer","year":"2015","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b97-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1287\/orsc.1100.0557","article-title":"Perspective\u2014Researchers Should Make Thoughtful Assessments Instead of Null-hypothesis Significance Tests","volume":"22","author":"Schwab","year":"2011","journal-title":"Organization Science"},{"issue":"5","key":"2025082211200841100_b98-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"519","DOI":"10.2307\/2089475","article-title":"A Critique of Tests of Significance in Survey Research","volume":"22","author":"Selvin","year":"1957","journal-title":"American Sociological Review"},{"issue":"4","key":"2025082211200841100_b99-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1057\/ejis.2014.17","article-title":"Transforming Decision-Making Processes: A Research Agenda for Understanding the Impact of Business Analytics on Organisations","volume":"23","author":"Sharma","year":"2014","journal-title":"European Journal of Information Systems"},{"issue":"3","key":"2025082211200841100_b100-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"553","DOI":"10.2307\/23042796","article-title":"Predictive Analytics in Information Systems Research","volume":"35","author":"Shmueli","year":"2011","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b101-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"683","DOI":"10.25300\/MISQ\/2015\/39.3.08","article-title":"Competing for Attention: An Empirical Study of Online Reviewers\u2019 Strategic Behaviors","volume":"39","author":"Shen","year":"2015","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b102-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"887","DOI":"10.25300\/MISQ\/2015\/39.4.7","article-title":"Strike a Happy Medium: The Effect of IT Knowledge on Venture Capitalists\u2019 Overconfidence in IT Investments","volume":"39","author":"Singh","year":"2015","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211200841100_b103-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"iii","DOI":"10.2307\/20650302","article-title":"Editor\u2019s Comments: Why Top Journals Accept Your Paper","volume":"33","author":"Straub","year":"2009","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b104-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"iii","DOI":"10.2307\/25148865","article-title":"Editor\u2019s Comments: Readability and the Relevance Versus Rigor Debate","volume":"32","author":"Straub","year":"2008","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b105-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"iii","DOI":"10.2307\/23043485","article-title":"Editor\u2019s Comments: Rigor and Relevance in IS Research: Redefining the Debate and a Call for Future Research","volume":"35","author":"Straub","year":"2011","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b106-02_13932_io_mohajerilee","article-title":"Validation Guidelines for IS Positivist Research","volume":"13","author":"Straub","year":"2004","journal-title":"Communications of the Association for Information Systems"},{"issue":"2","key":"2025082211200841100_b107-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"473","DOI":"10.25300\/MISQ\/2015\/39.2.09","article-title":"Support Structures and Their Impacts on Employee Outcomes: A Longitudinal Field Study of an Enterprise System Implementation","volume":"39","author":"Sykes","year":"2015","journal-title":"MIS Quarterly"},{"issue":"6","key":"2025082211200841100_b108-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1057\/ejis.2015.20","article-title":"Publishing and Getting Published in EJIS: Marshaling Contributions for a Diversity of Genres","volume":"24","author":"Te\u2019eni","year":"2015","journal-title":"European Journal of Information Systems"},{"issue":"1","key":"2025082211200841100_b109-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1002\/j.1556-6678.2002.tb00167.x","article-title":"\u2018Statistical,\u2019\u2018Practical,\u2019 and \u2018Clinical\u2019: How Many Kinds of Significance Do Counselors Need to Consider?","volume":"80","author":"Thompson","year":"2002","journal-title":"Journal of Counseling & Development"},{"issue":"1","key":"2025082211200841100_b110-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"39","DOI":"10.25300\/MISQ\/2015\/39.1.03","article-title":"How Do Enterprise Resource Planning Systems Affect Firm Risk? Post-Implementation Impact","volume":"39","author":"Tian","year":"2015","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b111-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"267","DOI":"10.17705\/1jais.00426","article-title":"Job Satisfaction in Agile Development Teams: Agile Development as Work Redesign","volume":"17","author":"Tripp","year":"2016","journal-title":"Journal of the Association for Information Systems"},{"issue":"4","key":"2025082211200841100_b112-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1037\/0022-0167.51.4.473","article-title":"How to Estimate and Interpret Various Effect Sizes","volume":"51","author":"Vacha-Haase","year":"2004","journal-title":"Journal of Counseling Psychology"},{"issue":"2","key":"2025082211200841100_b113-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"345","DOI":"10.25300\/MISQ\/2015\/39.2.04","article-title":"Increasing Accountability Through User-Interface Design Artifacts: A New Approach to Addressing the Problem of Access-Policy Violations","volume":"39","author":"Vance","year":"2015","journal-title":"MIS Quarterly"},{"key":"2025082211200841100_b114-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1080\/10871200214752","article-title":"Communicating Judgements about Practical Significance: Effect Size, Confidence Intervals and Odds Ratios","volume":"7","author":"Vaske","year":"2002","journal-title":"Human Dimensions of Wildlife"},{"issue":"1","key":"2025082211200841100_b115-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"115","DOI":"10.2307\/3250981","article-title":"Why Don\u2019t Men Ever Stop to Ask for Directions? Gender, Social Influence, and Their Role in Technology Acceptance and Usage Behavior","volume":"24","author":"Venkatesh","year":"2000","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211200841100_b116-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1287\/isre.2015.0612","article-title":"Managing Citizens\u2019 Uncertainty in E-Government Services: The Mediating and Moderating Roles of Transparency and Trust","volume":"27","author":"Venkatesh","year":"2016","journal-title":"Information Systems Research"},{"key":"2025082211200841100_b117-02_13932_io_mohajerilee","volume-title":"Regression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures Models","author":"Vittinghoff","year":"2005"},{"issue":"1","key":"2025082211200841100_b118-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"91","DOI":"10.25300\/MISQ\/2015\/39.1.05","article-title":"Insider Threats in a Financial Institution: Analysis of Attack-Proneness of Information Systems Applications","volume":"39","author":"Wang","year":"2015","journal-title":"MIS Quarterly"},{"issue":"11","key":"2025082211200841100_b119-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"759","DOI":"10.17705\/1jais.00442","article-title":"Overconfidence in Phishing Email Detection","volume":"17","author":"Wang","year":"2016","journal-title":"Journal of the Association for Information Systems"},{"key":"2025082211200841100_b120-02_13932_io_mohajerilee","volume-title":"Introductory Statistics for Business and Economics","author":"Wonnacott","year":"1984","edition":"3rd"},{"issue":"2","key":"2025082211200841100_b121-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"497","DOI":"10.25300\/MISQ\/2015\/39.2.10","article-title":"How Information Technology Governance Mechanisms and Strategic Alignment Influence Organizational Performance: Insights from a Matched Survey of Business and IT Managers","volume":"39","author":"Wu","year":"2015","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211200841100_b122-02_13932_io_mohajerilee","doi-asserted-by":"crossref","first-page":"763","DOI":"10.25300\/MISQ\/2015\/39.4.2","article-title":"Work Harder or Work Smarter? Information Technology and Resource Allocation in Healthcare Processes","volume":"39","author":"Yeow","year":"2015","journal-title":"MIS Quarterly"}],"container-title":["MIS Quarterly"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/44\/2\/525\/1905\/02_13932_io_mohajerilee.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/44\/2\/525\/1905\/02_13932_io_mohajerilee.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T15:20:29Z","timestamp":1755876029000},"score":1,"resource":{"primary":{"URL":"https:\/\/misq.umn.edu\/misq\/article\/44\/2\/525\/437\/When-Statistical-Significance-Is-Not-Enough"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,1]]},"references-count":122,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,6,1]]},"published-print":{"date-parts":[[2020,6,1]]}},"URL":"https:\/\/doi.org\/10.25300\/misq\/2020\/13932","relation":{},"ISSN":["0276-7783","2162-9730"],"issn-type":[{"value":"0276-7783","type":"print"},{"value":"2162-9730","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,1]]}}}