{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T09:38:03Z","timestamp":1777628283974,"version":"3.51.4"},"reference-count":51,"publisher":"Walter de Gruyter GmbH","issue":"4","license":[{"start":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T00:00:00Z","timestamp":1701388800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This paper explores Exploratory Data Analysis (EDA). Graphical methods are used to gain insights in EDA and these insights can be useful for forming tentative hypotheses when performing a root cause analysis (RCA). The topic of EDA is well addressed in the literature; however, empirical studies of the efficacy of EDA are lacking. We therefore aim to evaluate EDA by comparing one group of students identifying salient features in a table against a second group of students attempting to identify salient features in the same data presented in the form of a run chart, and then extracting relevant conclusions from such a comparison. Two groups of students were randomly selected to receive data; either in the form of a table or a run chart. They were then tasked with visually identifying any data points that stood out as interesting. The number of correctly identified values and the time to find the values were both evaluated by a two-sample t-test to determine if there was a statistically significant difference. The participants with a graph found the correct values that stood out in the data much quicker than those that used a table. Those using the data in the form of a table too much longer and failed to identify values that stood out. However, those with a graph also had far more false positives. Much has been written on the topic of EDA in the literature; however, an empirical evaluation of this common methodology is lacking. This paper confirms with empirical evidence the effectiveness of EDA.<\/jats:p>","DOI":"10.2478\/mspe-2023-0050","type":"journal-article","created":{"date-parts":[[2023,12,6]],"date-time":"2023-12-06T01:16:25Z","timestamp":1701825385000},"page":"442-448","source":"Crossref","is-referenced-by-count":1,"title":["Exploring Exploratory Data Analysis: An Empirical Test of Run Chart Utility"],"prefix":"10.2478","volume":"31","author":[{"given":"Matthew","family":"Barsalou","sequence":"first","affiliation":[{"name":"QPLUS"}]},{"given":"Pedro Manuel","family":"Saraiva","sequence":"additional","affiliation":[{"name":"University of Coimbra"}]},{"given":"Roberto","family":"Henriques","sequence":"additional","affiliation":[{"name":"Nova University Lisbon"}]}],"member":"374","published-online":{"date-parts":[[2023,12,6]]},"reference":[{"key":"2026042822072765438_j_mspe-2023-0050_ref_001","doi-asserted-by":"crossref","unstructured":"G. Vining. \u201cGeoff Vining\u2019s Discussion of \u2018Principles of Exploratory Data Analysis in Problem Solving: What Can We Learn From a Well-Known Case?,\u201d Quality Engineering. Vol. 21, No. 4, pp. 380-381, 2009.","DOI":"10.1080\/08982110903188300"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_002","doi-asserted-by":"crossref","unstructured":"J.W. Tukey. \u201cWe Need Both Exploratory and Confirmatory,\u201d The American Statistician. Vol. 34, No. 1, pp. 23-25, 1980.","DOI":"10.1080\/00031305.1980.10482706"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_003","doi-asserted-by":"crossref","unstructured":"J. de Mast, S.H. Steiner, R. Kuijten, and E. Funken-Van den Bliek. \u201cStatistical Reasoning in Diagnostic Problem-solving \u2013 The Case of Flow-rate Measurements. Quality Engineering. Vol. 31, No. 3, pp. 484-498, 2009.","DOI":"10.1080\/08982112.2018.1548022"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_004","doi-asserted-by":"crossref","unstructured":"T.T. Allen, Z. Sui, and K. Akbari. \u201cExploratory Text Data Analysis for Quality Hypothesis Generation,\u201d Quality Engineering. Vol. 30, No. 4, pp. 701-712, 2018.","DOI":"10.1080\/08982112.2018.1481216"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_005","doi-asserted-by":"crossref","unstructured":"A.O. Dempster. \u201cJohn W. Tukey as Philosopher,\u201d The Annals of Statistics. Vol. 30, No. 6), pp. 1619-1628, 2002.","DOI":"10.1214\/aos\/1043351249"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_006","doi-asserted-by":"crossref","unstructured":"G. Vining. \u201cGeoff Vining\u2019s Discussion of \u2018Principles of Exploratory Data Analysis in Problem Solving: What Can We Learn From a Well-Known Case?,\u201d Quality Engineering. Vol. 21, No. 4, pp. 380-381, 2009.","DOI":"10.1080\/08982110903188300"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_007","doi-asserted-by":"crossref","unstructured":"G.E. Box. \u201cStatistics as a Catalyst to Learning by Scientific Method Part II-A Discussion,\u201d Journal of Quality Technology. Vol. 31, No. 1, pp. 16-29, 1999.","DOI":"10.1080\/00224065.1999.11979890"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_008","doi-asserted-by":"crossref","unstructured":"D. J.-L. Lee, T. Siddiqui, K. Karahalios, and A. Parameswaran. \u201cThree Lessons from Accelerating Scientific Insight Discovery via Visual Querying,\u201d Patterns. Vol. 1, No. 7, 2020.","DOI":"10.1016\/j.patter.2020.100126"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_009","unstructured":"T. Pyzdek. The Six Sigma Project Planner \u2013 A Step-by-Step Guide to Leading a Six Sigma Project Through DMAIC, New Yok, NY, McGraw Hill Companies, Inc, 2003."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_010","doi-asserted-by":"crossref","unstructured":"D. Zrymiak. The Certified Quality Process Analyst Handbook. Milwaukee, WI, The ASQ Quality Press, 2015.","DOI":"10.1080\/10686967.2015.11918422"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_011","doi-asserted-by":"crossref","unstructured":"J.W. Tukey. \u201cWe Need Both Exploratory and Confirmatory,\u201d The American Statistician. Vol. 34, No. 1, pp. 23-25, 1980.","DOI":"10.1080\/00031305.1980.10482706"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_012","unstructured":"L.B. Hare. \u201cDodging Deceptive Depictions: The Challenges of Conveying Accurate and Truthful Information Through Graphical Displays,\u201d Quality Progress. Vol. 54, No. 2, pp. 37-44, 2001."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_013","unstructured":"M. Barsalou. \u201cMore Than Just Opinion,\u201d Quality Progress. Vol 4, No. 3, pp. 38-43, 2016."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_014","unstructured":"J.W. Tukey. Exploratory Data Analysis. Reading, MA: Addison-Wesley Publishing, 1977."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_015","doi-asserted-by":"crossref","unstructured":"J.W. Tukey. \u201cData-Based Graphics: Visual Display in the Decades to Come,\u201d Statistical Science. Vol., No. 3, pp. 327-339, 1990.","DOI":"10.1214\/ss\/1177012101"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_016","doi-asserted-by":"crossref","unstructured":"J. de Mast, and B.P.H. Kemper. \u201cPrinciples of Exploratory Data Analysis in Problem Solving: What Can We Learn from a Well-Known Case?,\u201d Quality Engineering. Vol. 21, No. 4, pp. 366-375, 2009.","DOI":"10.1080\/08982110903188276"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_017","doi-asserted-by":"crossref","unstructured":"M. Barsalou. \u201cOne Good Idea: Mix it Up,\u201d Quality Progress. Vol. 47, No. 5), pp. 64, 2014","DOI":"10.4324\/9781315831169-26"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_018","doi-asserted-by":"crossref","unstructured":"R. Hoerl, W. Jensen, and J. de Mast. \u201cUnderstanding and Addressing Complexity in Problem Solving,\u201d Quality Engineering. Vol. 33, No. 4), pp. 612-626, 2021.","DOI":"10.1080\/08982112.2021.1952230"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_019","doi-asserted-by":"crossref","unstructured":"G. Vining. \u201cTechnical Advice: Scientific Method and Approaches for Collecting Data,\u201d Quality Engineering. Vol. 25, No. 2, pp. 194-201, 2013.","DOI":"10.1080\/08982112.2013.764228"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_020","doi-asserted-by":"crossref","unstructured":"P. Maravelakis. \u201cThe Use of Statistics in Social Sciences,\u201d Journal of Humanities and Applied Social Sciences. Vol. 1, No. 2, pp. 87-97, 2019.","DOI":"10.1108\/JHASS-08-2019-0038"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_021","doi-asserted-by":"crossref","unstructured":"J. de Mast, and J. Lokkerbol. \u201cAn Analysis of the Six Sigma DMAIC Method From the Perspective of Problem Solving,\u201d International Journal of Production Economics. Vol. 139, No. 2, pp. 604-614, 2012.","DOI":"10.1016\/j.ijpe.2012.05.035"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_022","doi-asserted-by":"crossref","unstructured":"O. Kandil, and R. Abd El Aziz. \u201cEvaluating the Supply Chain Information Flow in Egyptian SMEs Using Six Sigma: A Case Study,\u201d International Journal of Lean Six Sigma, Vol. 12, No. 1, pp. 2018.","DOI":"10.1108\/IJLSS-10-2016-0066"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_023","doi-asserted-by":"crossref","unstructured":"M. Flores, R. Fern\u00e1ndez-Casal, S. Naya, and J. Tarr\u00edo-Saavedra. \u201cStatistical Quality Control with the qcr Package,\u201d The R Journal. Vol. 13, No. 1, pp. 194-217, 2021.","DOI":"10.32614\/RJ-2021-034"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_024","doi-asserted-by":"crossref","unstructured":"J. W. Tukey. \u201cData-Based Graphics: Visual Display in the Decades to Come,\u201d Statistical Science. Vol. 5, No. 3, pp. 327-339, 1990.","DOI":"10.1214\/ss\/1177012101"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_025","doi-asserted-by":"crossref","unstructured":"J.R. Simpson. \u201cDiscussion of \u2018Principles of Exploratory Data Analysis in Problem Solving: What Can We Learn from a Well-Known Case?\u2019,\u201d Quality Engineering. Vol. 21, No. 4, pp. 376-379.","DOI":"10.1080\/08982110903188292"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_026","doi-asserted-by":"crossref","unstructured":"J.W. Tukey. \u201cWe Need Both Exploratory and Confirmatory,\u201d The American Statistician. Vol. 34, No. 1, pp. 23-25, 2009.","DOI":"10.1080\/00031305.1980.10482706"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_027","doi-asserted-by":"crossref","unstructured":"M. Barsalou, M. \u201cOne Good Idea: Mix it Up,\u201d Quality Progress. Vol. 47, No. 5, pp. 64, 2014.","DOI":"10.4324\/9781315831169-26"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_028","doi-asserted-by":"crossref","unstructured":"J. de Mast and M. Bergman. \u201cHypothesis Generation in Quality Improvement Projects: Approaches for Exploratory Studies,\u201d Quality and Reliability. Engineering International. Vol. 22, No. 7, pp. 839-850, 2006.","DOI":"10.1002\/qre.767"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_029","unstructured":"N.R. Tague. The Quality Toolbox (2nd ed.), Milwaukee, WI, The ASQ Quality Press, 2005."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_030","unstructured":"T. Gojanovic. \u201cBack to Basics: Painting the Big Picture,\u201d Quality Progress. Vol. 39, No. 9, pp. 95-96, 2006."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_031","unstructured":"G. Vining. and S.M. Kowalski. Statistical Methods for Engineers (2nd ed.), Belmont, CA, Thompson Higher Education, 2006."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_032","doi-asserted-by":"crossref","unstructured":"J. de Mast. and A. Trip. \u201cExploratory Data Analysis in Quality-Improvement Projects.\u201d Journal of Quality Technology. Vol. 39, No. 4, pp. 301-311, 2007.","DOI":"10.1080\/00224065.2007.11917697"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_033","unstructured":"R.D. Snee. \u201cMy Process is to Variable- Now What Do I do?,\u201d Quality Progress. Vol. 4, No. 2, pp. 65-68, 2001."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_034","unstructured":"R.D. Zaciewski and L. N\u2019meth. \u201cThe Multi-Vari Chart: An Underutilized Quality Tool,\u201d Quality Progress. Vol. 28, No. 10, pp. 81-83, 1995."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_035","doi-asserted-by":"crossref","unstructured":"J. de Mast, J. and A. Trip. \u201cExploratory Data Analysis in Quality-Improvement Projects.\u201d Journal of Quality Technology. Vol. 39, No. 4, pp. 301-311, 2007.","DOI":"10.1080\/00224065.2007.11917697"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_036","unstructured":"T.M. Kubiak, T.M, and D.W. Benbow. The Certified Six Sigma Blackbelt Handbook (2nd ed.), Milwaukee, WI, The ASQ Quality Press, 2009."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_037","doi-asserted-by":"crossref","unstructured":"F. Fagroud, F.Z., L. Ajallouda, E.H.B. Lahmar, H. Toumi, K. Achtaich, and S. El Filali. \u201cIOT Search Engines: Exploratory Data Analysis,\u201d Procedia Computer Science. Vol. 175, pp. 572-577, 2020.","DOI":"10.1016\/j.procs.2020.07.082"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_038","unstructured":"K. Dooley. \u201cUse PDSA for Crying Out Loud,\u201d Quality Progress. Vol. 30, No. 10, pp. 60-63, 1997."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_039","doi-asserted-by":"crossref","unstructured":"D.C. Hoaglin. \u201cJohn W. Tukey and Data Analysis,\u201d Statistical Science. Vol. 18, No. 3, pp. 311-318, 2003.","DOI":"10.1214\/ss\/1076102418"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_040","doi-asserted-by":"crossref","unstructured":"S. Coleman. \u201cDiscussion of \u2018Experiences with Big Data: Accounts From a Data Scientist\u2019s perspective\u2019,\u201d Quality Engineering. Vol. 32, No. 4, pp. 558-559, 2020.","DOI":"10.1080\/08982112.2020.1755687"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_041","doi-asserted-by":"crossref","unstructured":"W.A. Jensen. \u201cStatistics = Analytics?,\u201d Quality Engineering. Vol. 32, No. 2, pp. 133-144, 2020.","DOI":"10.1080\/08982112.2019.1633670"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_042","doi-asserted-by":"crossref","unstructured":"C.G. Machado, M. P. Winroth, and E. Hans D. R. da Silva. \u201cSustainable Manufacturing in Industry 4.0: An Emerging Research Agenda.\u201d International Journal of Production Research. Vol. 8, No. 5, pp. 1462-1484, 2020.","DOI":"10.1080\/00207543.2019.1652777"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_043","doi-asserted-by":"crossref","unstructured":"E.E. Broday. \u201cThe Evolution of Quality: From Inspection to Quality 4.0.\u201d International Journal of Quality and Service Sciences. Vol. 14, No. 3, pp. 368-382, 2022.","DOI":"10.1108\/IJQSS-09-2021-0121"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_044","doi-asserted-by":"crossref","unstructured":"A. Saihi, M. Awad, and M. Ben-Daya. \u201cQuality 4.0: Leveraging Industry 4.0 Technologies to Improve Quality Management Practices \u2013 A Systematic Review,\u201d International Journal of Quality and Reliability Management. Vol. 40, No. 2, pp. 628-650, 2023.","DOI":"10.1108\/IJQRM-09-2021-0305"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_045","doi-asserted-by":"crossref","unstructured":"E.E. Broday. \u201cThe Evolution of Quality: From Inspection to Quality 4.0.\u201d International Journal of Quality and Service Sciences. Vol. 14, No. 3, pp. 368-382, 2022.","DOI":"10.1108\/IJQSS-09-2021-0121"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_046","doi-asserted-by":"crossref","unstructured":"X. Ou, J. Huang, Q. Chang, S. Hucker, and J.G. Lovasz. \u201cFirst Time Quality Diagnostics and Improvement Through Data Analysis: A Study of a Crankshaft Line,\u201d Procedia Manufacturing. Vol. 49, pp. 2-8, 2020.","DOI":"10.1016\/j.promfg.2020.06.003"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_047","doi-asserted-by":"crossref","unstructured":"J.C. Bou and A. Satorra. \u201cMultivariate Exploratory Data Analysis for Large Databases: An Application to Modelling Firms\u2019 Innovation Using CIS Data,\u201d BRQ Business Research Quarterly. Vol. 22, No. 4, pp. 275-293, 2019.","DOI":"10.1016\/j.brq.2018.10.001"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_048","doi-asserted-by":"crossref","unstructured":"C.A. Escobar, D. Chakraborty, M. McGovern, D. Macias, and R. Morales-Menendez. \u201cQuality 4.0 \u2013 Green, Black and Master Black Belt Curricula,\u201d Procedia Manufacturing. Vol. 53, pp. 748-459, 2021.","DOI":"10.1016\/j.promfg.2021.06.085"},{"key":"2026042822072765438_j_mspe-2023-0050_ref_049","unstructured":"D.W. Benbow, and T.M. Kubiak. The Certified Six Sigma Black Belt Handbook. Milwaukee, WI, ASQ Quality Press, 2009."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_050","unstructured":"M.A. Barsalou and J. Smith. Applied Statistics Manual: A Guide to Improving and Sustaining Quality with Minitab, Milwaukee, WI, ASQ Quality Press, 2019."},{"key":"2026042822072765438_j_mspe-2023-0050_ref_051","unstructured":"M.A. Barsalou and J. Smith. Applied Statistics Manual: A Guide to Improving and Sustaining Quality with Minitab, Milwaukee, WI, ASQ Quality Press, 2019."}],"container-title":["Management Systems in Production Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/reference-global.com\/pdf\/10.2478\/mspe-2023-0050","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T01:38:48Z","timestamp":1777426728000},"score":1,"resource":{"primary":{"URL":"https:\/\/reference-global.com\/article\/10.2478\/mspe-2023-0050"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,1]]},"references-count":51,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,12,6]]},"published-print":{"date-parts":[[2023,12,1]]}},"alternative-id":["10.2478\/mspe-2023-0050"],"URL":"https:\/\/doi.org\/10.2478\/mspe-2023-0050","relation":{},"ISSN":["2450-5781"],"issn-type":[{"value":"2450-5781","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,1]]}}}