{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T17:06:14Z","timestamp":1781888774623,"version":"3.54.5"},"reference-count":62,"publisher":"Emerald","issue":"6","license":[{"start":{"date-parts":[[2020,6,1]],"date-time":"2020-06-01T00:00:00Z","timestamp":1590969600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JEIM"],"published-print":{"date-parts":[[2020,6,1]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>The companies are struggling to collect invoices due to the decrease in the economic growth. This global trend does not only affect undeveloped countries, but it also has a strong impact on the developed countries. Improving the debt collection process become a significant element to maintain financial stability. The institutions that are specialized on collecting payments, debt collection agencies and their call centers, with their expertise in the field can improve the payment process. Yet, managing evaluating the performance of debt collection agencies is a very hard process that involves uncertainty and imprecision. Performance measurement (PM) is a combination of numerically expressed characteristics which give insight about the success or degree of accomplishment of an activity. PM can be handled in various levels such as individual, team, department or company. The aim of this study is to present a systematic and objective PM method for call centers.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>In this study, first an exploratory approach is used to understand the call center measurement problem. Several meetings are done with the representatives of both call center firms and the parent firms that outsource debt collection process. Simultaneously, a broad literature review is conducted. An iterative approach is selected to reach deeper knowledge on the process. New meetings are planned and scope of the literature review has changed based on this iterative approach. After these steps, the problem has been considered as the multi-criteria decision-making problem since more than one criteria should be considered for evaluating the performances of call centers. The result of the literature review and the meetings with experts show that defining the weights for the criteria is very crucial for evaluating the performances accurately. Collecting human judgment for defining the weights of call center criteria necessitates dealing with vagueness and uncertainty. The intuitionistic fuzzy sets excellent tools for representing uncertainty. Interval valued intuitionistic fuzzy sets can easily represent the human judgments. Thus, in this study, an intuitionistic fuzzy multi-criteria decision making approach is used to design the proposed methodology. Incomplete interval-valued intuitionistic preference relations are used to determine the weights of the indicators aggregating linguistic evaluations of the decision makers.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>The proposed approach provides an objective calculation of performance measurement. In order to provide objectivity, indicator performance functions are proposed for the first time in this study. Nine different functions and related parameters are defined to objectively measure indicator performances.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>The paper proposes an objective and easy-to-modify approach for call-center PM, which can be used by call center managers. It presents a new fuzzy multi-criteria decision-making (MCDM) method for call center performance evaluation, which can consider the multi-experts' judgments under vagueness and impreciseness, which may be conflicting and incomplete interval-valued intuitionistic fuzzy preference relations. Also nine new functions are defined for indicator performance.<\/jats:p><\/jats:sec>","DOI":"10.1108\/jeim-04-2017-0050","type":"journal-article","created":{"date-parts":[[2020,6,1]],"date-time":"2020-06-01T06:51:51Z","timestamp":1590994311000},"page":"1647-1668","source":"Crossref","is-referenced-by-count":14,"title":["Call center performance measurement using intuitionistic fuzzy sets"],"prefix":"10.1108","volume":"33","author":[{"given":"Basar","family":"Oztaysi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sezi","family":"Cevik Onar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cengiz","family":"Kahraman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muharrem","family":"Gok","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"140","reference":[{"key":"key2020120705100642400_ref060","article-title":"n Analytical Performance Management Framework Enabling Enterprise Strategy Management, PhD thesis","year":"2006"},{"issue":"3","key":"key2020120705100642400_ref001","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1016\/j.ejor.2013.10.064","article-title":"Call center service process analysis: bayesian parametric and semi-parametric mixture modeling","volume":"234","year":"2014","journal-title":"European Journal of Operational Research"},{"key":"key2020120705100642400_ref002","article-title":"Performance measurement of insurance companies by using balanced scorecard and ANP","year":"2009"},{"issue":"2","key":"key2020120705100642400_ref003","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.eij.2013.03.001","article-title":"Assessing call centers\u2019 success: a validation of the DeLone and Mclean model for information system","volume":"14","year":"2013","journal-title":"Egyptian Informatics Journal"},{"issue":"1","key":"key2020120705100642400_ref004","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.eij.2014.11.004","article-title":"Information systems performance evaluation, introducing a two-level technique: case study call centers","volume":"16","year":"2015","journal-title":"Egyptian Informatics Journal"},{"key":"key2020120705100642400_ref005","first-page":"113","article-title":"Performance measurement practices in airports: multidimensionality and utilization patterns","volume":"70","year":"2019","journal-title":"Journal of Air Transport Management"},{"issue":"4","key":"key2020120705100642400_ref006","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1108\/JEIM-01-2018-0020","article-title":"Pythagorean fuzzy CODAS and its application to supplier selection in a anufacturing firm","volume":"31","year":"2018","journal-title":"Journal of Enterprise Information Management"},{"key":"key2020120705100642400_ref007","first-page":"271","article-title":"Multi-attribute warehouse location selection in humanitarian logistics using hesitant fuzzy AHP","volume":"8","year":"2016","journal-title":"International Journal of the Analytic Hierarchy Process"},{"issue":"6","key":"key2020120705100642400_ref008","first-page":"64","article-title":"A preference ranking organization method: the Promethee method for MCDM","volume":"31","year":"1985","journal-title":"Management Science"},{"key":"key2020120705100642400_ref009","doi-asserted-by":"crossref","first-page":"100537","DOI":"10.1016\/j.seta.2019.100537","article-title":"An assessment of the mesoscale to microscale influences on wind turbine energy performance at a peri-urban coastal location from the Irish wind atlas and onsite LiDAR measurements","volume":"36","year":"2019","journal-title":"Sustainable Energy Technologies and Assessments"},{"issue":"4","key":"key2020120705100642400_ref010","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1108\/JEIM-01-2018-0017","article-title":"CNC router selection for SMEs in woodwork anufacturing using hesitant fuzzy AHP method","volume":"31","year":"2018","journal-title":"Journal of Enterprise Information Management"},{"issue":"1","key":"key2020120705100642400_ref011","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1108\/JEIM-03-2017-0046","article-title":"A new weighted fuzzy information axiom method in production research","volume":"32","year":"2019","journal-title":"Journal of Enterprise Information Management"},{"key":"key2020120705100642400_ref012","doi-asserted-by":"crossref","unstructured":"Cevik Onar, S., Oztaysi, B. and Kahraman, C. (2017), Dynamic intuitionistic fuzzy multi-attribute aftersales performance evaluation, Dynamic intuitionistic fuzzy multi-attribute aftersales performance evaluation.","DOI":"10.1142\/9789813146976_0131"},{"issue":"4","key":"key2020120705100642400_ref013","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1080\/07421222.2003.11045748","article-title":"The DeLone and McLean model of information systems success: a ten-year update","volume":"19","year":"2003","journal-title":"Journal of Management Information Systems"},{"issue":"6","key":"key2020120705100642400_ref014","doi-asserted-by":"crossref","first-page":"820","DOI":"10.1108\/JEIM-02-2018-0029","article-title":"A GIS-based interval type-2 fuzzy set for public bread factory site selection","volume":"31","year":"2018","journal-title":"Journal of Enterprise Information Management"},{"issue":"4","key":"key2020120705100642400_ref015","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1108\/JEIM-02-2018-0035","article-title":"In-store behavioral analytics technology selection using fuzzy decision making","volume":"31","year":"2018","journal-title":"Journal of Enterprise Information Management"},{"issue":"6","key":"key2020120705100642400_ref016","doi-asserted-by":"crossref","first-page":"950","DOI":"10.1108\/JEIM-12-2016-0195","article-title":"Stochastic AHP and fuzzy VIKOR approach for warehouse location selection problem","volume":"31","year":"2018","journal-title":"Journal of Enterprise Information Management"},{"issue":"2","key":"key2020120705100642400_ref017","doi-asserted-by":"crossref","first-page":"1155","DOI":"10.3233\/JIFS-16727","article-title":"Selecting firms in university technoparks: a hesitant linguistic fuzzy TOPSIS model for heterogeneous contexts","volume":"33","year":"2017","journal-title":"Journal of Intelligent and Fuzzy Systems"},{"issue":"7","key":"key2020120705100642400_ref018","doi-asserted-by":"crossref","first-page":"1622","DOI":"10.1016\/j.jbusres.2015.02.006","article-title":"Organizational factors and customers' motivation effect on insurance companies' performance","volume":"68","year":"2015","journal-title":"Journal of Business Research"},{"issue":"7","key":"key2020120705100642400_ref075","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.compind.2007.05.002","article-title":"Performance: Its meaning and content for today's business research","volume":"58","year":"2007","journal-title":"Computers in Industry"},{"key":"key2020120705100642400_ref019","unstructured":"Gartner (2017), Gartner IT Glossary, available at: http:\/\/www.gartner.com\/it-glossary\/contact-center-systems (accessed 10 January 2017)."},{"key":"key2020120705100642400_ref020","first-page":"261","article-title":"Development of a performance measurement system to choose the most efficient programs, the case of the Mashhad transportation system","volume":"106","year":"2017","journal-title":"Transportation Research Part A: Policy and Practice"},{"key":"key2020120705100642400_ref021","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.ssci.2015.11.009","article-title":"Exploring the state of health and safety management system performance measurement in mining organizations","volume":"83","year":"2016","journal-title":"Safety Science"},{"key":"key2020120705100642400_ref022","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.ijpe.2018.09.021","article-title":"The evolution of performance measurement systems in a supply chain: a longitudinal case study on the role of interorganisational factors","volume":"205","year":"2018","journal-title":"International Journal of Production Economics"},{"issue":"4","key":"key2020120705100642400_ref023","first-page":"2804","article-title":"Total factor carbon emission performance measurement and development","volume":"142","year":"2017","journal-title":"Journal of Cleaner Production"},{"key":"key2020120705100642400_ref024","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1016\/j.promfg.2017.02.072","article-title":"Sustainable manufacturing performance evaluation: integrating product and process metrics for systems level assessment","volume":"8","year":"2017","journal-title":"Procedia Manufacturing"},{"key":"key2020120705100642400_ref025","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1016\/j.tourman.2016.09.008","article-title":"Sustainability performance assessment focusing on coral reef protection by the tourism industry in the Coral Triangle region","volume":"59","year":"2017","journal-title":"Tourism Management"},{"issue":"101707","key":"key2020120705100642400_ref026","article-title":"Performance measurement of airports using data envelopment analysis: a review of methods and findings","volume":"81","year":"2019","journal-title":"Journal of Air Transport Management"},{"issue":"2","key":"key2020120705100642400_ref027","doi-asserted-by":"crossref","first-page":"118","DOI":"10.3390\/su8020118","article-title":"A comparison of wind energy investment alternatives using interval-valued intuitionistic fuzzy benefit\/cost analysis","volume":"8","year":"2016","journal-title":"Sustainability"},{"key":"key2020120705100642400_ref028","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1016\/j.cie.2016.12.012","article-title":"Extension of information axiom from ordinary to intuitionistic fuzzy sets: an application to search algorithm selection","volume":"105","year":"2017","journal-title":"Computers and Industrial Engineering"},{"key":"key2020120705100642400_ref029","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.engappai.2017.09.009","article-title":"A novel trapezoidal intuitionistic fuzzy information axiom approach: an application to multicriteria landfill site selection","volume":"67","year":"2018","journal-title":"Engineering Applications of Artificial Intelligence"},{"issue":"4","key":"key2020120705100642400_ref030","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1108\/JEIM-01-2018-0001","article-title":"Prioritization of production strategies of a manufacturing plant by using an integrated intuitionistic fuzzy AHP and TOPSIS approach","volume":"31","year":"2018","journal-title":"Journal of Enterprise Information Management"},{"issue":"6","key":"key2020120705100642400_ref031","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1108\/JEIM-01-2017-0015","article-title":"Analyzing Workforce 4.0 in the Fourth Industrial Revolution and proposing a road map from operations management perspective with fuzzy DEMATEL","volume":"31","year":"2018","journal-title":"Journal of Enterprise Information Management"},{"key":"key2020120705100642400_ref032","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1016\/j.apenergy.2016.12.034","article-title":"Cloud computing platform for real-time measurement and verification of energy performance","volume":"188","year":"2017","journal-title":"Applied Energy"},{"issue":"4","key":"key2020120705100642400_ref033","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1016\/j.indmarman.2008.04.008","article-title":"A CRM performance measurement framework: its development process and application","volume":"38","year":"2009","journal-title":"Industrial Marketing Management"},{"issue":"1","key":"key2020120705100642400_ref034","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.simpat.2010.07.002","article-title":"Using SOM in the performance monitoring of the emergency call-taking system","volume":"19","year":"2011","journal-title":"Simulation Modelling Practice and Theory"},{"key":"key2020120705100642400_ref035","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.jretconser.2016.11.004","article-title":"Ethical work climate, employee commitment and proactive customer service performance: test of the mediating effects of organizational politics","volume":"35","year":"2017","journal-title":"Journal of Retailing and Consumer Services"},{"issue":"1-3","key":"key2020120705100642400_ref081","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/0925-5273(95)00081-X","article-title":"Performance measurement and performance management","volume":"41","year":"1995","journal-title":"International Journal of Production, Economics"},{"key":"key2020120705100642400_ref036","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.ijpe.2018.04.005","article-title":"Contingency factors and complementary effects of adopting advanced manufacturing tools and managerial practices: effects on organizational measurement systems and firms' performance","volume":"200","year":"2018","journal-title":"International Journal of Production Economics"},{"issue":"1","key":"key2020120705100642400_ref037","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.simpat.2010.06.008","article-title":"Performance assessment in an interactive call center workforce simulation","volume":"19","year":"2011","journal-title":"Simulation Modelling Practice and Theory"},{"issue":"Part A","key":"key2020120705100642400_ref038","first-page":"299","article-title":"Supply chain performance measurement systems: a systematic review and research agenda","volume":"183","year":"2017","journal-title":"International Journal of Production Economics"},{"key":"key2020120705100642400_ref039","volume-title":"Rethinking Performance Measurement: Beyond the Balanced Scorecard","year":"2002"},{"key":"key2020120705100642400_ref040","doi-asserted-by":"crossref","first-page":"S40","DOI":"10.1016\/j.paid.2013.07.106","article-title":"Predicting performance at call-centres: work climate, exercise frequency and temperance","volume":"60","year":"2014","journal-title":"Personality and Individual Differences"},{"issue":"4","key":"key2020120705100642400_ref041","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1504\/IJAMS.2012.049929","article-title":"Performance measurement of a manufacturing company using fuzzy analytical network process","volume":"4","year":"2012","journal-title":"International Journal of Applied Management Science"},{"key":"key2020120705100642400_ref042","first-page":"199","article-title":"Supply chain performance measurement using a SCOR based fuzzy VIKOR approach","volume-title":"Supply Chain Management under Fuzziness","year":"2014"},{"key":"key2020120705100642400_ref043","article-title":"Comparison of MADM techniques usage in performance measurement","year":"2009"},{"issue":"8","key":"key2020120705100642400_ref044","doi-asserted-by":"crossref","first-page":"9788","DOI":"10.1016\/j.eswa.2011.01.170","article-title":"Performance comparison based on customer relationship management using analytic network process","volume":"38","year":"2011","journal-title":"Expert Systems with Applications"},{"key":"key2020120705100642400_ref045","first-page":"1203","article-title":"Evaluation of research proposals for grant funding using interval-valued intuitionistic fuzzy sets","volume":"21","year":"2015","journal-title":"Soft Computing"},{"key":"key2020120705100642400_ref046","unstructured":"Payment practices barometer Turkey (2019), available at: https:\/\/group.atradius.com\/publications\/payment-practices-barometer-turkey-2019.html."},{"key":"key2020120705100642400_ref047","unstructured":"Payment practices barometer Western Europe (2019), available at: https:\/\/group.atradius.com\/publications\/payment-practices-barometer-western-europe-2019."},{"key":"key2020120705100642400_ref048","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.peva.2014.03.001","article-title":"Performance analysis of call centers with abandonment, retrial and after-call work","volume":"80","year":"2014","journal-title":"Performance Evaluation"},{"issue":"2","key":"key2020120705100642400_ref049","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.jvoice.2011.02.006","article-title":"Vocal symptoms, voice activity, and participation profile and professional performance of call center operators","volume":"26","year":"2012","journal-title":"Journal of Voice"},{"issue":"2","key":"key2020120705100642400_ref050","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1002\/dir.1008","article-title":"Role stress in call centers: its effects on employee performance and satisfaction","volume":"15","year":"2001","journal-title":"Journal of Interactive Marketing"},{"key":"key2020120705100642400_ref051","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.tourman.2016.07.002","article-title":"Performance measurement in tourism firms: a content analytical meta-approach","volume":"59","year":"2017","journal-title":"Tourism Management"},{"key":"key2020120705100642400_ref052","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.oceaneng.2015.05.015","article-title":"Evaluation of ship performance in international maritime transportation using an onboard measurement system - in case of a bulk carrier in international voyages","volume":"104","year":"2015","journal-title":"Ocean Engineering"},{"issue":"2014","key":"key2020120705100642400_ref053","first-page":"75","article-title":"The relationship between emotional intelligence and job performance of call centre agents","volume":"129","year":"2014","journal-title":"Procedia - Social and Behavioral Sciences"},{"issue":"1","key":"key2020120705100642400_ref054","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/S0148-2963(02)00281-3","article-title":"Performance, satisfaction and turnover in call centers: the effects of stress and optimism","volume":"57","year":"2004","journal-title":"Journal of Business Research"},{"issue":"11","key":"key2020120705100642400_ref055","doi-asserted-by":"crossref","first-page":"9939","DOI":"10.1016\/j.eswa.2011.11.126","article-title":"Job performance prediction in a call center using a naive Bayes classifier","volume":"39","year":"2012","journal-title":"Expert Systems With Applications"},{"issue":"1","key":"key2020120705100642400_ref056","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.jm.2003.01.007","article-title":"When conscientiousness isn\u2019t enough: emotional exhaustion and performance among call center customer service representatives","volume":"30","year":"2004","journal-title":"Journal of Management"},{"key":"key2020120705100642400_ref057","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1080\/03081070903210630","article-title":"Incomplete interval-valued intuitionistic preference relations","volume":"38","year":"2009","journal-title":"International Journal of General Systems"},{"issue":"4","key":"key2020120705100642400_ref058","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/S1874-8651(08)60026-5","article-title":"An approach to group decision making based on interval-valued intuitionistic judgment matrices","volume":"27","year":"2007","journal-title":"Systems Engineering\u2013Theory and Practice"},{"key":"key2020120705100642400_ref059","doi-asserted-by":"crossref","first-page":"1258","DOI":"10.1016\/j.jclepro.2019.05.330","article-title":"Carbon emissions performance in logistics at the city level","volume":"231","year":"2019","journal-title":"Journal of Cleaner Production"}],"container-title":["Journal of Enterprise Information Management"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JEIM-04-2017-0050\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JEIM-04-2017-0050\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:31:12Z","timestamp":1753396272000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jeim\/article\/33\/6\/1647-1668\/434271"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,1]]},"references-count":62,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,6,1]]}},"alternative-id":["10.1108\/JEIM-04-2017-0050"],"URL":"https:\/\/doi.org\/10.1108\/jeim-04-2017-0050","relation":{},"ISSN":["1741-0398"],"issn-type":[{"value":"1741-0398","type":"print"}],"subject":[],"published":{"date-parts":[[2020,6,1]]}}}