{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,4,28]],"date-time":"2024-04-28T19:40:03Z","timestamp":1714333203183},"reference-count":120,"publisher":"IGI Global","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2012,1,1]]},"abstract":"<p>Current and prospective students (n =133) were surveyed about their preferences for a name for a new online series of courses to be launched by a university. Preferences for each of five names were solicited by means of analytical ratings, holistic ratings, and rankings. All three techniques were employed to assure that the most appropriate name for the program was selected, but this also afforded us the opportunity to study several theoretical issues: (a) Do the different methods lead to discrepant decisions at the aggregate level? (b) Is the holistic rating or the analytical rating approach more closely related to the rankings? (c) To what extent is lack of agreement between ratings and rankings due to lack of differentiation in ratings? The authors find that at the aggregate level all three methods suggest the same name for the program; the holistic rating is slightly more highly correlated with the ranking; and the lack of differentiation in ratings is one reason producing inconsistencies between ratings and rankings.<\/p>","DOI":"10.4018\/ijtem.2012010105","type":"journal-article","created":{"date-parts":[[2012,8,27]],"date-time":"2012-08-27T20:59:45Z","timestamp":1346101185000},"page":"59-79","source":"Crossref","is-referenced-by-count":1,"title":["You Name It"],"prefix":"10.4018","volume":"2","author":[{"given":"Michael J.","family":"Roszkowski","sequence":"first","affiliation":[{"name":"La Salle University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Scott","family":"Spreat","sequence":"additional","affiliation":[{"name":"Woods Services, Inc., USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"2432","reference":[{"key":"ijtem.2012010105-0","doi-asserted-by":"publisher","DOI":"10.1086\/268949"},{"key":"ijtem.2012010105-1","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.655"},{"key":"ijtem.2012010105-2","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.503"},{"key":"ijtem.2012010105-3","doi-asserted-by":"publisher","DOI":"10.1016\/S0346-251X(01)00025-2"},{"key":"ijtem.2012010105-4","doi-asserted-by":"publisher","DOI":"10.1017\/S0272263100007282"},{"key":"ijtem.2012010105-5","doi-asserted-by":"publisher","DOI":"10.1177\/026553229501200206"},{"key":"ijtem.2012010105-6","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-4781.1986.tb05294.x"},{"key":"ijtem.2012010105-7","doi-asserted-by":"publisher","DOI":"10.1177\/0265532210368717"},{"key":"ijtem.2012010105-8","doi-asserted-by":"publisher","DOI":"10.2307\/3172632"},{"key":"ijtem.2012010105-9","doi-asserted-by":"publisher","DOI":"10.1509\/jmkr.38.2.143.18840"},{"key":"ijtem.2012010105-10","doi-asserted-by":"publisher","DOI":"10.1093\/ijpor\/6.3.264"},{"key":"ijtem.2012010105-11","doi-asserted-by":"publisher","DOI":"10.1016\/0148-2963(91)90033-T"},{"key":"ijtem.2012010105-12","doi-asserted-by":"publisher","DOI":"10.2307\/2785802"},{"key":"ijtem.2012010105-13","doi-asserted-by":"publisher","DOI":"10.1080\/00223980.1983.9923557"},{"key":"ijtem.2012010105-14","doi-asserted-by":"publisher","DOI":"10.1177\/026553229501200101"},{"key":"ijtem.2012010105-15","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-1770.1984.tb00350.x"},{"key":"ijtem.2012010105-16","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1988.tb00652.x"},{"key":"ijtem.2012010105-17","first-page":"207","article-title":"A comparison of the effects of analytic and holistic rating scale types in the context of composition tests.","volume":"11","author":"N. T.Carr","year":"2000","journal-title":"Issues in Applied Linguistics"},{"key":"ijtem.2012010105-18","doi-asserted-by":"publisher","DOI":"10.1027\/1015-5759.21.4.265"},{"key":"ijtem.2012010105-19","doi-asserted-by":"publisher","DOI":"10.1057\/bm.2010.53"},{"key":"ijtem.2012010105-20","doi-asserted-by":"crossref","first-page":"65","DOI":"10.58680\/rte198415687","article-title":"The validity of using holistic scoring to evaluate writing: A critical overview.","volume":"18","author":"D.Charney","year":"1984","journal-title":"Research in the Teaching of English"},{"key":"ijtem.2012010105-21","first-page":"109","article-title":"Reliability issues in holistic assessment","author":"R. D.Cherry","year":"1993","journal-title":"Validating holistic scoring for writing assessment: Theoretical and empirical foundations"},{"key":"ijtem.2012010105-22","doi-asserted-by":"publisher","DOI":"10.1207\/s15328007sem1102_5"},{"key":"ijtem.2012010105-23","doi-asserted-by":"publisher","DOI":"10.1177\/0013164490503003"},{"key":"ijtem.2012010105-24","doi-asserted-by":"publisher","DOI":"10.1207\/S15327906MBR3403_2"},{"key":"ijtem.2012010105-25","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.65.2.155"},{"key":"ijtem.2012010105-26","first-page":"279","article-title":"Global clinical performance rating, reliability and validity in an undergraduate clerkship.","volume":"63","author":"H. E. M.Daelmans","year":"2005","journal-title":"The Netherlands Journal of Medicine"},{"key":"ijtem.2012010105-27","doi-asserted-by":"publisher","DOI":"10.1177\/00131640021970736"},{"key":"ijtem.2012010105-28","doi-asserted-by":"publisher","DOI":"10.1145\/1531793.1531816"},{"key":"ijtem.2012010105-29","author":"D.Douglas","year":"1997","journal-title":"Theoretical underpinnings of the Test of Spoken English revision project (TOEFL Monograph Series No. 9)"},{"key":"ijtem.2012010105-30","unstructured":"Driesener, C., & Romaniuk, J. (2002, December). A comparison of perceptual mapping using ranking, rating and pick any techniques. Paper presented at the Australian and New Zealand Marketing Academy Conference, Melbourne, Australia."},{"key":"ijtem.2012010105-31","doi-asserted-by":"publisher","DOI":"10.1177\/0265532207086780"},{"key":"ijtem.2012010105-32","doi-asserted-by":"publisher","DOI":"10.1207\/s15434311laq0203_1"},{"key":"ijtem.2012010105-33","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/978-1-4020-4489-2_8","article-title":"The testing of speaking in a second language","author":"G.Fulcher","year":"1997","journal-title":"Encyclopedia of language and education, 7. Language testing and assessment"},{"key":"ijtem.2012010105-34","doi-asserted-by":"publisher","DOI":"10.1108\/01409170710823449"},{"key":"ijtem.2012010105-35","doi-asserted-by":"publisher","DOI":"10.1007\/BF02278252"},{"issue":"2","key":"ijtem.2012010105-36","first-page":"73","article-title":"Relationship of analytic and holistic methods to raters\u2019 scores for speeches.","volume":"27","author":"N. R.Goulden","year":"1994","journal-title":"Journal of Research and Development in Education"},{"key":"ijtem.2012010105-37","doi-asserted-by":"publisher","DOI":"10.1080\/01608060802100899"},{"key":"ijtem.2012010105-38","doi-asserted-by":"publisher","DOI":"10.2307\/3588173"},{"key":"ijtem.2012010105-39","doi-asserted-by":"publisher","DOI":"10.1002\/1099-1379(200011)21:7<829::AID-JOB30>3.0.CO;2-4"},{"key":"ijtem.2012010105-40","unstructured":"Harvey, R. J., Wilson, M. A., Blunt, J. H., & Morris, P. (1994, April). Rational\/holistic versus empirical\/decomposed methods of rating general work behaviors. Paper presented at the Conference of the Society for Industrial and Organizational Psychology, Nashville, TN."},{"key":"ijtem.2012010105-41","doi-asserted-by":"publisher","DOI":"10.1016\/j.ibusrev.2009.03.001"},{"key":"ijtem.2012010105-42","doi-asserted-by":"publisher","DOI":"10.1177\/1470595806066332"},{"key":"ijtem.2012010105-43","unstructured":"Haswell, R. H. (1988, April). Contrasting ways to appraise improvement in a writing course: Paired comparison and holistic. Paper presented at the College Composition and Communication Conference, St. Louis, MO."},{"key":"ijtem.2012010105-44","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1986.tb00596.x"},{"key":"ijtem.2012010105-45","unstructured":"Hino, A., & Imai, R. (2008, August). Ranking vs. rating: Re-examining the Inglehart scale through an experimental survey. Paper presented at the 104th Annual Meeting of the American Political Science Association, Boston, MA."},{"key":"ijtem.2012010105-46","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/cmh419"},{"key":"ijtem.2012010105-47","doi-asserted-by":"publisher","DOI":"10.1006\/obhd.1996.0077"},{"key":"ijtem.2012010105-48","doi-asserted-by":"publisher","DOI":"10.2307\/358160"},{"key":"ijtem.2012010105-49","first-page":"206","article-title":"The influence of holistic scoring procedures on reading and rating student essays","author":"B.Huot","year":"1993","journal-title":"Validating holistic scoring for writing assessment: Theoretical and empirical foundations"},{"key":"ijtem.2012010105-50","first-page":"220","article-title":"Assessing speaking proficiency in the International English Language Testing System","author":"D.Ingram","year":"1993","journal-title":"A new decade of language testing research: Selected papers from the 1990 Language Testing Research Colloquium"},{"key":"ijtem.2012010105-51","doi-asserted-by":"publisher","DOI":"10.1177\/004912418000900206"},{"key":"ijtem.2012010105-52","doi-asserted-by":"publisher","DOI":"10.5993\/AJHB.23.5.5"},{"key":"ijtem.2012010105-53","doi-asserted-by":"publisher","DOI":"10.1016\/S0149-7189(03)00053-3"},{"key":"ijtem.2012010105-54","author":"L. R.Kahle","year":"1983","journal-title":"Social values and social change: Adaptation to life in America"},{"key":"ijtem.2012010105-55","doi-asserted-by":"crossref","unstructured":"Karapanos, E., Martens, J.-B., & Hassenzahl, M. (2009, April 4-9). Accounting for diversity in subjective judgments. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (pp. 639-648).","DOI":"10.1145\/1518701.1518801"},{"key":"ijtem.2012010105-56","doi-asserted-by":"publisher","DOI":"10.1093\/ijpor\/edh041"},{"key":"ijtem.2012010105-57","doi-asserted-by":"publisher","DOI":"10.1207\/s15324818ame1102_1"},{"key":"ijtem.2012010105-58","doi-asserted-by":"publisher","DOI":"10.1108\/13522750710819694"},{"key":"ijtem.2012010105-59","doi-asserted-by":"publisher","DOI":"10.1086\/269128"},{"key":"ijtem.2012010105-60","unstructured":"Krosnick, J. A., Thomas, R. K., & Shaeffer, E. M. (2003, May). How does ranking rate? A comparison of ranking and rating tasks. Paper presented at the Annual Meeting of the American Association for Public Opinion Research, Nashville, TN."},{"key":"ijtem.2012010105-61","doi-asserted-by":"publisher","DOI":"10.1037\/0278-6133.27.6.669"},{"key":"ijtem.2012010105-62","doi-asserted-by":"publisher","DOI":"10.1179\/096979599799155867"},{"key":"ijtem.2012010105-63","doi-asserted-by":"publisher","DOI":"10.1002\/mar.20197"},{"key":"ijtem.2012010105-64","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(82)90240-9"},{"key":"ijtem.2012010105-65","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X9901900201"},{"key":"ijtem.2012010105-66","doi-asserted-by":"publisher","DOI":"10.1207\/s15324834basp1802_4"},{"key":"ijtem.2012010105-67","unstructured":"Marzano, R. (1975). On the validity of analytic ratings. Unpublished study prepared at the University of Colorado at Denver, Denver, CO."},{"key":"ijtem.2012010105-68","doi-asserted-by":"publisher","DOI":"10.1086\/317989"},{"key":"ijtem.2012010105-69","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1080\/00220671.1970.10884123","article-title":"What does educational research say about the judging of writing ability?","volume":"64","author":"W.McColly","year":"1970","journal-title":"The Journal of Educational Research"},{"key":"ijtem.2012010105-70","doi-asserted-by":"publisher","DOI":"10.2307\/3151210"},{"key":"ijtem.2012010105-71","doi-asserted-by":"publisher","DOI":"10.3758\/BF03203389"},{"key":"ijtem.2012010105-72","first-page":"4","article-title":"Holistic scoring of essays: remedy for evaluating the third R.","volume":"8","author":"C.Mishler","year":"1982","journal-title":"Diagnostique"},{"key":"ijtem.2012010105-73","doi-asserted-by":"publisher","DOI":"10.1006\/obhd.1998.2791"},{"key":"ijtem.2012010105-74","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.374"},{"key":"ijtem.2012010105-75","doi-asserted-by":"publisher","DOI":"10.1002\/1099-1379(200011)21:7<819::AID-JOB29>3.0.CO;2-I"},{"key":"ijtem.2012010105-76","doi-asserted-by":"publisher","DOI":"10.2307\/3150873"},{"key":"ijtem.2012010105-77","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2923.2002.01290.x"},{"key":"ijtem.2012010105-78","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1988.tb00642.x"},{"key":"ijtem.2012010105-79","doi-asserted-by":"publisher","DOI":"10.1016\/j.nedt.2008.06.011"},{"key":"ijtem.2012010105-80","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.108.2.291"},{"key":"ijtem.2012010105-81","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1177\/026553229801500204","article-title":"Scaling descriptors for language proficiency scales.","volume":"15","author":"B.North","year":"1998","journal-title":"Language Testing"},{"key":"ijtem.2012010105-82","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2621.1980.tb02624.x"},{"key":"ijtem.2012010105-83","doi-asserted-by":"publisher","DOI":"10.1080\/87567550109595859"},{"key":"ijtem.2012010105-84","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhealeco.2005.04.001"},{"key":"ijtem.2012010105-85","doi-asserted-by":"crossref","unstructured":"Olson, D. M. (1988). The reliability of analytic and holistic methods in rating students' computer programs. In Proceedings of the Nineteenth SIGCSE Technical Symposium on Computer Science Education (pp. 293-298).","DOI":"10.1145\/52965.53037"},{"key":"ijtem.2012010105-86","doi-asserted-by":"publisher","DOI":"10.1080\/1364557032000081654"},{"key":"ijtem.2012010105-87","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/B978-0-12-590241-0.50006-X","article-title":"Measurement and control of response bias","author":"D. L.Paulhus","year":"1991","journal-title":"Measures of personality and social psychological attitudes"},{"key":"ijtem.2012010105-88","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.2.4.329"},{"key":"ijtem.2012010105-89","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1093\/biomet\/31.1-2.9","article-title":"A note on normal correlation.","volume":"31","author":"E. J. G.Pitman","year":"1939","journal-title":"Biometrika"},{"key":"ijtem.2012010105-90","doi-asserted-by":"publisher","DOI":"10.1002\/ejsp.2420100303"},{"key":"ijtem.2012010105-91","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.3960050302"},{"key":"ijtem.2012010105-92","doi-asserted-by":"publisher","DOI":"10.1207\/s15324818ame0702_4"},{"key":"ijtem.2012010105-93","doi-asserted-by":"publisher","DOI":"10.1007\/BF01013611"},{"key":"ijtem.2012010105-94","doi-asserted-by":"publisher","DOI":"10.1080\/08841241.2010.526354"},{"key":"ijtem.2012010105-95","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8295.1994.tb02509.x"},{"key":"ijtem.2012010105-96","doi-asserted-by":"publisher","DOI":"10.1007\/BF02230986"},{"key":"ijtem.2012010105-97","doi-asserted-by":"publisher","DOI":"10.1002\/1099-1379(200011)21:7<809::AID-JOB28>3.0.CO;2-O"},{"key":"ijtem.2012010105-98","doi-asserted-by":"publisher","DOI":"10.1177\/0265532207077205"},{"key":"ijtem.2012010105-99","doi-asserted-by":"publisher","DOI":"10.1080\/01421590801952994"},{"key":"ijtem.2012010105-100","author":"H.Shuman","year":"1981","journal-title":"Questions and answers in attitude surveys"},{"key":"ijtem.2012010105-101","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011478224834"},{"key":"ijtem.2012010105-102","doi-asserted-by":"publisher","DOI":"10.1177\/002242940705500307"},{"key":"ijtem.2012010105-103","doi-asserted-by":"publisher","DOI":"10.1080\/00986280902739776"},{"key":"ijtem.2012010105-104","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(81)90015-5"},{"key":"ijtem.2012010105-105","doi-asserted-by":"publisher","DOI":"10.1177\/00131649921970008"},{"key":"ijtem.2012010105-106","unstructured":"Thomas, R. K. (2011, July). Vive la diff\u00e9rence: What are the implications of response non-differentiation in web-based studies? Paper presented at the Fourth Conference of the European Survey Research Association, Lausanne, Switzerland."},{"key":"ijtem.2012010105-107","doi-asserted-by":"publisher","DOI":"10.1080\/00224545.1987.9713684"},{"key":"ijtem.2012010105-108","doi-asserted-by":"publisher","DOI":"10.1086\/461604"},{"key":"ijtem.2012010105-109","first-page":"407","article-title":"Ranking the ratings: The case of materialist and post-materialist value orientations.","volume":"9","author":"W.Van Deth","year":"1983","journal-title":"Political Methodology"},{"key":"ijtem.2012010105-110","doi-asserted-by":"publisher","DOI":"10.1016\/j.foodqual.2007.05.006"},{"key":"ijtem.2012010105-111","doi-asserted-by":"crossref","first-page":"290","DOI":"10.58680\/rte198315709","article-title":"Direct and indirect measures for large-scale evaluation of writing.","volume":"17","author":"L. R.Veal","year":"1983","journal-title":"Research in the Teaching of English"},{"key":"ijtem.2012010105-112","doi-asserted-by":"publisher","DOI":"10.1037\/h0036520"},{"key":"ijtem.2012010105-113","doi-asserted-by":"publisher","DOI":"10.1037\/h0036648"},{"key":"ijtem.2012010105-114","doi-asserted-by":"publisher","DOI":"10.1177\/026553229401100206"},{"key":"ijtem.2012010105-115","doi-asserted-by":"publisher","DOI":"10.1177\/026553229801500205"},{"key":"ijtem.2012010105-116","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511732997"},{"key":"ijtem.2012010105-117","doi-asserted-by":"publisher","DOI":"10.2307\/357792"},{"key":"ijtem.2012010105-118","doi-asserted-by":"publisher","DOI":"10.1207\/S15328015TLM1504_11"},{"key":"ijtem.2012010105-119","doi-asserted-by":"publisher","DOI":"10.1177\/0265532207076365"}],"container-title":["International Journal of Technology and Educational Marketing"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=65727","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,28]],"date-time":"2024-04-28T19:11:14Z","timestamp":1714331474000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/ijtem.2012010105"}},"subtitle":["Comparing Holistic and Analytical Rating Methods of Eliciting Preferences in Naming an Online Program Using Ranks as a Concurrent Validity Criterion"],"short-title":[],"issued":{"date-parts":[[2012,1,1]]},"references-count":120,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,1]]}},"URL":"https:\/\/doi.org\/10.4018\/ijtem.2012010105","relation":{},"ISSN":["2155-5605","2155-5613"],"issn-type":[{"value":"2155-5605","type":"print"},{"value":"2155-5613","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,1,1]]}}}