{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,6,2]],"date-time":"2022-06-02T05:11:35Z","timestamp":1654146695997},"reference-count":12,"publisher":"IGI Global","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2014,10,1]]},"abstract":"<p>In this paper, a new approach is proposed for the design of test data for pattern recognition systems. In the theoretical framework put forward, performance on the population of data is viewed as expectation of a random variable, and the purpose of test is to estimate the parameter. While the most popular method of test data design is random sampling, a novel approach based on performance influencing classes is proposed, which can achieve unbiased estimation and the variance of estimation is much lower than that from random sample. The method is applied to the evaluation of systems for broadcasting news segmentation, and experimental results show the advantages over the random sampling approach.<\/p>","DOI":"10.4018\/ijapuc.2014100104","type":"journal-article","created":{"date-parts":[[2015,6,15]],"date-time":"2015-06-15T19:46:27Z","timestamp":1434397587000},"page":"43-62","source":"Crossref","is-referenced-by-count":0,"title":["The PIC-TDD Framework of Test Data Design for Pattern Recognition Systems"],"prefix":"10.4018","volume":"6","author":[{"given":"Xiangdong","family":"Wang","sequence":"first","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China"}]},{"given":"Ying","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Information and Electrical Engineering, China Agricultural University, Beijing, China"}]},{"given":"Hong","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China"}]},{"given":"Yueliang","family":"Qian","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China"}]}],"member":"2432","reference":[{"key":"ijapuc.2014100104-0","doi-asserted-by":"publisher","DOI":"10.1002\/0471249688"},{"key":"ijapuc.2014100104-1","article-title":"The Rich Transcription 2009 Speech-To-Text (STT) and Speaker Attributed STT (SASTT) Results.","author":"J.Ajot","year":"2009","journal-title":"Proc. 2009 Rich Transcription Evaluation Workshop"},{"key":"ijapuc.2014100104-2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSLP.1996.607317"},{"key":"ijapuc.2014100104-3","first-page":"899","article-title":"The Design for the Wall Street Journal-based CSR Corpus.","author":"B. P.Douglas","year":"1992","journal-title":"Proceedings of Second International Conference on Spoken Language Processing"},{"key":"ijapuc.2014100104-4","unstructured":"Li, M. (2007) Automatic Annotation of Broadcasting News. Master\u2019s thesis. Institute of Computing Technology, Chinese Academy of Sciences."},{"key":"ijapuc.2014100104-5","article-title":"Optimal Selection of Speech Data for Automatic Speech Recognition Systems.","author":"A. B.Nagorski","year":"2002","journal-title":"Proceedings of ICSLP"},{"key":"ijapuc.2014100104-6","doi-asserted-by":"publisher","DOI":"10.1109\/ASRU.2003.1318511"},{"key":"ijapuc.2014100104-7","first-page":"29","article-title":"The Aurora Experimental Framework for the Performance Evaluation of Speech Recognition Systems under Noisy Conditions.","author":"D.Pearce","year":"2000","journal-title":"Proceedings of 6th International Conference on Spoken Language Processing (ICSLP 2000)"},{"key":"ijapuc.2014100104-8","author":"A.Schrijver","year":"1998","journal-title":"Theory of Linear and Integer Programming"},{"key":"ijapuc.2014100104-9","first-page":"316","article-title":"RAMOS-Recognizer Assessment by means of Manipulation of Speech.","volume":"2","author":"H. J. M.Steeneken","year":"1989","journal-title":"Proceedings of EuroSpeech"},{"key":"ijapuc.2014100104-10","first-page":"873","article-title":"The COST278 pan-European Broadcast News Database.","author":"A.Vandecatseye","year":"2004","journal-title":"Proceedings of LREC 2004"},{"key":"ijapuc.2014100104-11","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-21736-9"}],"container-title":["International Journal of Advanced Pervasive and Ubiquitous Computing"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=130642","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,1]],"date-time":"2022-06-01T18:00:45Z","timestamp":1654106445000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/ijapuc.2014100104"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2014,10,1]]},"references-count":12,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2014,10]]}},"URL":"https:\/\/doi.org\/10.4018\/ijapuc.2014100104","relation":{},"ISSN":["1937-965X","1937-9668"],"issn-type":[{"value":"1937-965X","type":"print"},{"value":"1937-9668","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,10,1]]}}}