{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,17]],"date-time":"2026-10-17T22:19:17Z","timestamp":1792275557922,"version":"4.4.0"},"reference-count":53,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2020,5,26]],"date-time":"2020-05-26T00:00:00Z","timestamp":1590451200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["J Learn Disabil"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>Advancing teacher candidates\u2019 overall competence through use of valid teacher observation systems should be an essential element of teacher preparation. Yet, the field of special education has not provided observation protocols designed specifically for preservice teachers that are founded in theoretical perspectives and research on effective instruction for students with learning and other high-incidence disabilities (SWDs). To address this need, a group of researchers in special education teacher preparation and measurement developed the Preservice Observation Instrument for Special Education (POISE). The POISE is an observation system rooted in effective special education practices that support the growth of preservice teachers who will serve SWD across instructional settings. The purpose of this article is to report on the development and psychometric properties of the POISE. Specifically, we employed Kane\u2019s argument-based validity approach to frame each stage in the development process of the POISE. We conducted two phases of content validation activities, development activities, and a pilot study to assess the degree to which scores from POISE provided evidence for the scoring, generalizability, and extrapolation inferences. In the end, the POISE represents a promising observation instrument for the development of special education teacher candidates.<\/jats:p>","DOI":"10.1177\/0022219420920382","type":"journal-article","created":{"date-parts":[[2020,5,26]],"date-time":"2020-05-26T08:55:05Z","timestamp":1590483305000},"page":"6-19","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":15,"title":["Preservice Observation in Special Education: A Validation Study"],"prefix":"10.1177","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1488-5052","authenticated-orcid":false,"given":"Daisy J.","family":"Pua","sequence":"first","affiliation":[{"name":"University of Florida, Gainesville, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David J.","family":"Peyton","sequence":"additional","affiliation":[{"name":"Appalachian State University, Boone, NC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary T.","family":"Brownell","sequence":"additional","affiliation":[{"name":"University of Florida, Gainesville, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentina A.","family":"Contesse","sequence":"additional","affiliation":[{"name":"University of Florida, Gainesville, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nathan D.","family":"Jones","sequence":"additional","affiliation":[{"name":"Boston University Wheelock College of Education & Human Development, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2020,5,26]]},"reference":[{"key":"bibr1-0022219420920382","volume-title":"Standards for educational and psychological testing","author":"American Educational Research Association, American Psychological Association, &amp; National Council on Measurement in Education","year":"1999"},{"key":"bibr2-0022219420920382","volume-title":"Explicit instruction: Effective and efficient teaching","author":"Archer A. L.","year":"2010"},{"key":"bibr3-0022219420920382","doi-asserted-by":"crossref","unstructured":"Bates D., Maechler M., Bolker B., Walker S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67, 1\u201348. https:\/\/doi.org\/10.18637\/jss.v067.i01","DOI":"10.18637\/jss.v067.i01"},{"key":"bibr4-0022219420920382","doi-asserted-by":"crossref","unstructured":"Bell C. A., Gitomer D. H., McCaffrey D. F., Hamre B. K., Pianta R. C., Qi Y. (2012). An argument approach to observation protocol validity. Educational Assessment, 17(2\u20133), 62\u201387. https:\/\/doi.org\/10.1080\/10627197.2012.715014","DOI":"10.1080\/10627197.2012.715014"},{"key":"bibr5-0022219420920382","first-page":"55","volume-title":"Designing teacher evaluation systems: New guidance from the Measures of Effective Teaching Project","author":"Bell C. A.","year":"2014"},{"key":"bibr6-0022219420920382","doi-asserted-by":"publisher","DOI":"10.4159\/9780674028845"},{"key":"bibr7-0022219420920382","first-page":"17","volume-title":"Handbook of classroom management: Research, practice, and contemporary issues","author":"Brophy J.","year":"2006"},{"key":"bibr8-0022219420920382","doi-asserted-by":"crossref","unstructured":"Brownell M. T., Bishop A. G., Gersten R., Klingner J. K., Penfield R. D., Dimino J.\u2004.\u2004. Sindelar P. T. (2009). The role of domain expertise in beginning special education teacher quality. Exceptional Children, 75, 391\u2013411. https:\/\/doi.org\/10.1177\/001440290907500401","DOI":"10.1177\/001440290907500401"},{"key":"bibr9-0022219420920382","doi-asserted-by":"crossref","unstructured":"Casabianca J. M., McCaffrey D. F., Gitomer D. H., Bell C. A., Hamre B. K., Pianta R. C. (2013). Effect of observation mode on measures of secondary mathematics teaching. Educational and Psychological Measurement, 73(5), 757\u2013783. https:\/\/doi.org\/10.1177\/0013164413486987","DOI":"10.1177\/0013164413486987"},{"key":"bibr10-0022219420920382","doi-asserted-by":"crossref","unstructured":"Cohen J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37\u201346. http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/001316446002000104","DOI":"10.1177\/001316446002000104"},{"key":"bibr11-0022219420920382","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1598\/RRQ.46.3.1","volume":"46","author":"Connor C. M.","year":"2011","journal-title":"Reading Research Quarterly"},{"key":"bibr12-0022219420920382","doi-asserted-by":"crossref","unstructured":"Connor C. M., Morrison F. J., Petrella J. N. (2004). Effective reading comprehension instruction: Examining Child \u00d7 Instruction interactions. Journal of Educational Psychology, 96, 682\u2013698. https:\/\/doi.org\/10.1037\/0022-0663.96.4.682","DOI":"10.1037\/0022-0663.96.4.682"},{"key":"bibr13-0022219420920382","unstructured":"Coogan J., Herrington N. Q. (2011). Methodology: An overview. Research in Secondary Teacher Education, 1(2), 24\u201328. https:\/\/repository.uel.ac.uk\/item\/8604v"},{"key":"bibr14-0022219420920382","doi-asserted-by":"crossref","unstructured":"Cornelius K. E., Nagro S. A. (2014). Evaluating the evidence base of performance feedback in preservice special education teacher training. Teacher Education and Special Education, 37(2), 133\u2013146. https:\/\/doi.org\/10.1177\/0888406414521837","DOI":"10.1177\/0888406414521837"},{"key":"bibr15-0022219420920382","volume-title":"Essentials of psychological testing","author":"Cronbach L. J.","year":"1984","edition":"4"},{"key":"bibr16-0022219420920382","doi-asserted-by":"crossref","unstructured":"Doabler C. T., Baker S. K., Kosty D. B., Smolkowski K., Clarke B., Miller S. J., Fien H. (2015). Examining the association between explicit mathematics instruction and student mathematics achievement. The Elementary School Journal, 115, 303\u2013333. https:\/\/doi.org\/10.1086\/679969","DOI":"10.1086\/679969"},{"key":"bibr17-0022219420920382","doi-asserted-by":"crossref","unstructured":"Doabler C. T., Nelson N. J., Kosty D. B., Fien H., Baker S. K., Smolkowski K., Clarke B. (2014). Examining teachers\u2019 use of evidence-based practices during core mathematics instruction. Assessment for Effective Intervention, 39, 99\u2013111. https:\/\/doi.org\/10.1177\/1534508413511848","DOI":"10.1177\/1534508413511848"},{"key":"bibr18-0022219420920382","unstructured":"Dover A. G., Schultz B. D., Smith K., Duggan T. J. (2015). Who\u2019s preparing our candidates? edTPA, localized knowledge and the outsourcing of teacher evaluation. Teachers College Record. http:\/\/www.tcrecord.org\/Content.asp?ContentId=17914"},{"key":"bibr19-0022219420920382","unstructured":"EDITECT. (2017). Editect (Version 2.0) [Computer software]. https:\/\/editect.com\/editect\/rater.php"},{"key":"bibr20-0022219420920382","doi-asserted-by":"crossref","unstructured":"Garwood J., Vernon-Feagans L. & Family Life Project Key Investigators. (2017). Classroom management affects literacy development of students with emotional and behavioral disorders. Exceptional Children, 83, 123\u2013142. https:\/\/doi.org\/10.1177\/0014402916651846","DOI":"10.1177\/0014402916651846"},{"key":"bibr21-0022219420920382","doi-asserted-by":"crossref","unstructured":"Gersten R., Fuchs L., Williams J., Baker S. (2001). Teaching reading comprehension strategies to students with learning disabilities: A review of research. Review of Educational Research, 71, 279\u2013320. https:\/\/doi.org\/10.3102\/00346543071002279","DOI":"10.3102\/00346543071002279"},{"key":"bibr22-0022219420920382","doi-asserted-by":"crossref","unstructured":"Hamre B. K., Pianta R. C., Burchinal M., Field S., LoCasal-Crouch J., Downer J. T., Scott-Little C. (2012). A course on effective teacher-child interactions: Effects on teacher beliefs knowledge and observed practice. American Educational Research Journal, 49, 88\u2013123. https:\/\/doi.org\/10.3102\/0002831211434596","DOI":"10.3102\/0002831211434596"},{"key":"bibr23-0022219420920382","doi-asserted-by":"crossref","unstructured":"Hamre B. K., Pianta R. C., Downer J. T., DeCoster J., Mashburn A. J., Jones S. M.\u2004.\u2004. Hamagami A. (2013). Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms. The Elementary School Journal, 113, 461\u2013487. https:\/\/doi.org\/10.1086\/669616","DOI":"10.1086\/669616"},{"key":"bibr24-0022219420920382","first-page":"131","volume-title":"Handbook of metacognition in education","author":"Harris K. R.","year":"2009"},{"key":"bibr25-0022219420920382","unstructured":"Ho A. D., Kane T. J. (2013). The reliability of classroom observations by school personnel. Bill & Melinda Gates Foundation. https:\/\/eric.ed.gov\/?id=ED540957"},{"key":"bibr26-0022219420920382","doi-asserted-by":"crossref","unstructured":"Horner R., Sugai G., Anderson C. (2010). Examining the evidence for school-wide positive behavior support. Focus on Exceptional Children, 42, 1\u201314. https:\/\/doi.org\/10.17161\/foec.v42i8.6906","DOI":"10.17161\/foec.v42i8.6906"},{"key":"bibr27-0022219420920382","unstructured":"Johnson E. S., Semmelroth C. L. (2015). Validating an observation protocol to measure special education teacher effectiveness. Journal of the American Academy of Special Education Professionals, 99\u2013119. https:\/\/scholarworks.boisestate.edu\/sped_facpubs\/110\/"},{"key":"bibr28-0022219420920382","volume-title":"American Education for Research Association Annual Conference","author":"Jones N. D.","year":"2019"},{"key":"bibr29-0022219420920382","doi-asserted-by":"crossref","unstructured":"Jones N. D., Brownell M. T. (2014). Examining the use of classroom observations in the evaluation of special education teachers. Assessment for Effective Intervention, 39(2), 112\u2013124. https:\/\/doi.org\/10.1177\/1534508413514103","DOI":"10.1177\/1534508413514103"},{"key":"bibr30-0022219420920382","volume-title":"Handbook of leadership and administration for special education","author":"Jones N. D.","year":"2019"},{"key":"bibr31-0022219420920382","first-page":"17","volume-title":"Educational measurement","author":"Kane M.","year":"2006"},{"key":"bibr32-0022219420920382","unstructured":"Kane T. J., Staiger D. O. (2012). Gathering feedback for teaching: Combining high quality observations with student surveys and achievement gains. Bill & Melinda Gates Foundation. https:\/\/eric.ed.gov\/?id=ED540960"},{"key":"bibr33-0022219420920382","doi-asserted-by":"crossref","unstructured":"Karabenick S. A., Woolley M. E., Friedel J. M., Ammon B. V., Blazevski J., Bonney C. R.\u2004.\u2004. Kelly K. L. (2007). Cognitive processing of self-report items in educational research: Do they think what we mean? Educational Psychologist, 42(3), 139\u2013151. https:\/\/doi.org\/10.1080\/00461520701416231","DOI":"10.1080\/00461520701416231"},{"key":"bibr34-0022219420920382","doi-asserted-by":"crossref","unstructured":"Korpershoek H., Harms T., de Boer H., van Kuijk M., Doolaard S. (2016). A meta-analysis of the effects of classroom management strategies and classroom management programs on students\u2019 academic, behavioral, emotional, and motivational outcomes. Review of Educational Research, 86(3), 643\u2013680. https:\/\/doi.org\/10.3102\/0034654315626799","DOI":"10.3102\/0034654315626799"},{"key":"bibr35-0022219420920382","doi-asserted-by":"crossref","unstructured":"Landis J. R., Koch G. G. (1977). An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics, 33(2), 363\u2013374. https:\/\/www.jstor.org\/stable\/2529786","DOI":"10.2307\/2529786"},{"key":"bibr36-0022219420920382","doi-asserted-by":"crossref","unstructured":"Lissitz R. W., Samuelsen K. (2007). A suggested change in terminology and emphasis regarding validity and education. Educational Researcher, 36, 437\u2013448. https:\/\/doi.org\/10.3102\/0013189X07311286","DOI":"10.3102\/0013189X07311286"},{"key":"bibr37-0022219420920382","volume-title":"The Framework for Teaching: Convergence and divergence with conceptions of effectiveness in special education","author":"Mathews H."},{"key":"bibr38-0022219420920382","volume-title":"Teaching students with learning problems","author":"Mercer C. D.","year":"2011","edition":"8"},{"key":"bibr39-0022219420920382","first-page":"13","volume-title":"Educational measurement","author":"Messick S.","year":"1989","edition":"3"},{"key":"bibr40-0022219420920382","doi-asserted-by":"crossref","unstructured":"Nelson-Walker N., Fien H., Kosty D. B., Smolkowski K., Smith J. L. M., Baker S. K. (2013). Evaluating the effects of a systematic intervention on first-grader teachers\u2019 explicit reading instruction. Learning Disability Quarterly, 36, 215\u2013230. https:\/\/doi.org\/10.1177\/0731948712472186","DOI":"10.1177\/0731948712472186"},{"key":"bibr41-0022219420920382","unstructured":"Noell G. H., Brownell M. T., Buzick H. M., Jones N. D. (2014). Using educator effectiveness measures to improve educator preparation programs and student outcomes (CEEDAR Doc. No. LS-1). Collaboration for Effective Educator Development, Accountability, and Reform Center, University of Florida. Retrieved from https:\/\/ceedar.education.ufl.edu\/wp-content\/uploads\/2014\/09\/LS-1_FINAL_08-27-14.pdf"},{"key":"bibr42-0022219420920382","author":"Pianta R. C.","year":"2007","journal-title":"Classroom Assessment Scoring System\u2014CLASS"},{"key":"bibr43-0022219420920382","doi-asserted-by":"crossref","unstructured":"Porter A. C., Polikoff M. S., Goldring E., Murphy J., Elliott S. N., May H. (2010). Developing a psychometrically sound assessment of school leadership: The VAL-ED as a case study. Educational Administration Quarterly, 46(2), 135\u2013173. https:\/\/doi.org\/10.1177\/1094670510361747","DOI":"10.1177\/1094670510361747"},{"key":"bibr44-0022219420920382","doi-asserted-by":"publisher","DOI":"10.1037\/11877-000"},{"key":"bibr45-0022219420920382","doi-asserted-by":"publisher","DOI":"10.1177\/1534508413511488"},{"key":"bibr46-0022219420920382","doi-asserted-by":"publisher","DOI":"10.1016\/B0-12-369398-5\/00193-6"},{"key":"bibr47-0022219420920382","doi-asserted-by":"crossref","unstructured":"Simonsen B., Fairbanks S., Briesch A., Myers D., Sugai G. (2008). Evidence-based practices in classroom management: Considerations for research to practice. Education and Treatment of Children, 31, 351\u2013380. https:\/\/www.jstor.org\/stable\/42899983","DOI":"10.1353\/etc.0.0007"},{"key":"bibr48-0022219420920382","doi-asserted-by":"crossref","unstructured":"Sledge A., Pazey B. L. (2013). Measuring teacher effectiveness through meaningful evaluation: Can reform models apply to general education and special education teachers? Teacher Education and Special Education, 36, 231\u2013246. https:\/\/doi.org\/10.1177\/0888406413489839","DOI":"10.1177\/0888406413489839"},{"key":"bibr49-0022219420920382","doi-asserted-by":"crossref","unstructured":"Swanson H. L., Deshler D. D. (2003). Instructing adolescents with learning disabilities: Converting a meta-analysis to practice. Journal of Learning Disabilities, 36, 124\u2013135. https:\/\/doi.org\/10.1177\/002221940303600205","DOI":"10.1177\/002221940303600205"},{"key":"bibr50-0022219420920382","volume-title":"Interventions for students with learning disabilities: A meta-analysis of treatment outcomes","author":"Swanson H. L.","year":"1999"},{"key":"bibr51-0022219420920382","doi-asserted-by":"crossref","unstructured":"Swanson H. L., Sachse-Lee C. (2000). A meta-analysis of single-subject-design intervention research for students with LD. Journal of Learning Disabilities, 33(2), 114\u2013136. https:\/\/doi.org\/10.1177\/002221940003300201","DOI":"10.1177\/002221940003300201"},{"key":"bibr52-0022219420920382","doi-asserted-by":"crossref","unstructured":"Wanzek J., Vaughn S., Scammacca N. K., Metz K., Murray C. S., Roberts G., Danielson L. (2013). Extensive reading interventions for students with reading difficulties after grade 3. Review of Educational Research, 83, 163\u2013195. https:\/\/doi.org\/10.3102\/0034654313477212","DOI":"10.3102\/0034654313477212"},{"key":"bibr53-0022219420920382","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7161(06)26004-8"}],"container-title":["Journal of Learning Disabilities"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0022219420920382","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0022219420920382","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0022219420920382","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T06:40:21Z","timestamp":1777617621000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0022219420920382"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,26]]},"references-count":53,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1177\/0022219420920382"],"URL":"https:\/\/doi.org\/10.1177\/0022219420920382","relation":{},"ISSN":["0022-2194","1538-4780"],"issn-type":[{"value":"0022-2194","type":"print"},{"value":"1538-4780","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,26]]}}}