Evaluation of school experience lesson performances of teacher candidates: study for reliability among evaluators

Abstract

School experience lesson takes place in the beginning of pre-service teacher education process. the aim of the lesson is to inform teacher candidates about the profession for which they are candidate. At the end of school experience lesson, teacher candidates submit their application school files to application lecturers. This study aims to score the lesson forms which are rated for each student by more than one evaluator and to find a reliability coefficient between evaluators. It is a research in scanning model. Suitable sampling method was used while determining research group. Research group consists of 32 teacher candidates and 8 evaluator (lecturer) who were having education in university in 2013-2014 academic year. As data collection tool, school experience I form, which was created by council of higher education, was used. in the analysis of the data, descriptive statistics were determined in order to calculate Cohen Kappa and set interior correlation coefficient used in reliability coefficient in continuous data. First compliance between 2 evaluators was calculated by Cohen Kappa and then compliance among 8 evaluators (scorers) by set interior correlation coefficient. Cohen Kappa reliability coefficient, interior set reliability coefficient among multiple evaluators was found to be at medium level. At the end of the research it was observed that evaluation performed with multiple evaluators in scoring depending on observation and performance were found to be more reliable. It is suggested for similar researches that decision shall be taken by calculating the reliability coefficients among multiple scorers. (C) 2015 the Authors. Published by Elsevier Ltd.