Matching Items (2)
Filtering by
- All Subjects: Evaluation
- Genre: Academic theses
- Creators: Amrein-Beardsley, Audrey
- Creators: Harris, Connie
- Status: Published
Description
With changes in federal legislation and the proposed reauthorization of The Elementary and Secondary Education Act, school administrators are held to high standards in an attempt to improve achievement for all students. They no longer just manage their schools but must now be instructional leaders charged with observing and conferencing with teachers, leading professional development aligned to data, and measuring results. Classroom walkthroughs have become a way of assisting with these tasks while supporting the mission of each school. The purpose of this research was to describe how walkthroughs operate in practice and how they were experienced by school administration, teacher leaders, and teachers at two schools within the same suburban district. Interviews illustrated that experiences were varied using the classroom walkthrough protocol. Continued professional development needed to occur with administrators and teachers. Participants shared their thoughts on implementation and usage, as well as made recommendations to schools and/or districts considering implementing classroom walkthroughs. Results also indicated a great deal of attention paid to the collection of data within the schools but there was less consensus on the analysis and use of the collected data. There was also confusion with teachers as to the vision, purpose, and goals of using classroom walkthroughs. Changes in leadership during the five years since implementation and young administrators, who were relatively new in their positions, helped shape school experiences. Recommendations to schools and/or districts considering implementation focused on support from the district office, a need for help with data collection and analysis, and a clear vision for the use of the protocol. Interviewees mentioned it would benefit districts and schools to develop a shared vocabulary for instructional engagement, alignment, and rigor, as well as a focus for professional development. They also shared the view that calibration conferences and conversations, centered on instruction, provided a focus for teaching and learning within a school and/or district.
ContributorsCunningham, Alexa Renee (Author) / Danzig, Arnold (Thesis advisor) / Harris, Connie (Committee member) / Hurley, Beverly (Committee member) / Arizona State University (Publisher)
Created2012
Description
ABSTRACT
This study examines validity evidence of a state policy-directed teacher evaluation system implemented in Arizona during school year 2012-2013. The purpose was to evaluate the warrant for making high stakes, consequential judgments of teacher competence based on value-added (VAM) estimates of instructional impact and observations of professional practice (PP). The research also explores educator influence (voice) in evaluation design and the role information brokers have in local decision making. Findings are situated in an evidentiary and policy context at both the LEA and state policy levels.
The study employs a single-phase, concurrent, mixed-methods research design triangulating multiple sources of qualitative and quantitative evidence onto a single (unified) validation construct: Teacher Instructional Quality. It focuses on assessing the characteristics of metrics used to construct quantitative ratings of instructional competence and the alignment of stakeholder perspectives to facets implicit in the evaluation framework. Validity examinations include assembly of criterion, content, reliability, consequential and construct articulation evidences. Perceptual perspectives were obtained from teachers, principals, district leadership, and state policy decision makers. Data for this study came from a large suburban public school district in metropolitan Phoenix, Arizona.
Study findings suggest that the evaluation framework is insufficient for supporting high stakes, consequential inferences of teacher instructional quality. This is based, in part on the following: (1) Weak associations between VAM and PP metrics; (2) Unstable VAM measures across time and between tested content areas; (3) Less than adequate scale reliabilities; (4) Lack of coherence between theorized and empirical PP factor structures; (5) Omission/underrepresentation of important instructional attributes/effects; (6) Stakeholder concerns over rater consistency, bias, and the inability of test scores to adequately represent instructional competence; (7) Negative sentiments regarding the system's ability to improve instructional competence and/or student learning; (8) Concerns regarding unintended consequences including increased stress, lower morale, harm to professional identity, and restricted learning opportunities; and (9) The general lack of empowerment and educator exclusion from the decision making process. Study findings also highlight the value of information brokers in policy decision making and the importance of having access to unbiased empirical information during the design and implementation phases of important change initiatives.
This study examines validity evidence of a state policy-directed teacher evaluation system implemented in Arizona during school year 2012-2013. The purpose was to evaluate the warrant for making high stakes, consequential judgments of teacher competence based on value-added (VAM) estimates of instructional impact and observations of professional practice (PP). The research also explores educator influence (voice) in evaluation design and the role information brokers have in local decision making. Findings are situated in an evidentiary and policy context at both the LEA and state policy levels.
The study employs a single-phase, concurrent, mixed-methods research design triangulating multiple sources of qualitative and quantitative evidence onto a single (unified) validation construct: Teacher Instructional Quality. It focuses on assessing the characteristics of metrics used to construct quantitative ratings of instructional competence and the alignment of stakeholder perspectives to facets implicit in the evaluation framework. Validity examinations include assembly of criterion, content, reliability, consequential and construct articulation evidences. Perceptual perspectives were obtained from teachers, principals, district leadership, and state policy decision makers. Data for this study came from a large suburban public school district in metropolitan Phoenix, Arizona.
Study findings suggest that the evaluation framework is insufficient for supporting high stakes, consequential inferences of teacher instructional quality. This is based, in part on the following: (1) Weak associations between VAM and PP metrics; (2) Unstable VAM measures across time and between tested content areas; (3) Less than adequate scale reliabilities; (4) Lack of coherence between theorized and empirical PP factor structures; (5) Omission/underrepresentation of important instructional attributes/effects; (6) Stakeholder concerns over rater consistency, bias, and the inability of test scores to adequately represent instructional competence; (7) Negative sentiments regarding the system's ability to improve instructional competence and/or student learning; (8) Concerns regarding unintended consequences including increased stress, lower morale, harm to professional identity, and restricted learning opportunities; and (9) The general lack of empowerment and educator exclusion from the decision making process. Study findings also highlight the value of information brokers in policy decision making and the importance of having access to unbiased empirical information during the design and implementation phases of important change initiatives.
ContributorsSloat, Edward F. (Author) / Wetzel, Keith (Thesis advisor) / Amrein-Beardsley, Audrey (Thesis advisor) / Ewbank, Ann (Committee member) / Shough, Lori (Committee member) / Arizona State University (Publisher)
Created2015