Matching Items (5)
Filtering by
- All Subjects: Educational evaluation
- Creators: Nelson, Brian
- Creators: Powers, Jeanne
- Member of: ASU Electronic Theses and Dissertations
- Member of: Theses and Dissertations
Description
ABSTRACT A review of studies selected from the Educational Resource Information Center (ERIC) covering the years 1985 through 2011 revealed three key evaluation components to analyze within a comprehensive teacher evaluation program: (a) designing, planning, and implementing instruction; (b) learning environments; and (c) parent and peer surveys. In this dissertation, these three components are investigated in the context of two research questions: 1. What is the relationship, if any, between comprehensive teacher evaluation scores and student standardized test scores? 2. How do teachers and administrators experience the comprehensive evaluation process and how do they use their experiences to inform instruction? The methodology for the study included a mixed-method case study at a charter school located in a middle-class neighborhood within a large metropolitan area of the southwestern United States, which included a comparison of teachers' average evaluation scores in the areas of instruction and environment, peer survey scores, parent survey scores, and students' standardized test (SST) benchmark scores over a two-year period as the quantitative data for the study. I also completed in-depth interviews with classroom teachers, mentor teachers, the master teacher, and the school principal; I used these interviews for the qualitative portion of my study. All three teachers had similar evaluation scores; however, when comparing student scores among the teachers, differences were evident. While no direct correlations between student achievement data and teacher evaluation scores are possible, the qualitative data suggest that there were variations among the teachers and administrators in how they experienced or "bought into" the comprehensive teacher evaluation, but they all used evaluation information to inform their instruction. This dissertation contributes to current research by suggesting that comprehensive teacher evaluation has the potential to change teachers' and principals' perceptions of teacher evaluation as inefficient and unproductive to a system that can enhance instruction and ultimately improve student achievement.
ContributorsBullock, Donna (Author) / Mccarty, Teresa (Thesis advisor) / Powers, Jeanne (Thesis advisor) / Stafford, Catherine (Committee member) / Arizona State University (Publisher)
Created2013
Description
The purpose of this survey study was to collect data from pre-K-12 educators in the U.S. regarding their perceptions of the purpose, conceptions, use, impact, and results of educational research. The survey tool was based on existing questionnaires and case studies in the literature, as well as newly developed items. 3,908 educators in a database developed over 10+ years at the world's largest education company were sent a recruiting email; 400 elementary and secondary teachers in the final sample completed the online survey containing 48 questions over a three-week deployment period in the spring of 2013. Results indicated that overall teachers believe educational research is important, that the most important purpose of research is to increase effectiveness of classroom practice, yet research is not frequently sought out during the course of practice. Teachers perceive results in research journals as the most trustworthy yet also perceive research journals the most difficult to access (relying second-most often for research via in-service trainings). These findings have implications for teachers, administrators, policy-makers, and researchers. Educational researchers should seek to address both the theoretical and the applied aspects of learning. Professional development must make explicit links between research findings and classroom strategies and tactics, and research must be made more readily available to those who are not currently seeking additional credentialing, and therefore do not individually have access to scholarly literature. Further research is needed to expand the survey sample and refine the survey instrument. Similar research with administrators in pre-K-20 settings as well as in-depth interviews would serve to investigate the "why" of many findings.
ContributorsMahoney, Shawn (Author) / Savenye, Wilhelmina (Thesis advisor) / Nelson, Brian (Committee member) / Atkinson, Robert (Committee member) / Arizona State University (Publisher)
Created2013
Description
With the advent of Massive Open Online Courses (MOOCs) educators have the opportunity to collect data from students and use it to derive insightful information about the students. Specifically, for programming based courses the ability to identify the specific areas or topics that need more attention from the students can be of immense help. But the majority of traditional, non-virtual classes lack the ability to uncover such information that can serve as a feedback to the effectiveness of teaching. In majority of the schools paper exams and assignments provide the only form of assessment to measure the success of the students in achieving the course objectives. The overall grade obtained in paper exams and assignments need not present a complete picture of a student’s strengths and weaknesses. In part, this can be addressed by incorporating research-based technology into the classrooms to obtain real-time updates on students' progress. But introducing technology to provide real-time, class-wide engagement involves a considerable investment both academically and financially. This prevents the adoption of such technology thereby preventing the ideal, technology-enabled classrooms. With increasing class sizes, it is becoming impossible for teachers to keep a persistent track of their students progress and to provide personalized feedback. What if we can we provide technology support without adding more burden to the existing pedagogical approach? How can we enable semantic enrichment of exams that can translate to students' understanding of the topics taught in the class? Can we provide feedback to students that goes beyond only numbers and reveal areas that need their focus. In this research I focus on bringing the capability of conducting insightful analysis to paper exams with a less intrusive learning analytics approach that taps into the generic classrooms with minimum technology introduction. Specifically, the work focuses on automatic indexing of programming exam questions with ontological semantics. The thesis also focuses on designing and evaluating a novel semantic visual analytics suite for in-depth course monitoring. By visualizing the semantic information to illustrate the areas that need a student’s focus and enable teachers to visualize class level progress, the system provides a richer feedback to both sides for improvement.
ContributorsPandhalkudi Govindarajan, Sesha Kumar (Author) / Hsiao, I-Han (Thesis advisor) / Nelson, Brian (Committee member) / Walker, Erin (Committee member) / Arizona State University (Publisher)
Created2016
Web-Based Programming Grading Assistant: An Investigation of the Role of Students Reviewing Behavior
Description
Paper assessment remains to be an essential formal assessment method in today's classes. However, it is difficult to track student learning behavior on physical papers. This thesis presents a new educational technology—Web Programming Grading Assistant (WPGA). WPGA not only serves as a grading system but also a feedback delivery tool that connects paper-based assessments to digital space. I designed a classroom study and collected data from ASU computer science classes. I tracked and modeled students' reviewing and reflecting behaviors based on the use of WPGA. I analyzed students' reviewing efforts, in terms of frequency, timing, and the associations with their academic performances. Results showed that students put extra emphasis in reviewing prior to the exams and the efforts demonstrated the desire to review formal assessments regardless of if they were graded for academic performance or for attendance. In addition, all students paid more attention on reviewing quizzes and exams toward the end of semester.
ContributorsHuang, Po-Kai (Author) / Hsiao, I-Han (Thesis advisor) / Nelson, Brian (Committee member) / VanLehn, Kurt (Committee member) / Arizona State University (Publisher)
Created2017
Description
The purpose of this study was to explore features of Supplemental Educational Services (SES) implementation at the district level. In the study beliefs, goals, and actions of district office administrators were analyzed against the backdrop of changing federal guidelines and challenges faced by SES implementers across Arizona. The case study focuses on implementation in the 2007-2008, 2008-2009, and 2009-2010 school years. The study uses the 2005 and 2009 Department of Education guidelines, survey responses from Arizona district and school implementers, as well as documents and interviews from an urban Arizona case district. The study separates the implementation activities into task areas, which are analyzed separately. Using a loose coupling perspective, the separate task areas are furthered used as coupling domains and represented in social network graphs. Results show that the case district personnel were highly focused on their primary role, maintaining district compliance with federal guidelines. The district personnel employed several changes over the case study period to centralize their control of SES operations within district. The employment and training of site level coordinators was the most impactful of the strategies. As boundary spanners, the coordinators allowed greater access to information, oversight, and influence at the site level. Despite the growing capacity and earnest efforts of the district personnel, the case district was still very far from being able to measure or assess the impact of SES on student achievement. Centralization in the scholastic task areas was relatively low, and had marginal changes over the case study period. Years into the program, there was still no avenue to accurately gauge the effectiveness. As the district personnel were chiefly concerned with compliance, they had suspended judgment on the program and focused primarily on improving their processes.
ContributorsBlankson, Gerald Kotey (Author) / Danzig, Arnold (Thesis advisor) / Glass, Gene (Committee member) / Powers, Jeanne (Committee member) / Arizona State University (Publisher)
Created2011