Matching Items (5)
Filtering by
- All Subjects: Educational evaluation
- All Subjects: Equity
- Creators: Berliner, David C.
Description
This study examined the intended and unintended consequences associated with the Education Value-Added Assessment System (EVAAS) as perceived and experienced by teachers in the Houston Independent School District (HISD). To evaluate teacher effectiveness, HISD is using EVAAS for high-stakes consequences more than any other district or state in the country. A large-scale electronic survey was used to investigate the model's reliability and validity; to determine whether teachers used the EVAAS data in formative ways as intended; to gather teachers' opinions on EVAAS's claimed benefits and statements; and to understand the unintended consequences that occurred as a result of EVAAS use in HISD. Mixed methods data collection and analyses were used to present the findings in user-friendly ways, particularly when using the words and experiences of the teachers themselves. Results revealed that the reliability of the EVAAS model produced split and inconsistent results among teacher participants, and teachers indicated that students biased the EVAAS results. The majority of teachers did not report similar EVAAS and principal observation scores, reducing the criterion-related validity of both measures of teacher quality. Teachers revealed discrepancies in the distribution of EVAAS reports, the awareness of trainings offered, and among principals' understanding of EVAAS across the district. This resulted in an underwhelming number of teachers who reportedly used EVAAS data for formative purposes. Teachers disagreed with EVAAS marketing claims, implying the majority did not believe EVAAS worked as intended and promoted. Additionally, many unintended consequences associated with the high-stakes use of EVAAS emerged through teachers' responses, which revealed among others that teachers felt heightened pressure and competition, which reduced morale and collaboration, and encouraged cheating or teaching to the test in attempt to raise EVAAS scores. This study is one of the first to investigate how the EVAAS model works in practice and provides a glimpse of whether value-added models might produce desired outcomes and encourage best teacher practices. This is information of which policymakers, researchers, and districts should be aware and consider when implementing the EVAAS, or any value-added model for teacher evaluation, as many of the reported issues are not specific to the EVAAS model.
ContributorsCollins, Clarin (Author) / Amrein-Beardsley, Audrey (Thesis advisor) / Berliner, David C. (Committee member) / Fischman, Gustavo E (Committee member) / Arizona State University (Publisher)
Created2012
Description
Increasing public criticism of traditional teacher evaluation systems based largely on classroom observations has spurred an unprecedented shift in the debate surrounding educational accountability policies, specifically about the purposes for and measures used to evaluate teachers. In response to growing public demand and associated federal mandates, states have been prompted to design and implement teacher evaluation systems that use increasingly available, statistically complex models (i.e., value-added) intended to isolate and measure the effects of individual teachers on student academic growth over time. The purpose of this study was to examine the perceptions of school administrators and teachers within one of the largest school districts in the state of Arizona with regards to the design and implementation of a federally-supported, state policy-directed teacher evaluation system based on professional practice and value-added measures. While much research has been conducted on teacher evaluation, few studies have examined teacher evaluation systems in context to better understand the standards of effectiveness used by school administrators and teachers to measure system effectiveness. The perceptions of school administrators and teachers, considering their lived experiences as the subjects of the nation's new and improved teacher evaluation systems in context, must be better understood if state and federal policymakers are to also better recognize and understand the consequences (intended and unintended) associated with the design and implementation of these systems in practice.
ContributorsPaufler, Noelle A (Author) / Amrein-Beardsley, Audrey L (Thesis advisor) / Berliner, David C. (Committee member) / Fischman, Gustavo E (Committee member) / Arizona State University (Publisher)
Created2014
Description
Although U.S. rates of college enrollment among 18-24 year olds have reached historic highs, rates of degree completion have not kept pace. This is especially evident at community colleges, where a disproportionate number of students from groups who, historically, have had low college-completion rates enroll. One way community colleges are attempting to address low completion rates is by implementing institutional interventions intended to increase opportunities for student engagement at their colleges. Utilizing logistic and linear regression analyses, this study focused on community college students, examining the association between participation in institutional support activities and student outcomes, while controlling for specific student characteristics known to impact student success in college. The sample included 746 first-time, full-time, degree-seeking students at a single community college located in the U.S. Southwest. Additional analyses were conducted for the 440 first-time, full-time, degree-seeking students in this sample who placed into at least one developmental education course. Findings indicate that significant associations exist between different types of participation in institutional interventions and various student outcomes: Academic advising was found to be related to increased rates of Fall to Spring and Fall to Fall persistence and, for developmental education students, participation in a student success course was found to be related to an increase in the proportion of course credit hours earned. The results of this study provide evidence that student participation in institutional-level support may relate to increased rates of college persistence and credit hour completion; however, additional inquiry is warranted to inform specific policy and program decision-making at the college and to determine if these findings are generalizable to populations outside of this college setting.
ContributorsBeckert, Kimberly Marrone (Author) / De Los Santos Jr., Alfredo G (Thesis advisor) / Thompson, Marilyn S (Thesis advisor) / Berliner, David C. (Committee member) / Arizona State University (Publisher)
Created2011
Description
ABSTRACT
Closing the achievement gap between low-income, marginalized, racially, and linguistically diverse students has proven difficult. Research has outlined the effects of funding on student achievement in a manner that focuses the attention on dollars expended, in order overcome barriers to learning. Arizona has long been recognized for its education funding disparity, and its inability to balance fiscal capacity in a manner that serves to improve educational outcomes.
This dissertation examines how Arizona funds its education system. It measures horizontal inequity in a robust manner by examining those fiscal capacity resources directly related to learning and poverty. Recognizing districts with higher concentrations of special needs students will impact fiscal capacity at the district level, this dissertation applies a non-linear analysis to measure how English language learners/ limited English proficient (ELL/ LEP) student proportionality impacts federal and state revenue per pupil, ELL expenditures per pupil, and total expenditures per pupil.
Using the Gini Ratio, McCloone Index, Coefficient of Variation, and Theil inequality index, this dissertation confirms that significant education funding disparity exists across Arizona’s school districts. This dissertation also shows the proportion of English language learners is negatively related to local revenue per pupil, and ELL expenditures per ELL pupil.
Arizona has characteristically funded the public education system inequitably and positioned its students in a manner that stratifies achievement gaps based on wealth. Targeted funding toward ELLs is in no way meaningfully related to the proportion of ELLs in a district. Conceptually the way in which equity is defined, and measured, may require re-evaluation, beyond correlated inputs and outputs. This conceptual re-evaluation of equity must include the decision making process of administrative leaders which influence the quality of those resources related to student learning.
Closing the achievement gap between low-income, marginalized, racially, and linguistically diverse students has proven difficult. Research has outlined the effects of funding on student achievement in a manner that focuses the attention on dollars expended, in order overcome barriers to learning. Arizona has long been recognized for its education funding disparity, and its inability to balance fiscal capacity in a manner that serves to improve educational outcomes.
This dissertation examines how Arizona funds its education system. It measures horizontal inequity in a robust manner by examining those fiscal capacity resources directly related to learning and poverty. Recognizing districts with higher concentrations of special needs students will impact fiscal capacity at the district level, this dissertation applies a non-linear analysis to measure how English language learners/ limited English proficient (ELL/ LEP) student proportionality impacts federal and state revenue per pupil, ELL expenditures per pupil, and total expenditures per pupil.
Using the Gini Ratio, McCloone Index, Coefficient of Variation, and Theil inequality index, this dissertation confirms that significant education funding disparity exists across Arizona’s school districts. This dissertation also shows the proportion of English language learners is negatively related to local revenue per pupil, and ELL expenditures per ELL pupil.
Arizona has characteristically funded the public education system inequitably and positioned its students in a manner that stratifies achievement gaps based on wealth. Targeted funding toward ELLs is in no way meaningfully related to the proportion of ELLs in a district. Conceptually the way in which equity is defined, and measured, may require re-evaluation, beyond correlated inputs and outputs. This conceptual re-evaluation of equity must include the decision making process of administrative leaders which influence the quality of those resources related to student learning.
ContributorsMartinez, David G (Author) / Pivovarova, Margarita (Thesis advisor) / Berliner, David C. (Thesis advisor) / Dorn, Sherman (Committee member) / Arizona State University (Publisher)
Created2018
Description
The purpose of this study was to determine how I, as a future teacher, can best combat inequities in technological access and fluency in my future classroom. In this study, I explored a range of literature on the role of technology in the classroom, the digital divide in home and school settings, and variance in digital literacy. Additional insight was gained through interviews and observing school faculty in three public school districts in the Phoenix Metropolitan Area. This provided a better understanding of local context in order to gain a sense of the national and local realities of the digital landscape as they relate to educational equity in the educational settings where I aim to serve as a certified teacher.
ContributorsJakubczyk, Nicole Marie (Author) / Foulger, Teresa (Thesis director) / Barnett, Juliet (Committee member) / Division of Teacher Preparation (Contributor) / Barrett, The Honors College (Contributor)
Created2017-05