Matching Items (4)
Filtering by
- All Subjects: English language
- All Subjects: value-added models
- Creators: Berliner, David C.
- Creators: Anderson, Kate T.
Description
This study examined the intended and unintended consequences associated with the Education Value-Added Assessment System (EVAAS) as perceived and experienced by teachers in the Houston Independent School District (HISD). To evaluate teacher effectiveness, HISD is using EVAAS for high-stakes consequences more than any other district or state in the country. A large-scale electronic survey was used to investigate the model's reliability and validity; to determine whether teachers used the EVAAS data in formative ways as intended; to gather teachers' opinions on EVAAS's claimed benefits and statements; and to understand the unintended consequences that occurred as a result of EVAAS use in HISD. Mixed methods data collection and analyses were used to present the findings in user-friendly ways, particularly when using the words and experiences of the teachers themselves. Results revealed that the reliability of the EVAAS model produced split and inconsistent results among teacher participants, and teachers indicated that students biased the EVAAS results. The majority of teachers did not report similar EVAAS and principal observation scores, reducing the criterion-related validity of both measures of teacher quality. Teachers revealed discrepancies in the distribution of EVAAS reports, the awareness of trainings offered, and among principals' understanding of EVAAS across the district. This resulted in an underwhelming number of teachers who reportedly used EVAAS data for formative purposes. Teachers disagreed with EVAAS marketing claims, implying the majority did not believe EVAAS worked as intended and promoted. Additionally, many unintended consequences associated with the high-stakes use of EVAAS emerged through teachers' responses, which revealed among others that teachers felt heightened pressure and competition, which reduced morale and collaboration, and encouraged cheating or teaching to the test in attempt to raise EVAAS scores. This study is one of the first to investigate how the EVAAS model works in practice and provides a glimpse of whether value-added models might produce desired outcomes and encourage best teacher practices. This is information of which policymakers, researchers, and districts should be aware and consider when implementing the EVAAS, or any value-added model for teacher evaluation, as many of the reported issues are not specific to the EVAAS model.
ContributorsCollins, Clarin (Author) / Amrein-Beardsley, Audrey (Thesis advisor) / Berliner, David C. (Committee member) / Fischman, Gustavo E (Committee member) / Arizona State University (Publisher)
Created2012
Description
ABSTRACT
Closing the achievement gap between low-income, marginalized, racially, and linguistically diverse students has proven difficult. Research has outlined the effects of funding on student achievement in a manner that focuses the attention on dollars expended, in order overcome barriers to learning. Arizona has long been recognized for its education funding disparity, and its inability to balance fiscal capacity in a manner that serves to improve educational outcomes.
This dissertation examines how Arizona funds its education system. It measures horizontal inequity in a robust manner by examining those fiscal capacity resources directly related to learning and poverty. Recognizing districts with higher concentrations of special needs students will impact fiscal capacity at the district level, this dissertation applies a non-linear analysis to measure how English language learners/ limited English proficient (ELL/ LEP) student proportionality impacts federal and state revenue per pupil, ELL expenditures per pupil, and total expenditures per pupil.
Using the Gini Ratio, McCloone Index, Coefficient of Variation, and Theil inequality index, this dissertation confirms that significant education funding disparity exists across Arizona’s school districts. This dissertation also shows the proportion of English language learners is negatively related to local revenue per pupil, and ELL expenditures per ELL pupil.
Arizona has characteristically funded the public education system inequitably and positioned its students in a manner that stratifies achievement gaps based on wealth. Targeted funding toward ELLs is in no way meaningfully related to the proportion of ELLs in a district. Conceptually the way in which equity is defined, and measured, may require re-evaluation, beyond correlated inputs and outputs. This conceptual re-evaluation of equity must include the decision making process of administrative leaders which influence the quality of those resources related to student learning.
Closing the achievement gap between low-income, marginalized, racially, and linguistically diverse students has proven difficult. Research has outlined the effects of funding on student achievement in a manner that focuses the attention on dollars expended, in order overcome barriers to learning. Arizona has long been recognized for its education funding disparity, and its inability to balance fiscal capacity in a manner that serves to improve educational outcomes.
This dissertation examines how Arizona funds its education system. It measures horizontal inequity in a robust manner by examining those fiscal capacity resources directly related to learning and poverty. Recognizing districts with higher concentrations of special needs students will impact fiscal capacity at the district level, this dissertation applies a non-linear analysis to measure how English language learners/ limited English proficient (ELL/ LEP) student proportionality impacts federal and state revenue per pupil, ELL expenditures per pupil, and total expenditures per pupil.
Using the Gini Ratio, McCloone Index, Coefficient of Variation, and Theil inequality index, this dissertation confirms that significant education funding disparity exists across Arizona’s school districts. This dissertation also shows the proportion of English language learners is negatively related to local revenue per pupil, and ELL expenditures per ELL pupil.
Arizona has characteristically funded the public education system inequitably and positioned its students in a manner that stratifies achievement gaps based on wealth. Targeted funding toward ELLs is in no way meaningfully related to the proportion of ELLs in a district. Conceptually the way in which equity is defined, and measured, may require re-evaluation, beyond correlated inputs and outputs. This conceptual re-evaluation of equity must include the decision making process of administrative leaders which influence the quality of those resources related to student learning.
ContributorsMartinez, David G (Author) / Pivovarova, Margarita (Thesis advisor) / Berliner, David C. (Thesis advisor) / Dorn, Sherman (Committee member) / Arizona State University (Publisher)
Created2018
Description
In this article-style dissertation, I explore how students used digital technologies, specifically three social media platforms, as multimodal writing platforms while creating a digital portfolio in a senior English class. These platforms are 1) Weebly pages: a website building platform, 2) Weebly Blogs: a feature of Weebly, and 3) Instagram: a photo/video sharing application. Under a multiliteracies lens, I examine the changing nature of literacies and the educational practices surrounding learning literacies when mediated through social media.
First, I conducted an analysis of how the students in this class designed their portfolios. This is done through an examination of each students’ Weebly homepage as well as an in-depth analysis two focal students across each of the social media platforms as illustrative cases. Findings show the students designed complex multimodal compositions that would have otherwise not been possible with the more formal, rigid forms of writing typical to this classroom. Implications for this study include embracing alternative authoring paths in classrooms beyond traditional forms of text-based writing to allow for students’ interests to be included through their designs.
I also examined how students used each of the platforms and the pedagogical implications for those uses. I found that students used Instagram to write multimodally, which allowed them to express ideas in non-traditional ways that are often not present in classrooms. Students used Weebly pages to publically showcase their writing, which afforded them an opportunity to extend their writing to a larger audience. Students used Weebly Blogs to communicate informally, which allowed them to reflect on connections to the text. I offer implications for how teachers can use social media in the classroom.
Finally, I outline how Ms. Lee and her students oriented to the value of writing in this unit. Findings indicate that Ms. Lee, like many others, privileged print-based forms of writing, even in a more expansive project like the portfolio unit. The students oriented to this value by predominantly making meaning through textual modes throughout their portfolios. Implications extend to teachers expanding their classroom practices beyond the traditional forms of literacy for which they are trained.
First, I conducted an analysis of how the students in this class designed their portfolios. This is done through an examination of each students’ Weebly homepage as well as an in-depth analysis two focal students across each of the social media platforms as illustrative cases. Findings show the students designed complex multimodal compositions that would have otherwise not been possible with the more formal, rigid forms of writing typical to this classroom. Implications for this study include embracing alternative authoring paths in classrooms beyond traditional forms of text-based writing to allow for students’ interests to be included through their designs.
I also examined how students used each of the platforms and the pedagogical implications for those uses. I found that students used Instagram to write multimodally, which allowed them to express ideas in non-traditional ways that are often not present in classrooms. Students used Weebly pages to publically showcase their writing, which afforded them an opportunity to extend their writing to a larger audience. Students used Weebly Blogs to communicate informally, which allowed them to reflect on connections to the text. I offer implications for how teachers can use social media in the classroom.
Finally, I outline how Ms. Lee and her students oriented to the value of writing in this unit. Findings indicate that Ms. Lee, like many others, privileged print-based forms of writing, even in a more expansive project like the portfolio unit. The students oriented to this value by predominantly making meaning through textual modes throughout their portfolios. Implications extend to teachers expanding their classroom practices beyond the traditional forms of literacy for which they are trained.
ContributorsStewart, Olivia Grace (Author) / Anderson, Kate T. (Thesis advisor) / Serafini, Frank (Committee member) / Gee, Elisabeth (Committee member) / Arizona State University (Publisher)
Created2017
Description
Teacher evaluation policies have recently shifted in the United States. For the first time in history, many states, districts, and administrators are now required to evaluate teachers by methods that are up to 50% based on their "value-added," as demonstrated at the classroom-level by growth on student achievement data over time. Other related instruments and methods, such as classroom observations and rubrics, have also become common practices in teacher evaluation systems. Such methods are consistent with the neoliberal discourse that has dominated the social and political sphere for the past three decades. Employing a discourse analytic approach that called upon a governmentality framework, the author used a complementary approach to understand how contemporary teacher evaluation polices, practices, and instruments work to discursively (re)define teachers and teacher quality in terms of their market value.
For the first part of the analysis, the author collected and analyzed documents and field notes related to the teacher evaluation system at one urban middle school. The analysis included official policy documents, official White House speeches and press releases, evaluation system promotional materials, evaluator training materials, and the like. For the second part of the analysis, she interviewed teachers and their evaluators at the local middle school in order to understand how the participants had embodied the market-based discourse to define themselves as teachers and qualify their practice, quality, and worth accordingly.
The findings of the study suggest that teacher evaluation policies, practices, and instruments make possible a variety of techniques, such as numericization, hierarchical surveillance, normalizing judgments, and audit, in order to first make teachers objects of knowledge and then act upon that knowledge to manage teachers' conduct. The author also found that teachers and their evaluators have taken up this discourse in order to think about and act upon themselves as responsibilized subjects. Ultimately, the author argues that while much of the attention related to teacher evaluations has focused on the instruments used to measure the construct of teacher quality, that teacher evaluation instruments work in a mutually constitutive ways to discursively shape the construct of teacher quality.
For the first part of the analysis, the author collected and analyzed documents and field notes related to the teacher evaluation system at one urban middle school. The analysis included official policy documents, official White House speeches and press releases, evaluation system promotional materials, evaluator training materials, and the like. For the second part of the analysis, she interviewed teachers and their evaluators at the local middle school in order to understand how the participants had embodied the market-based discourse to define themselves as teachers and qualify their practice, quality, and worth accordingly.
The findings of the study suggest that teacher evaluation policies, practices, and instruments make possible a variety of techniques, such as numericization, hierarchical surveillance, normalizing judgments, and audit, in order to first make teachers objects of knowledge and then act upon that knowledge to manage teachers' conduct. The author also found that teachers and their evaluators have taken up this discourse in order to think about and act upon themselves as responsibilized subjects. Ultimately, the author argues that while much of the attention related to teacher evaluations has focused on the instruments used to measure the construct of teacher quality, that teacher evaluation instruments work in a mutually constitutive ways to discursively shape the construct of teacher quality.
ContributorsHolloway-Libell, Jessica (Author) / Amrein-Beardsley, Audrey (Thesis advisor) / Anderson, Kate T. (Thesis advisor) / Berliner, David C. (Committee member) / Arizona State University (Publisher)
Created2014