Matching Items (986)
Description
This study examined the intended and unintended consequences associated with the Education Value-Added Assessment System (EVAAS) as perceived and experienced by teachers in the Houston Independent School District (HISD). To evaluate teacher effectiveness, HISD is using EVAAS for high-stakes consequences more than any other district or state in the country. A large-scale electronic survey was used to investigate the model's reliability and validity; to determine whether teachers used the EVAAS data in formative ways as intended; to gather teachers' opinions on EVAAS's claimed benefits and statements; and to understand the unintended consequences that occurred as a result of EVAAS use in HISD. Mixed methods data collection and analyses were used to present the findings in user-friendly ways, particularly when using the words and experiences of the teachers themselves. Results revealed that the reliability of the EVAAS model produced split and inconsistent results among teacher participants, and teachers indicated that students biased the EVAAS results. The majority of teachers did not report similar EVAAS and principal observation scores, reducing the criterion-related validity of both measures of teacher quality. Teachers revealed discrepancies in the distribution of EVAAS reports, the awareness of trainings offered, and among principals' understanding of EVAAS across the district. This resulted in an underwhelming number of teachers who reportedly used EVAAS data for formative purposes. Teachers disagreed with EVAAS marketing claims, implying the majority did not believe EVAAS worked as intended and promoted. Additionally, many unintended consequences associated with the high-stakes use of EVAAS emerged through teachers' responses, which revealed among others that teachers felt heightened pressure and competition, which reduced morale and collaboration, and encouraged cheating or teaching to the test in attempt to raise EVAAS scores. This study is one of the first to investigate how the EVAAS model works in practice and provides a glimpse of whether value-added models might produce desired outcomes and encourage best teacher practices. This is information of which policymakers, researchers, and districts should be aware and consider when implementing the EVAAS, or any value-added model for teacher evaluation, as many of the reported issues are not specific to the EVAAS model.
ContributorsCollins, Clarin (Author) / Amrein-Beardsley, Audrey (Thesis advisor) / Berliner, David C. (Committee member) / Fischman, Gustavo E (Committee member) / Arizona State University (Publisher)
Created2012
Description
ABSTRACT
This study examines validity evidence of a state policy-directed teacher evaluation system implemented in Arizona during school year 2012-2013. The purpose was to evaluate the warrant for making high stakes, consequential judgments of teacher competence based on value-added (VAM) estimates of instructional impact and observations of professional practice (PP). The research also explores educator influence (voice) in evaluation design and the role information brokers have in local decision making. Findings are situated in an evidentiary and policy context at both the LEA and state policy levels.
The study employs a single-phase, concurrent, mixed-methods research design triangulating multiple sources of qualitative and quantitative evidence onto a single (unified) validation construct: Teacher Instructional Quality. It focuses on assessing the characteristics of metrics used to construct quantitative ratings of instructional competence and the alignment of stakeholder perspectives to facets implicit in the evaluation framework. Validity examinations include assembly of criterion, content, reliability, consequential and construct articulation evidences. Perceptual perspectives were obtained from teachers, principals, district leadership, and state policy decision makers. Data for this study came from a large suburban public school district in metropolitan Phoenix, Arizona.
Study findings suggest that the evaluation framework is insufficient for supporting high stakes, consequential inferences of teacher instructional quality. This is based, in part on the following: (1) Weak associations between VAM and PP metrics; (2) Unstable VAM measures across time and between tested content areas; (3) Less than adequate scale reliabilities; (4) Lack of coherence between theorized and empirical PP factor structures; (5) Omission/underrepresentation of important instructional attributes/effects; (6) Stakeholder concerns over rater consistency, bias, and the inability of test scores to adequately represent instructional competence; (7) Negative sentiments regarding the system's ability to improve instructional competence and/or student learning; (8) Concerns regarding unintended consequences including increased stress, lower morale, harm to professional identity, and restricted learning opportunities; and (9) The general lack of empowerment and educator exclusion from the decision making process. Study findings also highlight the value of information brokers in policy decision making and the importance of having access to unbiased empirical information during the design and implementation phases of important change initiatives.
This study examines validity evidence of a state policy-directed teacher evaluation system implemented in Arizona during school year 2012-2013. The purpose was to evaluate the warrant for making high stakes, consequential judgments of teacher competence based on value-added (VAM) estimates of instructional impact and observations of professional practice (PP). The research also explores educator influence (voice) in evaluation design and the role information brokers have in local decision making. Findings are situated in an evidentiary and policy context at both the LEA and state policy levels.
The study employs a single-phase, concurrent, mixed-methods research design triangulating multiple sources of qualitative and quantitative evidence onto a single (unified) validation construct: Teacher Instructional Quality. It focuses on assessing the characteristics of metrics used to construct quantitative ratings of instructional competence and the alignment of stakeholder perspectives to facets implicit in the evaluation framework. Validity examinations include assembly of criterion, content, reliability, consequential and construct articulation evidences. Perceptual perspectives were obtained from teachers, principals, district leadership, and state policy decision makers. Data for this study came from a large suburban public school district in metropolitan Phoenix, Arizona.
Study findings suggest that the evaluation framework is insufficient for supporting high stakes, consequential inferences of teacher instructional quality. This is based, in part on the following: (1) Weak associations between VAM and PP metrics; (2) Unstable VAM measures across time and between tested content areas; (3) Less than adequate scale reliabilities; (4) Lack of coherence between theorized and empirical PP factor structures; (5) Omission/underrepresentation of important instructional attributes/effects; (6) Stakeholder concerns over rater consistency, bias, and the inability of test scores to adequately represent instructional competence; (7) Negative sentiments regarding the system's ability to improve instructional competence and/or student learning; (8) Concerns regarding unintended consequences including increased stress, lower morale, harm to professional identity, and restricted learning opportunities; and (9) The general lack of empowerment and educator exclusion from the decision making process. Study findings also highlight the value of information brokers in policy decision making and the importance of having access to unbiased empirical information during the design and implementation phases of important change initiatives.
ContributorsSloat, Edward F. (Author) / Wetzel, Keith (Thesis advisor) / Amrein-Beardsley, Audrey (Thesis advisor) / Ewbank, Ann (Committee member) / Shough, Lori (Committee member) / Arizona State University (Publisher)
Created2015
Description
This mixed-methods study explored perceptions of new adjuncts on various trainings with regards to satisfying their professional and aspirational needs. Three trainings were offered in fall 2018 quarter as optional professional development: workshop, and two roundtable sessions. These trainings assisted adjuncts with their teaching skills, educational technology and pedagogy. Guidance was provided from experienced adjuncts and staff.
Surveys and interviews with adjuncts, along with a focus group with staff were the sources of data for this study. A repeated measures Analysis of Covariance (ANCOVA) model was utilized. Analysis of data showed that there was a positive and statistical significance of change in perceptions of adjuncts who participated in all trainings towards fulfilling their needs, as compared to those who did not participate in any trainings. Adjuncts perceived an improvement in their professional growth based on Herzberg’s motivation-hygiene theory and the trainings also fulfilled their higher-level growth needs based on Maslow’s hierarchical needs theory. A large practical significance was also found which measures the practical impact of such trainings at local communities of practice.
Surveys and interviews with adjuncts, along with a focus group with staff were the sources of data for this study. A repeated measures Analysis of Covariance (ANCOVA) model was utilized. Analysis of data showed that there was a positive and statistical significance of change in perceptions of adjuncts who participated in all trainings towards fulfilling their needs, as compared to those who did not participate in any trainings. Adjuncts perceived an improvement in their professional growth based on Herzberg’s motivation-hygiene theory and the trainings also fulfilled their higher-level growth needs based on Maslow’s hierarchical needs theory. A large practical significance was also found which measures the practical impact of such trainings at local communities of practice.
ContributorsSreekaram, Siddhartha (Author) / Marsh, Josephine (Thesis advisor) / Amrein-Beardsley, Audrey (Committee member) / Kim, Jeongeun (Committee member) / Arizona State University (Publisher)
Created2019
Description
With the new independence of adulthood, college students are a group susceptible to adopting unsupported, if not harmful, health practices. A survey of Arizona State University undergraduate students (N=200) was conducted to evaluate supplement use, trust in information sources, and beliefs about supplement regulation. Of those who reported using supplements, college students most frequently received information from friends and family. STEM majors in fields unrelated to health who were taking a supplement were found to be less likely to receive information about the supplement from a medical practitioner than those in health fields or those in non-STEM majors (-26.9%, p=0.018). STEM majors in health-related fields were 15.0% more likely to treat colds and/or cold symptoms with research-supported methods identified from reliable sources, while non-health STEM and non-STEM majors were more likely to take unsupported cold treatments (p=0.010). Surveyed students, regardless of major, also stated they would trust a medical practitioner for supplement advice above other sources (88.0%), and the majority expressed a belief that dietary supplements are approved/regulated by the government (59.8%).
ContributorsPerez, Jacob Tanner (Author) / Hendrickson, Kirstin (Thesis director) / Lefler, Scott (Committee member) / College of Liberal Arts and Sciences (Contributor) / School of Molecular Sciences (Contributor) / Department of Physics (Contributor) / Barrett, The Honors College (Contributor)
Created2018-05
ContributorsChandler, N. Kayla (Author) / Neisewander, Janet (Thesis director) / Sanabria, Federico (Committee member) / Olive, M. Foster (Committee member) / Barrett, The Honors College (Contributor) / College of Liberal Arts and Sciences (Contributor)
Created2013-05
Description
I propose that norms regulate behaviors that negatively impact an individual's survival and reproduction. But because monitoring and enforcing of norms can be costly, individuals should be selective about which norms they police and under what circumstances they should do so. Two studies tested this idea by experimentally activating fitness-relevant motives and having participants answer questions about the policing of norms. The first study examined a norm prescribing respect for status and another proscribing sexual coercion. Results from Study 1 failed to support the hypotheses; activating a status-seeking motive did not have the predicted effects on policing of the respect-status norm nor did activating a mating motive have the predicted effects on policing of the respect-status norm or anti-coercion norm. Study 2 examined two new norms, one prescribing that people stay home when sick and the other proscribing people from having sex with another person's partners. Study 2 also manipulated whether self or others were the target of the policing. Study 2 failed to provide support; a disease avoidance motive failed to have effects on policing of the stay home when sick norm. Individuals in a relationship under a mating motive wanted less policing of others for violation of the mate poaching norm than those in a baseline condition, opposite of the predicted effects.
ContributorsSmith, M. Kristopher (Author) / Neuberg, L. Steven (Thesis director) / Presson, Clark (Committee member) / Hruschka, J. Daniel (Committee member) / Barrett, The Honors College (Contributor) / College of Liberal Arts and Sciences (Contributor)
Created2013-05
Description
Literature in public administration emphasizes a growing dissatisfaction with government on the part of residents. Where there tends to be a lack in the literature is in terms of solutions to this problem. We would like to argue that the engagement process itself has the power to foster a profound attitudinal shift on the part of both residents and government. This paper explores the structural and cultural barriers to satisfactory public engagement both from literature and a combination of policy analysis, semi-structured interviews and participatory observation within the City of Tempe. We then provide recommendations to the City of Tempe on how to overcome these barriers and effect authentic public engagement practices. With these new suggested practices and mindsets, we provide a way that people can have the power to create their own community.
ContributorsRiffle, Morgan (Co-author) / Tchida, Celina (Co-author) / Ingram-Waters, Mary (Thesis director) / Grzanka, Patrick (Committee member) / King, Cheryl (Committee member) / Barrett, The Honors College (Contributor) / College of Liberal Arts and Sciences (Contributor)
Created2013-05
Description
This thesis examines the relationship between unofficial, official, and parallel Islam in Uzbekistan following the end of the Soviet Union. Key touchstone moments in Uzbekistan during the twentieth-century show the history between unofficial and official Islam and the resulting precedents set for Muslims gathering against the government. This historical analysis shows how President Karimov and the Uzbek government view and approach Islam in the country following independence.
ContributorsTieslink, Evan (Author) / Batalden, Stephen (Thesis director) / Kefeli, Agnes (Committee member) / Saikia, Yasmin (Committee member) / Barrett, The Honors College (Contributor) / College of Liberal Arts and Sciences (Contributor) / School of Politics and Global Studies (Contributor) / School of Historical, Philosophical and Religious Studies (Contributor)
Created2013-05
Description
Through this creative project, I executed a Distracted Driving Awareness Campaign at Arizona State University to raise awareness about the dangers of distracted driving, specifically texting while driving. As an Undergraduate Student Government Senator, my priority is the safety and success of students, both in and out of the classroom. By partnering with State Farm and AT&T, we were able to raise awareness about the dangers of distracted driving and collected over 200 pledges from students to never text and drive.
ContributorsHibbs, Jordan Ashley (Author) / Miller, Clark (Thesis director) / Parmentier, Mary Jane (Committee member) / Barrett, The Honors College (Contributor) / College of Liberal Arts and Sciences (Contributor) / School of Politics and Global Studies (Contributor) / Department of Psychology (Contributor) / Graduate College (Contributor)
Created2014-05
Description
Teen dating violence is a significant problem in the U.S., with approximately 1 out of 3 teens experiencing some form of dating violence. BLOOM is a not-for-profit organization created by Donna Bartos. BLOOM's educators enter high schools in Arizona and present their educational program on dating abuse prevention. BLOOM's primary goal is to educate teens on how to prevent teen dating violence and empower them with the skills leading to healthy relationships. After participants complete their educational program, a feedback card is filled out with an open-response section. This project focused on the open response section to analyze feedback cards through a process of code development, coding, and tallying. Information provided by this project could assist BLOOM in re-evaluating their curriculum, appealing to future investors, and growing their program to reach more students. With a coding system in place, BLOOM will also be able to better assess the impact they have on the participants of their program.
ContributorsHarmon, Ashley Nicole (Author) / Bodman, Denise (Thesis director) / Dumka, Larry (Committee member) / T. Denny Sanford School of Social and Family Dynamics (Contributor) / College of Liberal Arts and Sciences (Contributor) / Barrett, The Honors College (Contributor)
Created2016-05