Matching Items (5)
Filtering by

Clear all filters

Description
ABSTRACT

This study examines validity evidence of a state policy-directed teacher evaluation system implemented in Arizona during school year 2012-2013. The purpose was to evaluate the warrant for making high stakes, consequential judgments of teacher competence based on value-added (VAM) estimates of instructional impact and observations of professional practice (PP).

ABSTRACT

This study examines validity evidence of a state policy-directed teacher evaluation system implemented in Arizona during school year 2012-2013. The purpose was to evaluate the warrant for making high stakes, consequential judgments of teacher competence based on value-added (VAM) estimates of instructional impact and observations of professional practice (PP). The research also explores educator influence (voice) in evaluation design and the role information brokers have in local decision making. Findings are situated in an evidentiary and policy context at both the LEA and state policy levels.

The study employs a single-phase, concurrent, mixed-methods research design triangulating multiple sources of qualitative and quantitative evidence onto a single (unified) validation construct: Teacher Instructional Quality. It focuses on assessing the characteristics of metrics used to construct quantitative ratings of instructional competence and the alignment of stakeholder perspectives to facets implicit in the evaluation framework. Validity examinations include assembly of criterion, content, reliability, consequential and construct articulation evidences. Perceptual perspectives were obtained from teachers, principals, district leadership, and state policy decision makers. Data for this study came from a large suburban public school district in metropolitan Phoenix, Arizona.

Study findings suggest that the evaluation framework is insufficient for supporting high stakes, consequential inferences of teacher instructional quality. This is based, in part on the following: (1) Weak associations between VAM and PP metrics; (2) Unstable VAM measures across time and between tested content areas; (3) Less than adequate scale reliabilities; (4) Lack of coherence between theorized and empirical PP factor structures; (5) Omission/underrepresentation of important instructional attributes/effects; (6) Stakeholder concerns over rater consistency, bias, and the inability of test scores to adequately represent instructional competence; (7) Negative sentiments regarding the system's ability to improve instructional competence and/or student learning; (8) Concerns regarding unintended consequences including increased stress, lower morale, harm to professional identity, and restricted learning opportunities; and (9) The general lack of empowerment and educator exclusion from the decision making process. Study findings also highlight the value of information brokers in policy decision making and the importance of having access to unbiased empirical information during the design and implementation phases of important change initiatives.
ContributorsSloat, Edward F. (Author) / Wetzel, Keith (Thesis advisor) / Amrein-Beardsley, Audrey (Thesis advisor) / Ewbank, Ann (Committee member) / Shough, Lori (Committee member) / Arizona State University (Publisher)
Created2015
136787-Thumbnail Image.png
Description
There is a serious need for early childhood intervention practices for children who are living at or below the poverty line. Since 1965 Head Start has provided a federally funded, free preschool program for children in this population. The City of Phoenix Head Start program consists of nine delegate agencies,

There is a serious need for early childhood intervention practices for children who are living at or below the poverty line. Since 1965 Head Start has provided a federally funded, free preschool program for children in this population. The City of Phoenix Head Start program consists of nine delegate agencies, seven of which reside in school districts. These agencies are currently not conducting local longitudinal evaluations of their preschool graduates. The purpose of this study was to recommend initial steps the City of Phoenix grantee and the delegate agencies can take to begin a longitudinal evaluation process of their Head Start programs. Seven City of Phoenix Head Start agency directors were interviewed. These interviews provided information about the attitudes of the directors when considering longitudinal evaluations and how Head Start already evaluates their programs through internal assessments. The researcher also took notes on the Third Grade Follow-Up to the Head Start Executive Summary in order to make recommendations to the City of Phoenix Head Start programs about the best practices for longitudinal student evaluations.
Created2014-05
137238-Thumbnail Image.png
Description
Conducted in collaboration with the Arizona Coalition to End Sexual and Domestic Violence, this project was a pilot survey of representatives at sexual violence organizations in Arizona and a best practices review of sexual violence organizations. It was carried out with the purpose of enhancing ACESDV's knowledge about sexual violence

Conducted in collaboration with the Arizona Coalition to End Sexual and Domestic Violence, this project was a pilot survey of representatives at sexual violence organizations in Arizona and a best practices review of sexual violence organizations. It was carried out with the purpose of enhancing ACESDV's knowledge about sexual violence organizations so that the coalition will be able to offer informed and individualized support to these organizations in Arizona as it begins to pursue its new mission of addressing sexual violence.
ContributorsHarrach, Meagan L. (Author) / Bodman, Denise (Thesis director) / Dumka, Larry (Committee member) / Barrett, The Honors College (Contributor) / T. Denny Sanford School of Social and Family Dynamics (Contributor) / School of International Letters and Cultures (Contributor)
Created2014-05
135697-Thumbnail Image.png
Description
The Community Action Research Experiences (CARE) program collaborated with Singleton Moms, a local non-profit organization that provides financial, psychological, and social support services to single parents with cancer. The purpose of this action research project was to assess the volunteer program at Singleton Moms. Both past and present Singleton Moms'

The Community Action Research Experiences (CARE) program collaborated with Singleton Moms, a local non-profit organization that provides financial, psychological, and social support services to single parents with cancer. The purpose of this action research project was to assess the volunteer program at Singleton Moms. Both past and present Singleton Moms' volunteers (N = 123; 87.0% female) completed an online survey assessing their motivation for volunteering and their satisfaction with the organization. A mixed ANOVA was conducted to identify the most important motivation and satisfaction domains and to see if the findings depended on whether the volunteers were current or past volunteers. For the motivation assessment, results indicated that the volunteers rate the cancer specific and moral/human kindness domains as the strongest reasons for motivating them to volunteer at Singleton Moms. In addition, results revealed that the social connection motivation domain was the only domain with differences between the ratings of the past and present volunteers. For the satisfaction assessment, results indicated that the volunteers rate the organizational climate domain as the most fulfilled area of satisfaction within the Singleton Moms' volunteer program. It was also revealed that there were no significant differences between the ratings of the past and present volunteers among all satisfaction domains. Both the quantitative and qualitative findings suggest that Singleton Moms' implications for action may include: 1) a volunteer database audit, 2) streamlining communications, 3) variability in volunteer times, and 4) bolstering volunteer motivation. Implementing some of these actions may help Singleton Moms increase volunteer motivation and satisfaction and thus create a more effective volunteer program. Ultimately, this may encourage volunteers to continue their services at Singleton Moms and thus help Singleton Moms expand their support programs and assist additional families.
ContributorsDubois, Courtney Michelle (Author) / Miller, Cindy (Thesis director) / Dumka, Larry (Committee member) / Harrington Bioengineering Program (Contributor) / Barrett, The Honors College (Contributor) / T. Denny Sanford School of Social and Family Dynamics (Contributor)
Created2016-05
135293-Thumbnail Image.png
Description
There is a widespread inequality in health care access and insured rates suffered by the Latino, Spanish-speaking population in Arizona, resulting in poor health measures and economic burden. The passage of the Affordable Care Act in 2010 provided mechanisms to alleviate this disparity, however, many Latino communities lack accessible information

There is a widespread inequality in health care access and insured rates suffered by the Latino, Spanish-speaking population in Arizona, resulting in poor health measures and economic burden. The passage of the Affordable Care Act in 2010 provided mechanisms to alleviate this disparity, however, many Latino communities lack accessible information and means to gain access to health insurance enrollment. Chicanos Por La Causa (CPLC) is a community based organizing that provides many services to low-income communities across Arizona, one of which is the CPLC Insurance Program. In collaboration with the Community Action Research Experiences (CARE) at Arizona State University, the program was studied to help address the need of a LOGIC model and evaluation plan to determine its effectiveness. Interviews with three executives within CPLC were conducted in conjunction with a literature review to determine the inputs, strategies, outputs, and outcomes of the LOGIC model that drive CPLC Insurance's mission. Evaluation measures were then created to provide the necessary quantitative data that can best show to what degree the program is achieving its goals. Specifically, the results indicated the key outcomes that drive the LOGIC model, and an evaluation plan designed to provide indicators of these outcomes was produced. The implications of this study are that the suggested data collection can verify how effectively the program's actions are creating positive change, as well as show where further improvements may be necessary to maximize effectiveness.
ContributorsCunningham, Matthew Lee (Author) / Fey, Richard (Thesis director) / Dumka, Larry (Committee member) / School of Molecular Sciences (Contributor) / Department of Psychology (Contributor) / Barrett, The Honors College (Contributor) / T. Denny Sanford School of Social and Family Dynamics (Contributor)
Created2016-05