Matching Items (7)
Filtering by
- All Subjects: Educational evaluation
- Creators: Berliner, David C.
- Creators: Rotheram-Fuller, Erin
Description
Although U.S. rates of college enrollment among 18-24 year olds have reached historic highs, rates of degree completion have not kept pace. This is especially evident at community colleges, where a disproportionate number of students from groups who, historically, have had low college-completion rates enroll. One way community colleges are attempting to address low completion rates is by implementing institutional interventions intended to increase opportunities for student engagement at their colleges. Utilizing logistic and linear regression analyses, this study focused on community college students, examining the association between participation in institutional support activities and student outcomes, while controlling for specific student characteristics known to impact student success in college. The sample included 746 first-time, full-time, degree-seeking students at a single community college located in the U.S. Southwest. Additional analyses were conducted for the 440 first-time, full-time, degree-seeking students in this sample who placed into at least one developmental education course. Findings indicate that significant associations exist between different types of participation in institutional interventions and various student outcomes: Academic advising was found to be related to increased rates of Fall to Spring and Fall to Fall persistence and, for developmental education students, participation in a student success course was found to be related to an increase in the proportion of course credit hours earned. The results of this study provide evidence that student participation in institutional-level support may relate to increased rates of college persistence and credit hour completion; however, additional inquiry is warranted to inform specific policy and program decision-making at the college and to determine if these findings are generalizable to populations outside of this college setting.
ContributorsBeckert, Kimberly Marrone (Author) / De Los Santos Jr., Alfredo G (Thesis advisor) / Thompson, Marilyn S (Thesis advisor) / Berliner, David C. (Committee member) / Arizona State University (Publisher)
Created2011
Description
This study examined the intended and unintended consequences associated with the Education Value-Added Assessment System (EVAAS) as perceived and experienced by teachers in the Houston Independent School District (HISD). To evaluate teacher effectiveness, HISD is using EVAAS for high-stakes consequences more than any other district or state in the country. A large-scale electronic survey was used to investigate the model's reliability and validity; to determine whether teachers used the EVAAS data in formative ways as intended; to gather teachers' opinions on EVAAS's claimed benefits and statements; and to understand the unintended consequences that occurred as a result of EVAAS use in HISD. Mixed methods data collection and analyses were used to present the findings in user-friendly ways, particularly when using the words and experiences of the teachers themselves. Results revealed that the reliability of the EVAAS model produced split and inconsistent results among teacher participants, and teachers indicated that students biased the EVAAS results. The majority of teachers did not report similar EVAAS and principal observation scores, reducing the criterion-related validity of both measures of teacher quality. Teachers revealed discrepancies in the distribution of EVAAS reports, the awareness of trainings offered, and among principals' understanding of EVAAS across the district. This resulted in an underwhelming number of teachers who reportedly used EVAAS data for formative purposes. Teachers disagreed with EVAAS marketing claims, implying the majority did not believe EVAAS worked as intended and promoted. Additionally, many unintended consequences associated with the high-stakes use of EVAAS emerged through teachers' responses, which revealed among others that teachers felt heightened pressure and competition, which reduced morale and collaboration, and encouraged cheating or teaching to the test in attempt to raise EVAAS scores. This study is one of the first to investigate how the EVAAS model works in practice and provides a glimpse of whether value-added models might produce desired outcomes and encourage best teacher practices. This is information of which policymakers, researchers, and districts should be aware and consider when implementing the EVAAS, or any value-added model for teacher evaluation, as many of the reported issues are not specific to the EVAAS model.
ContributorsCollins, Clarin (Author) / Amrein-Beardsley, Audrey (Thesis advisor) / Berliner, David C. (Committee member) / Fischman, Gustavo E (Committee member) / Arizona State University (Publisher)
Created2012
Description
In the next decade, community college English departments will expand their developmental course offerings. The students who take these developmental courses generally have higher incidence of diagnosed learnin g disabilities, bleak economic circumstances that require them to work full time, greater dependence on public transporation, and some level of frustration and confusion about being placed in a non-credit course despite graduating from high school. Using a qualitative approach, this action research study articulates the faculty behaviors, classroom environments, and faculty-student interactions that help developmental writing students succeed. The researcher interviewed successful students about what the faculty members did that helped them succeed in developmental writing classes. Then the researcher created and tested a checklist to help writing instructors conform their practices to best practices identified in published research and interviews with successful students. Instructors found the checklist useful in evaluating their own practices in relation to the current research.
ContributorsBixler, L. Ann (Laura Ann) (Author) / Clark, Christopher M. (Thesis advisor) / Rund, James (Thesis advisor) / Young, Donna (Committee member) / Arizona State University (Publisher)
Created2012
Description
“If you treat an individual as he is, he will stay as he is,
but if you treat him as if he were what he ought to be
and could be, he will become what he ought and could be.”
Johann Wolfgang von Goethe (1749-1832)
Teacher leaders in public education have a great amount of responsibility on their shoulders in today’s political climate. They are responsible for evaluating instruction, improving the teaching force, and raising student achievement. These responsibilities coupled with the day-to-day demands of effectively running a school have caused many teacher leaders to disengage from the true purpose of their work and have lead to retention rates that are less than desirable. This mixed methods action research study was conducted to investigate how participation in L.E.A.D. (Learn. Engage. Act. Discuss.) groups, influenced the self-perceptions teacher leaders have of their ability to engage in the change process at their schools. The innovation was a series of three action-driven sessions aimed at providing the participating teacher leaders with a space to discuss their roles in the change process at their school, their perceived engagement in those processes, and their perceived ability to navigate the technical, normative, and political dimensions of change. The greater purpose behind the design of this innovation was to provide teacher leaders with tools they could utilize that would support them in the realization that their level of engagement was not totally dependent on those around them. Through the L.E.A.D. groups, it became evident that the participating teacher leaders were resilient and optimistic individuals that, despite factors outside of their control demanding their time and energy, were still dedicated to the change process at their schools.
but if you treat him as if he were what he ought to be
and could be, he will become what he ought and could be.”
Johann Wolfgang von Goethe (1749-1832)
Teacher leaders in public education have a great amount of responsibility on their shoulders in today’s political climate. They are responsible for evaluating instruction, improving the teaching force, and raising student achievement. These responsibilities coupled with the day-to-day demands of effectively running a school have caused many teacher leaders to disengage from the true purpose of their work and have lead to retention rates that are less than desirable. This mixed methods action research study was conducted to investigate how participation in L.E.A.D. (Learn. Engage. Act. Discuss.) groups, influenced the self-perceptions teacher leaders have of their ability to engage in the change process at their schools. The innovation was a series of three action-driven sessions aimed at providing the participating teacher leaders with a space to discuss their roles in the change process at their school, their perceived engagement in those processes, and their perceived ability to navigate the technical, normative, and political dimensions of change. The greater purpose behind the design of this innovation was to provide teacher leaders with tools they could utilize that would support them in the realization that their level of engagement was not totally dependent on those around them. Through the L.E.A.D. groups, it became evident that the participating teacher leaders were resilient and optimistic individuals that, despite factors outside of their control demanding their time and energy, were still dedicated to the change process at their schools.
ContributorsSaltmarsh, Sarah Schmaltz (Author) / Liou, Daniel D (Thesis advisor) / Rotheram-Fuller, Erin (Committee member) / Shaw, Ann (Committee member) / Arizona State University (Publisher)
Created2016
Description
Increasing public criticism of traditional teacher evaluation systems based largely on classroom observations has spurred an unprecedented shift in the debate surrounding educational accountability policies, specifically about the purposes for and measures used to evaluate teachers. In response to growing public demand and associated federal mandates, states have been prompted to design and implement teacher evaluation systems that use increasingly available, statistically complex models (i.e., value-added) intended to isolate and measure the effects of individual teachers on student academic growth over time. The purpose of this study was to examine the perceptions of school administrators and teachers within one of the largest school districts in the state of Arizona with regards to the design and implementation of a federally-supported, state policy-directed teacher evaluation system based on professional practice and value-added measures. While much research has been conducted on teacher evaluation, few studies have examined teacher evaluation systems in context to better understand the standards of effectiveness used by school administrators and teachers to measure system effectiveness. The perceptions of school administrators and teachers, considering their lived experiences as the subjects of the nation's new and improved teacher evaluation systems in context, must be better understood if state and federal policymakers are to also better recognize and understand the consequences (intended and unintended) associated with the design and implementation of these systems in practice.
ContributorsPaufler, Noelle A (Author) / Amrein-Beardsley, Audrey L (Thesis advisor) / Berliner, David C. (Committee member) / Fischman, Gustavo E (Committee member) / Arizona State University (Publisher)
Created2014
Norming at scale: faculty perceptions of assessment culture and student learning outcomes assessment
Description
To foster both external and internal accountability, universities seek more effective models for student learning outcomes assessment (SLOA). Meaningful and authentic measurement of program-level student learning outcomes requires engagement with an institution’s faculty members, especially to gather student performance assessment data using common scoring instruments, or rubrics, across a university’s many colleges and programs. Too often, however, institutions rely on faculty engagement for SLOA initiatives like this without providing necessary support, communication, and training. The resulting data may lack sufficient reliability and reflect deficiencies in an institution’s culture of assessment.
This mixed methods action research study gauged how well one form of SLOA training – a rubric-norming workshop – could affect both inter-rater reliability for faculty scorers and faculty perceptions of SLOA while exploring the nature of faculty collaboration toward a shared understanding of student learning outcomes. The study participants, ten part-time faculty members at the institution, each held primary careers in the health care industry, apart from their secondary role teaching university courses. Accordingly, each contributed expertise and experience to the rubric-norming discussions, surveys of assessment-related perceptions, and individual scoring of student performance with a common rubric. Drawing on sociocultural learning principles and the specific lens of activity theory, influences on faculty SLOA were arranged and analyzed within the heuristic framework of an activity system to discern effects of collaboration and perceptions toward SLOA on consistent rubric-scoring by faculty participants.
Findings suggest participation in the study did not correlate to increased inter-rater reliability for faculty scorers when using the common rubric. Constraints found within assessment tools and unclear institutional leadership prevented more reliable use of common rubrics. Instead, faculty participants resorted to individual assessment approaches to meaningfully guide students to classroom achievement and preparation for careers in the health care field. Despite this, faculty participants valued SLOA, collaborated readily with colleagues for shared assessment goals, and worked hard to teach and assess students meaningfully.
This mixed methods action research study gauged how well one form of SLOA training – a rubric-norming workshop – could affect both inter-rater reliability for faculty scorers and faculty perceptions of SLOA while exploring the nature of faculty collaboration toward a shared understanding of student learning outcomes. The study participants, ten part-time faculty members at the institution, each held primary careers in the health care industry, apart from their secondary role teaching university courses. Accordingly, each contributed expertise and experience to the rubric-norming discussions, surveys of assessment-related perceptions, and individual scoring of student performance with a common rubric. Drawing on sociocultural learning principles and the specific lens of activity theory, influences on faculty SLOA were arranged and analyzed within the heuristic framework of an activity system to discern effects of collaboration and perceptions toward SLOA on consistent rubric-scoring by faculty participants.
Findings suggest participation in the study did not correlate to increased inter-rater reliability for faculty scorers when using the common rubric. Constraints found within assessment tools and unclear institutional leadership prevented more reliable use of common rubrics. Instead, faculty participants resorted to individual assessment approaches to meaningfully guide students to classroom achievement and preparation for careers in the health care field. Despite this, faculty participants valued SLOA, collaborated readily with colleagues for shared assessment goals, and worked hard to teach and assess students meaningfully.
ContributorsWilliams, Nicholas (Author) / Liou, Daniel D (Thesis advisor) / Rotheram-Fuller, Erin (Committee member) / Turbow, David (Committee member) / Arizona State University (Publisher)
Created2018
Description
Peer coaching is an emerging approach higher education institutions are using to increase student success outcomes for first-year students. This study examined how peer coaches use their community cultural wealth with the students they coach and how coaching encouraged first-generation students to access the community cultural wealth they bring with them to college. The theoretical framework guiding this study was Yosso’s theory of community cultural wealth. I used a qualitative approach and interviewed five peer coaches and conducted focus groups with 15 first-generation, first-year students who had received coaching. Findings indicate peer coaches used the six dimensions of community cultural wealth with students they coach, including aspirational, familial, linguistic, navigational, resistant, and social capital. Students also reported peer coaching helped them access their community cultural wealth, especially as compared to advising and faculty interactions. Three key differentiators emerged when comparing coaching to other forms of support: relatability, sense of belonging, and self-confidence.
ContributorsSymonds, Sylvia (Author) / Garcia, David (Thesis advisor) / Rund, James (Committee member) / Ott, Molly (Committee member) / Arizona State University (Publisher)
Created2020