Matching Items (4)
Filtering by
- All Subjects: Higher Education Administration
- Creators: Rotheram-Fuller, Erin
- Creators: Smith, Sharon
- Resource Type: Text
- Status: Published
Norming at scale: faculty perceptions of assessment culture and student learning outcomes assessment
Description
To foster both external and internal accountability, universities seek more effective models for student learning outcomes assessment (SLOA). Meaningful and authentic measurement of program-level student learning outcomes requires engagement with an institution’s faculty members, especially to gather student performance assessment data using common scoring instruments, or rubrics, across a university’s many colleges and programs. Too often, however, institutions rely on faculty engagement for SLOA initiatives like this without providing necessary support, communication, and training. The resulting data may lack sufficient reliability and reflect deficiencies in an institution’s culture of assessment.
This mixed methods action research study gauged how well one form of SLOA training – a rubric-norming workshop – could affect both inter-rater reliability for faculty scorers and faculty perceptions of SLOA while exploring the nature of faculty collaboration toward a shared understanding of student learning outcomes. The study participants, ten part-time faculty members at the institution, each held primary careers in the health care industry, apart from their secondary role teaching university courses. Accordingly, each contributed expertise and experience to the rubric-norming discussions, surveys of assessment-related perceptions, and individual scoring of student performance with a common rubric. Drawing on sociocultural learning principles and the specific lens of activity theory, influences on faculty SLOA were arranged and analyzed within the heuristic framework of an activity system to discern effects of collaboration and perceptions toward SLOA on consistent rubric-scoring by faculty participants.
Findings suggest participation in the study did not correlate to increased inter-rater reliability for faculty scorers when using the common rubric. Constraints found within assessment tools and unclear institutional leadership prevented more reliable use of common rubrics. Instead, faculty participants resorted to individual assessment approaches to meaningfully guide students to classroom achievement and preparation for careers in the health care field. Despite this, faculty participants valued SLOA, collaborated readily with colleagues for shared assessment goals, and worked hard to teach and assess students meaningfully.
This mixed methods action research study gauged how well one form of SLOA training – a rubric-norming workshop – could affect both inter-rater reliability for faculty scorers and faculty perceptions of SLOA while exploring the nature of faculty collaboration toward a shared understanding of student learning outcomes. The study participants, ten part-time faculty members at the institution, each held primary careers in the health care industry, apart from their secondary role teaching university courses. Accordingly, each contributed expertise and experience to the rubric-norming discussions, surveys of assessment-related perceptions, and individual scoring of student performance with a common rubric. Drawing on sociocultural learning principles and the specific lens of activity theory, influences on faculty SLOA were arranged and analyzed within the heuristic framework of an activity system to discern effects of collaboration and perceptions toward SLOA on consistent rubric-scoring by faculty participants.
Findings suggest participation in the study did not correlate to increased inter-rater reliability for faculty scorers when using the common rubric. Constraints found within assessment tools and unclear institutional leadership prevented more reliable use of common rubrics. Instead, faculty participants resorted to individual assessment approaches to meaningfully guide students to classroom achievement and preparation for careers in the health care field. Despite this, faculty participants valued SLOA, collaborated readily with colleagues for shared assessment goals, and worked hard to teach and assess students meaningfully.
ContributorsWilliams, Nicholas (Author) / Liou, Daniel D (Thesis advisor) / Rotheram-Fuller, Erin (Committee member) / Turbow, David (Committee member) / Arizona State University (Publisher)
Created2018
Description
Civic engagement is often defined as political activism; to be a part of governmental decision making, the practices thereof, and various efforts of participation in voting. However, civic engagement is also known for its role within non-political work, such as community building and development. Because of the former definition many members of our society have a tendency to not embrace the full potential of their community roles. It is always about who is a Republican, who is a Democrat, who looks better, or who has a better name. Now it must be noted that this is not in absolute, not all members of our society work in this thought process, but many still do. If that doesn't come as a surprise to you, then the simplicity of how you can be an engaged member will. As a student attending Arizona State University at the West campus in Phoenix, Arizona, I have chosen to challenge the traditional view of civic engagement and prepare this development plan for the campus community. Having done so, I not only discovered the paths that one can take to be engaged in such matters, but also continued my role as a civil servant.
ContributorsWaldie, Howard William (Author) / Ackroyd, William (Thesis director) / Smith, Sharon (Committee member) / Alvarez Manninen, Bertha (Committee member) / Barrett, The Honors College (Contributor) / School of Social and Behavioral Sciences (Contributor) / School of Humanities, Arts, and Cultural Studies (Contributor)
Created2015-05
Description
First-generation college students are an underrepresented group in terms of study
abroad participation nationally and at Arizona State University (ASU). The ASU and
International Studies Abroad (ISA) Planning Scholars Scholarship Program was
developed to support first-generation college students in their pursuit of study abroad.
This mixed-methods study examined what the specific needs of first-generation college
students are as they pursue study abroad experiences and what effect the ASU and ISA
Planning Scholars Program had on them. A combination of surveys, semi-structured
interviews, and a photovoice project provided data for the study. Key findings included
that first-generation college students had concerns about finances, finding a study abroad
program that would keep them on track for graduation, making friends while they study
abroad, and traveling abroad alone. The study indicated that the Planning Scholars
program did increase students’ confidence in pursuing study abroad. Additionally, the
theory of First-Generation Strength was developed which suggests that first-generation
college students possess certain strengths and capital that help them overcome a variety
of new obstacles and make them an ideal candidate for study abroad due to their
experiences with having to navigate new contexts, such as going to college,
independently.
abroad participation nationally and at Arizona State University (ASU). The ASU and
International Studies Abroad (ISA) Planning Scholars Scholarship Program was
developed to support first-generation college students in their pursuit of study abroad.
This mixed-methods study examined what the specific needs of first-generation college
students are as they pursue study abroad experiences and what effect the ASU and ISA
Planning Scholars Program had on them. A combination of surveys, semi-structured
interviews, and a photovoice project provided data for the study. Key findings included
that first-generation college students had concerns about finances, finding a study abroad
program that would keep them on track for graduation, making friends while they study
abroad, and traveling abroad alone. The study indicated that the Planning Scholars
program did increase students’ confidence in pursuing study abroad. Additionally, the
theory of First-Generation Strength was developed which suggests that first-generation
college students possess certain strengths and capital that help them overcome a variety
of new obstacles and make them an ideal candidate for study abroad due to their
experiences with having to navigate new contexts, such as going to college,
independently.
ContributorsRausch, Kyle (Author) / Puckett, Kathleen (Thesis advisor) / Lynch, Jacquelyn S (Committee member) / Smith, Sharon (Committee member) / Arizona State University (Publisher)
Created2017
Description
College completion has become a national priority in the United States. Before students can graduate from a college or university, however, they must survive their first year in higher education. The retention of out-of-state freshmen is a major piece of the larger college student retention puzzle due to recent national enrollment trends and the financial implications of out-of-state student enrollment. With public universities nationwide receiving less financial support from state governments, many of these institutions have used a strategy of aggressively recruiting and increasingly enrolling out-of-state students because the higher tuition these students pay can help offset the loss of state funding. Despite the importance of out-of-state students to the national higher education landscape, little research has been conducted on out-of-state student retention.
This study examined the relation between a resource website and the engagement, sense of belonging, homesickness, and retention of out-of-state freshmen at Arizona State University (ASU). Mixed methods of inquiry were utilized; data sources included a pre- and post-intervention student survey, student interviews, student essay artifacts, website utilization records, and university retention reports.
This study demonstrated that freshmen coming to ASU from another state experienced four main challenges related to being an out-of-state student. Those challenges were homesickness, adjusting to living in Arizona, managing finances, and making friends at ASU. Out-of-state students therefore needed extra support for their transition. The study found that an out-of-state student resource website had a positive association with co-curricular engagement and homesickness frequency reduction. Moreover, the site provided useful information on the challenges experienced by out-of-state freshmen. Discussion includes possible explanations for the findings and implications for practice and research.
This study examined the relation between a resource website and the engagement, sense of belonging, homesickness, and retention of out-of-state freshmen at Arizona State University (ASU). Mixed methods of inquiry were utilized; data sources included a pre- and post-intervention student survey, student interviews, student essay artifacts, website utilization records, and university retention reports.
This study demonstrated that freshmen coming to ASU from another state experienced four main challenges related to being an out-of-state student. Those challenges were homesickness, adjusting to living in Arizona, managing finances, and making friends at ASU. Out-of-state students therefore needed extra support for their transition. The study found that an out-of-state student resource website had a positive association with co-curricular engagement and homesickness frequency reduction. Moreover, the site provided useful information on the challenges experienced by out-of-state freshmen. Discussion includes possible explanations for the findings and implications for practice and research.
ContributorsCorrea, Kevin (Author) / Rotheram-Fuller, Erin (Thesis advisor) / Ott, Molly (Committee member) / Blakemore, Arthur (Committee member) / Arizona State University (Publisher)
Created2017