Matching Items (3)
Filtering by
- All Subjects: Higher Education Administration
- Creators: Rotheram-Fuller, Erin
Norming at scale: faculty perceptions of assessment culture and student learning outcomes assessment
Description
To foster both external and internal accountability, universities seek more effective models for student learning outcomes assessment (SLOA). Meaningful and authentic measurement of program-level student learning outcomes requires engagement with an institution’s faculty members, especially to gather student performance assessment data using common scoring instruments, or rubrics, across a university’s many colleges and programs. Too often, however, institutions rely on faculty engagement for SLOA initiatives like this without providing necessary support, communication, and training. The resulting data may lack sufficient reliability and reflect deficiencies in an institution’s culture of assessment.
This mixed methods action research study gauged how well one form of SLOA training – a rubric-norming workshop – could affect both inter-rater reliability for faculty scorers and faculty perceptions of SLOA while exploring the nature of faculty collaboration toward a shared understanding of student learning outcomes. The study participants, ten part-time faculty members at the institution, each held primary careers in the health care industry, apart from their secondary role teaching university courses. Accordingly, each contributed expertise and experience to the rubric-norming discussions, surveys of assessment-related perceptions, and individual scoring of student performance with a common rubric. Drawing on sociocultural learning principles and the specific lens of activity theory, influences on faculty SLOA were arranged and analyzed within the heuristic framework of an activity system to discern effects of collaboration and perceptions toward SLOA on consistent rubric-scoring by faculty participants.
Findings suggest participation in the study did not correlate to increased inter-rater reliability for faculty scorers when using the common rubric. Constraints found within assessment tools and unclear institutional leadership prevented more reliable use of common rubrics. Instead, faculty participants resorted to individual assessment approaches to meaningfully guide students to classroom achievement and preparation for careers in the health care field. Despite this, faculty participants valued SLOA, collaborated readily with colleagues for shared assessment goals, and worked hard to teach and assess students meaningfully.
This mixed methods action research study gauged how well one form of SLOA training – a rubric-norming workshop – could affect both inter-rater reliability for faculty scorers and faculty perceptions of SLOA while exploring the nature of faculty collaboration toward a shared understanding of student learning outcomes. The study participants, ten part-time faculty members at the institution, each held primary careers in the health care industry, apart from their secondary role teaching university courses. Accordingly, each contributed expertise and experience to the rubric-norming discussions, surveys of assessment-related perceptions, and individual scoring of student performance with a common rubric. Drawing on sociocultural learning principles and the specific lens of activity theory, influences on faculty SLOA were arranged and analyzed within the heuristic framework of an activity system to discern effects of collaboration and perceptions toward SLOA on consistent rubric-scoring by faculty participants.
Findings suggest participation in the study did not correlate to increased inter-rater reliability for faculty scorers when using the common rubric. Constraints found within assessment tools and unclear institutional leadership prevented more reliable use of common rubrics. Instead, faculty participants resorted to individual assessment approaches to meaningfully guide students to classroom achievement and preparation for careers in the health care field. Despite this, faculty participants valued SLOA, collaborated readily with colleagues for shared assessment goals, and worked hard to teach and assess students meaningfully.
ContributorsWilliams, Nicholas (Author) / Liou, Daniel D (Thesis advisor) / Rotheram-Fuller, Erin (Committee member) / Turbow, David (Committee member) / Arizona State University (Publisher)
Created2018
Description
College completion has become a national priority in the United States. Before students can graduate from a college or university, however, they must survive their first year in higher education. The retention of out-of-state freshmen is a major piece of the larger college student retention puzzle due to recent national enrollment trends and the financial implications of out-of-state student enrollment. With public universities nationwide receiving less financial support from state governments, many of these institutions have used a strategy of aggressively recruiting and increasingly enrolling out-of-state students because the higher tuition these students pay can help offset the loss of state funding. Despite the importance of out-of-state students to the national higher education landscape, little research has been conducted on out-of-state student retention.
This study examined the relation between a resource website and the engagement, sense of belonging, homesickness, and retention of out-of-state freshmen at Arizona State University (ASU). Mixed methods of inquiry were utilized; data sources included a pre- and post-intervention student survey, student interviews, student essay artifacts, website utilization records, and university retention reports.
This study demonstrated that freshmen coming to ASU from another state experienced four main challenges related to being an out-of-state student. Those challenges were homesickness, adjusting to living in Arizona, managing finances, and making friends at ASU. Out-of-state students therefore needed extra support for their transition. The study found that an out-of-state student resource website had a positive association with co-curricular engagement and homesickness frequency reduction. Moreover, the site provided useful information on the challenges experienced by out-of-state freshmen. Discussion includes possible explanations for the findings and implications for practice and research.
This study examined the relation between a resource website and the engagement, sense of belonging, homesickness, and retention of out-of-state freshmen at Arizona State University (ASU). Mixed methods of inquiry were utilized; data sources included a pre- and post-intervention student survey, student interviews, student essay artifacts, website utilization records, and university retention reports.
This study demonstrated that freshmen coming to ASU from another state experienced four main challenges related to being an out-of-state student. Those challenges were homesickness, adjusting to living in Arizona, managing finances, and making friends at ASU. Out-of-state students therefore needed extra support for their transition. The study found that an out-of-state student resource website had a positive association with co-curricular engagement and homesickness frequency reduction. Moreover, the site provided useful information on the challenges experienced by out-of-state freshmen. Discussion includes possible explanations for the findings and implications for practice and research.
ContributorsCorrea, Kevin (Author) / Rotheram-Fuller, Erin (Thesis advisor) / Ott, Molly (Committee member) / Blakemore, Arthur (Committee member) / Arizona State University (Publisher)
Created2017
Description
ABSTRACT
Faculty and staff can create barriers by not understanding their role in student success. This study began with an artifact analysis of 20 documents to better understand how faculty and staff at Concordia University Texas were operationalizing student success. The results of the artifact analysis showed a lack of recorded dialogue around student success at regular business meetings, as well as pattern of deficit language approach to policy and procedure in the student handbooks Next, this study evaluated the impacts of using a Community of Practice as a change agent to help faculty and staff better understand their roles in student success and specifically to establish a definition of student success. Using a mixed method, action research approach, results showed that the Community of Practice was successful in terms of transfer or knowledge and creating a sense of purpose for participants regarding their role in student success. Results showed that participating in a Community of Practice was successful in helping faculty and staff not only understand their own role in student success, but understand their place among others in the unified goal to help students succeed. The Community of Practice participants completed the research with a better understanding of how and why collaborating with different departments enables faculty and staff to better help students. Additionally, the participants concluded that a visual reminder of student success (figurines, students stories, student pictures) ensured that student success was the first thing they thought about when completing their daily work.
Faculty and staff can create barriers by not understanding their role in student success. This study began with an artifact analysis of 20 documents to better understand how faculty and staff at Concordia University Texas were operationalizing student success. The results of the artifact analysis showed a lack of recorded dialogue around student success at regular business meetings, as well as pattern of deficit language approach to policy and procedure in the student handbooks Next, this study evaluated the impacts of using a Community of Practice as a change agent to help faculty and staff better understand their roles in student success and specifically to establish a definition of student success. Using a mixed method, action research approach, results showed that the Community of Practice was successful in terms of transfer or knowledge and creating a sense of purpose for participants regarding their role in student success. Results showed that participating in a Community of Practice was successful in helping faculty and staff not only understand their own role in student success, but understand their place among others in the unified goal to help students succeed. The Community of Practice participants completed the research with a better understanding of how and why collaborating with different departments enables faculty and staff to better help students. Additionally, the participants concluded that a visual reminder of student success (figurines, students stories, student pictures) ensured that student success was the first thing they thought about when completing their daily work.
ContributorsPospisil, KC (Author) / Wylie, Ruth (Thesis advisor) / Ott, Mollie (Committee member) / Burgess, Prairie (Committee member) / Arizona State University (Publisher)
Created2020