Barrett, The Honors College Thesis/Creative Project Collection
Barrett, The Honors College at Arizona State University proudly showcases the work of undergraduate honors students by sharing this collection exclusively with the ASU community.
Barrett accepts high performing, academically engaged undergraduate students and works with them in collaboration with all of the other academic units at Arizona State University. All Barrett students complete a thesis or creative project which is an opportunity to explore an intellectual interest and produce an original piece of scholarly research. The thesis or creative project is supervised and defended in front of a faculty committee. Students are able to engage with professors who are nationally recognized in their fields and committed to working with honors students. Completing a Barrett thesis or creative project is an opportunity for undergraduate honors students to contribute to the ASU academic community in a meaningful way.
Objective: This study aims to develop and evaluate a semi-automated workflow using Natural Language Processing (NLP) for sharing positive patient feedback with radiology staff, assessing its efficiency and impact on radiology staff morale.
Methods: The HIPAA compliant, institutional review board-waived implementation study was conducted from April 2022 to June 2023 and…
Objective: This study aims to develop and evaluate a semi-automated workflow using Natural Language Processing (NLP) for sharing positive patient feedback with radiology staff, assessing its efficiency and impact on radiology staff morale.
Methods: The HIPAA compliant, institutional review board-waived implementation study was conducted from April 2022 to June 2023 and introduced a Patient Praises program to distribute positive patient feedback to radiology staff collected from patient surveys. The study transitioned from an initial manual workflow to a hybrid process using an NLP model trained on 1,034 annotated comments and validated on 260 holdout reports. The time to generate Patient Praises e-mails were compared between manual and hybrid workflows. Impact of Patient Praises on radiology staff was measured using a 4 question Likert-scale survey and an open text feedback box. Kruskal-Wallis and post-hoc Dunn’s test was performed to evaluate differences in time for different workflows.
Results: From April 2022 to June 2023, the radiology department received 10,643 patient surveys. Of those surveys, 95.6% of these surveys contained positive comments, with 9.6% (n = 978) shared as Patient Praises to staff. After implementation of the hybrid workflow in March 2023, 45.8% of Patient Praises were sent through the hybrid workflow and 54.2% were sent manually. Time efficiency analysis on 30-case subsets revealed that the hybrid workflow without edits was the most efficient, taking a median of 0.7 minutes per case. A high proportion of staff found the praises made them feel appreciated (94%) and valued (90%) responding with a 5/5 agreement on 5-point Likert scale responses.
Conclusion: A hybrid workflow incorporating NLP significantly improves time efficiency for the Patient Praises program while increasing feelings of acknowledgment and value among staff.
