Matching Items (7)
Filtering by
- All Subjects: Human Factors
- Creators: Cooke, Nancy J.
- Creators: Ben Amor, Hani HB
Description
The objective of this project was to evaluate human factors based cognitive aids on endoscope reprocessing. The project stems from recent failures in reprocessing (cleaning) endoscopes, contributing to the spread of harmful bacterial and viral agents between patients. Three themes were found to represent a majority of problems: 1) lack of visibility (parts and tools were difficult to identify), 2) high memory demands, and 3) insufficient user feedback. In an effort to improve completion rate and eliminate error, cognitive aids were designed utilizing human factors principles that would replace existing manufacturer visual aids. Then, a usability test was conducted, which compared the endoscope reprocessing performance of novices using the standard manufacturer-provided visual aids and the new cognitive aids. Participants successfully completed 87.1% of the reprocessing procedure in the experimental condition with the use of the cognitive aids, compared to 46.3% in the control condition using only existing support materials. Twenty-five of sixty subtasks showed significant improvement in completion rates. When given a cognitive aid designed with human factors principles, participants were able to more successfully complete the reprocessing task. This resulted in an endoscope that was more likely to be safe for patient use.
ContributorsJolly, Jonathan D (Author) / Branaghan, Russell J (Thesis advisor) / Cooke, Nancy J. (Committee member) / Sanchez, Christopher (Committee member) / Arizona State University (Publisher)
Created2011
Description
The rapid increase in the volume and complexity of data lead to accelerated Artificial Intelligence (AI) applications, primarily as intelligent machines, in everyday life. Providing explanations is considered an imperative ability for an AI agent in a human-robot teaming framework, which provides the rationale behind an AI agent's decision-making. Therefore, the validity of the AI models is constrained based on their ability to explain their decision-making rationale. On the other hand, AI agents cannot perceive the social situation that human experts may recognize using their background knowledge, specifically in cybersecurity and the military. Social behavior depends on situation awareness, and it relies on interpretability, transparency, and fairness when we envision efficient Human-AI collaboration. Consequently, the human remains an essential element for planning, especially when the problem's constraints are difficult to express for an agent in a dynamic setting.
This dissertation will first develop different model-based explanation generation approaches to predict where the human teammate would misunderstand the plan and, therefore, generate an explanation accordingly. The robot's generated explanation or interactive explicable behavior maintains the human teammate's cognitive workload and increases the overall team situation awareness throughout human-robot interaction. Further, it will focus on a rule-based model to preserve the collaborative engagement of the team by exploring essential aspects of the facilitator agent design. In addition to recognizing wherein the plan might be discrepancies, focusing on the decision-making process provides insight into the reason behind the conflict between the human expectation and the robot's behavior. Employing a rule-based framework will shift the focus from assisting an individual (human) teammate to helping the team interactively while maintaining collaboration. Hence, concentrating on teaming provides the opportunity to recognize some cognitive biases that skew the teammate's expectations and affect interaction behavior.
This dissertation investigates how to maintain collaboration engagement or cognitive readiness for collaborative planning tasks. Moreover, this dissertation aims to lay out a planning framework focusing on the human teammate's cognitive abilities to understand the machine-provided explanations while collaborating on a planning task. Consequently, this dissertation explored the design for AI facilitator, helping a team tasked with a challenging task to plan collaboratively, mitigating the teaming biases, and communicate effectively. This dissertation investigates the effect of some cognitive biases on the task outcome and shapes the utility function. The facilitator's role is to facilitate goal alignment, the consensus of planning strategies, utility management, effective communication, and mitigate biases.
ContributorsZakershahrak, Mehrdad (Author) / Cooke, Nancy NC (Thesis advisor) / Zhang, Yu YZ (Thesis advisor) / Ben Amor, Hani HB (Committee member) / Srivastava, Siddharth SS (Committee member) / Hsiao, Sharon SH (Committee member) / Arizona State University (Publisher)
Created2021
Description
Human-robot interaction has expanded immensely within dynamic environments. The goals of human-robot interaction are to increase productivity, efficiency and safety. In order for the integration of human-robot interaction to be seamless and effective humans must be willing to trust the capabilities of assistive robots. A major priority for human-robot interaction should be to understand how human dyads have been historically effective within a joint-task setting. This will ensure that all goals can be met in human robot settings. The aim of the present study was to examine human dyads and the effects of an unexpected interruption. Humans’ interpersonal and individual levels of trust were studied in order to draw appropriate conclusions. Seventeen undergraduate and graduate level dyads were collected from Arizona State University. Participants were broken up into either a surprise condition or a baseline condition. Participants individually took two surveys in order to have an accurate understanding of levels of dispositional and individual levels of trust. The findings showed that participant levels of interpersonal trust were average. Surprisingly, participants who participated in the surprise condition afterwards, showed moderate to high levels of dyad trust. This effect showed that participants became more reliant on their partners when interrupted by a surprising event. Future studies will take this knowledge and apply it to human-robot interaction, in order to mimic the seamless team-interaction shown in historically effective dyads, specifically human team interaction.
ContributorsShaw, Alexandra Luann (Author) / Chiou, Erin (Thesis advisor) / Cooke, Nancy J. (Committee member) / Craig, Scotty (Committee member) / Arizona State University (Publisher)
Created2019
Description
Future autonomous vehicle systems will be diverse in design and functionality since they will be produced by different brands. In the automotive industry, trustworthiness of a vehicle is closely tied to its perceived safety. Trust involves dependence on another agent in an uncertain situation. Perceptions of system safety, trustworthiness, and performance are important because they guide people’s behavior towards automation. Specifically, these perceptions impact how reliant people believe they can be on the system to do a certain task. Over or under reliance can be a concern for safety because they involve the person allocating tasks between themselves and the system in inappropriate ways. If a person trusts a brand they may also believe the brand’s technology will keep them safe. The present study measured brand trust associations and performance expectations for safety between twelve different automobile brands using an online survey.
The literature and results of the present study suggest perceived trustworthiness for safety of the automation and the brand of the automation, could together impact trust. Results revelated that brands closely related to the trust-based attributes, Confidence, Secure, Integrity, and Trustworthiness were expected to produce autonomous vehicle technology that performs in a safer way. While, brands more related to the trust-based attributes Harmful, Deceptive, Underhanded, Suspicious, Beware, and Familiar were expected to produce autonomous vehicle technology that performs in a less safe way.
These findings contribute to both the fields of Human-Automation Interaction and Consumer Psychology. Typically, brands and automation are discussed separately however, this work suggests an important relationship may exist. A deeper understanding of brand trust as it relates to autonomous vehicles can help producers understand potential for over or under reliance and create safer systems that help users calibrate trust appropriately. Considering the impact on safety, more research should be conducted to explore brand trust and expectations for performance between various brands.
The literature and results of the present study suggest perceived trustworthiness for safety of the automation and the brand of the automation, could together impact trust. Results revelated that brands closely related to the trust-based attributes, Confidence, Secure, Integrity, and Trustworthiness were expected to produce autonomous vehicle technology that performs in a safer way. While, brands more related to the trust-based attributes Harmful, Deceptive, Underhanded, Suspicious, Beware, and Familiar were expected to produce autonomous vehicle technology that performs in a less safe way.
These findings contribute to both the fields of Human-Automation Interaction and Consumer Psychology. Typically, brands and automation are discussed separately however, this work suggests an important relationship may exist. A deeper understanding of brand trust as it relates to autonomous vehicles can help producers understand potential for over or under reliance and create safer systems that help users calibrate trust appropriately. Considering the impact on safety, more research should be conducted to explore brand trust and expectations for performance between various brands.
ContributorsCelmer, Natalie (Author) / Branaghan, Russell (Thesis advisor) / Chiou, Erin (Thesis advisor) / Cooke, Nancy J. (Committee member) / Arizona State University (Publisher)
Created2018
Description
Humans and robots need to work together as a team to accomplish certain shared goals due to the limitations of current robot capabilities. Human assistance is required to accomplish the tasks as human capabilities are often better suited for certain tasks and they complement robot capabilities in many situations. Given the necessity of human-robot teams, it has been long assumed that for the robotic agent to be an effective team member, it must be equipped with automated planning technologies that helps in achieving the goals that have been delegated to it by their human teammates as well as in deducing its own goal to proactively support its human counterpart by inferring their goals. However there has not been any systematic evaluation on the accuracy of this claim.
In my thesis, I perform human factors analysis on effectiveness of such automated planning technologies for remote human-robot teaming. In the first part of my study, I perform an investigation on effectiveness of automated planning in remote human-robot teaming scenarios. In the second part of my study, I perform an investigation on effectiveness of a proactive robot assistant in remote human-robot teaming scenarios.
Both investigations are conducted in a simulated urban search and rescue (USAR) scenario where the human-robot teams are deployed during early phases of an emergency response to explore all areas of the disaster scene. I evaluate through both the studies, how effective is automated planning technology in helping the human-robot teams move closer to human-human teams. I utilize both objective measures (like accuracy and time spent on primary and secondary tasks, Robot Attention Demand, etc.) and a set of subjective Likert-scale questions (on situation awareness, immediacy etc.) to investigate the trade-offs between different types of remote human-robot teams. The results from both the studies seem to suggest that intelligent robots with automated planning capability and proactive support ability is welcomed in general.
In my thesis, I perform human factors analysis on effectiveness of such automated planning technologies for remote human-robot teaming. In the first part of my study, I perform an investigation on effectiveness of automated planning in remote human-robot teaming scenarios. In the second part of my study, I perform an investigation on effectiveness of a proactive robot assistant in remote human-robot teaming scenarios.
Both investigations are conducted in a simulated urban search and rescue (USAR) scenario where the human-robot teams are deployed during early phases of an emergency response to explore all areas of the disaster scene. I evaluate through both the studies, how effective is automated planning technology in helping the human-robot teams move closer to human-human teams. I utilize both objective measures (like accuracy and time spent on primary and secondary tasks, Robot Attention Demand, etc.) and a set of subjective Likert-scale questions (on situation awareness, immediacy etc.) to investigate the trade-offs between different types of remote human-robot teams. The results from both the studies seem to suggest that intelligent robots with automated planning capability and proactive support ability is welcomed in general.
ContributorsNarayanan, Vignesh (Author) / Kambhampati, Subbarao (Thesis advisor) / Zhang, Yu (Thesis advisor) / Cooke, Nancy J. (Committee member) / Fainekos, Georgios (Committee member) / Arizona State University (Publisher)
Created2015
Description
Preoperative team briefings have been suggested to be important for improving team performance in the operating room. Many high risk environments have accepted team briefings; however healthcare has been slower to follow. While applying briefings in the operating room has shown positive benefits including improved communication and perceptions of teamwork, most research has only focused on feasibility of implementation and not on understanding how the quality of briefings can impact subsequent surgical procedures. Thus, there are no formal protocols or methodologies that have been developed.
The goal of this study was to relate specific characteristics of team briefings back to objective measures of team performance. The study employed cognitive interviews, prospective observations, and principle component regression to characterize and model the relationship between team briefing characteristics and non-routine events (NREs) in gynecological surgery. Interviews were conducted with 13 team members representing each role on the surgical team and data were collected for 24 pre-operative team briefings and 45 subsequent surgical cases. The findings revealed that variations within the team briefing are associated with differences in team-related outcomes, namely NREs, during the subsequent surgical procedures. Synthesis of the data highlighted three important trends which include the need to promote team communication during the briefing, the importance of attendance by all surgical team members, and the value of holding a briefing prior to each surgical procedure. These findings have implications for development of formal briefing protocols.
Pre-operative team briefings are beneficial for team performance in the operating room. Future research will be needed to continue understanding this relationship between how briefings are conducted and team performance to establish more consistent approaches and as well as for the continuing assessment of team briefings and other similar team-related events in the operating room.
The goal of this study was to relate specific characteristics of team briefings back to objective measures of team performance. The study employed cognitive interviews, prospective observations, and principle component regression to characterize and model the relationship between team briefing characteristics and non-routine events (NREs) in gynecological surgery. Interviews were conducted with 13 team members representing each role on the surgical team and data were collected for 24 pre-operative team briefings and 45 subsequent surgical cases. The findings revealed that variations within the team briefing are associated with differences in team-related outcomes, namely NREs, during the subsequent surgical procedures. Synthesis of the data highlighted three important trends which include the need to promote team communication during the briefing, the importance of attendance by all surgical team members, and the value of holding a briefing prior to each surgical procedure. These findings have implications for development of formal briefing protocols.
Pre-operative team briefings are beneficial for team performance in the operating room. Future research will be needed to continue understanding this relationship between how briefings are conducted and team performance to establish more consistent approaches and as well as for the continuing assessment of team briefings and other similar team-related events in the operating room.
ContributorsHildebrand, Emily A (Author) / Branaghan, Russell J (Thesis advisor) / Cooke, Nancy J. (Committee member) / Hallbeck, M. Susan (Committee member) / Bekki, Jennifer M (Committee member) / Blocker, Renaldo C (Committee member) / Arizona State University (Publisher)
Created2014
Description
Interpersonal communications during civil infrastructure systems operation and maintenance (CIS O&M) are processes for CIS O&M participants to exchange critical information. Poor communications that provide misleading information can jeopardize CIS O&M safety and efficiency. Previous studies suggest that communication contexts and features could be indicators of communication errors and relevant CIS O&M risks. However, challenges remain for reliable prediction of communication errors to ensure CIS O&M safety and efficiency. For example, existing studies lack a systematic summarization of risky contexts and features of communication processes for predicting communication errors. Limited studies examined quantitative methods for incorporating expert opinions as constraints for reliable communication error prediction. How to examine mitigation strategies (e.g., adjustments of communication protocols) for reducing communication-related CIS O&M risks is also challenging. The main reason is the lack of causal analysis about how various factors influence the occurrences and impacts of communication errors so that engineers lack the basis for intervention.
This dissertation presents a method that integrates Bayesian Network (BN) modeling and simulation for communication-related risk prediction and mitigation. The proposed method aims at tackling the three challenges mentioned above for ensuring CIS O&M safety and efficiency. The proposed method contains three parts: 1) Communication Data Collection and Error Detection – designing lab experiments for collecting communication data in CIS O&M workflows and using the collected data for identifying risky communication contexts and features; 2) Communication Error Classification and Prediction – encoding expert knowledge as constraints through BN model updating to improve the accuracy of communication error prediction based on given communication contexts and features, and 3) Communication Risk Mitigation – carrying out simulations to adjust communication protocols for reducing communication-related CIS O&M risks.
This dissertation uses two CIS O&M case studies (air traffic control and NPP outages) to validate the proposed method. The results indicate that the proposed method can 1) identify risky communication contexts and features, 2) predict communication errors and CIS O&M risks, and 3) reduce CIS O&M risks triggered by communication errors. The author envisions that the proposed method will shed light on achieving predictive control of interpersonal communications in dynamic and complex CIS O&M.
This dissertation presents a method that integrates Bayesian Network (BN) modeling and simulation for communication-related risk prediction and mitigation. The proposed method aims at tackling the three challenges mentioned above for ensuring CIS O&M safety and efficiency. The proposed method contains three parts: 1) Communication Data Collection and Error Detection – designing lab experiments for collecting communication data in CIS O&M workflows and using the collected data for identifying risky communication contexts and features; 2) Communication Error Classification and Prediction – encoding expert knowledge as constraints through BN model updating to improve the accuracy of communication error prediction based on given communication contexts and features, and 3) Communication Risk Mitigation – carrying out simulations to adjust communication protocols for reducing communication-related CIS O&M risks.
This dissertation uses two CIS O&M case studies (air traffic control and NPP outages) to validate the proposed method. The results indicate that the proposed method can 1) identify risky communication contexts and features, 2) predict communication errors and CIS O&M risks, and 3) reduce CIS O&M risks triggered by communication errors. The author envisions that the proposed method will shed light on achieving predictive control of interpersonal communications in dynamic and complex CIS O&M.
ContributorsSun, Zhe (Author) / Tang, Pingbo (Thesis advisor) / Ayer, Steven K (Committee member) / Cooke, Nancy J. (Committee member) / Liu, Yongming (Committee member) / Arizona State University (Publisher)
Created2020