Matching Items (62)
Description
Reasoning about the activities of cyber threat actors is critical to defend against cyber
attacks. However, this task is difficult for a variety of reasons. In simple terms, it is difficult
to determine who the attacker is, what the desired goals are of the attacker, and how they will
carry out their attacks. These three questions essentially entail understanding the attacker’s
use of deception, the capabilities available, and the intent of launching the attack. These
three issues are highly inter-related. If an adversary can hide their intent, they can better
deceive a defender. If an adversary’s capabilities are not well understood, then determining
what their goals are becomes difficult as the defender is uncertain if they have the necessary
tools to accomplish them. However, the understanding of these aspects are also mutually
supportive. If we have a clear picture of capabilities, intent can better be deciphered. If we
understand intent and capabilities, a defender may be able to see through deception schemes.
In this dissertation, I present three pieces of work to tackle these questions to obtain
a better understanding of cyber threats. First, we introduce a new reasoning framework
to address deception. We evaluate the framework by building a dataset from DEFCON
capture-the-flag exercise to identify the person or group responsible for a cyber attack.
We demonstrate that the framework not only handles cases of deception but also provides
transparent decision making in identifying the threat actor. The second task uses a cognitive
learning model to determine the intent – goals of the threat actor on the target system.
The third task looks at understanding the capabilities of threat actors to target systems by
identifying at-risk systems from hacker discussions on darkweb websites. To achieve this
task we gather discussions from more than 300 darkweb websites relating to malicious
hacking.
attacks. However, this task is difficult for a variety of reasons. In simple terms, it is difficult
to determine who the attacker is, what the desired goals are of the attacker, and how they will
carry out their attacks. These three questions essentially entail understanding the attacker’s
use of deception, the capabilities available, and the intent of launching the attack. These
three issues are highly inter-related. If an adversary can hide their intent, they can better
deceive a defender. If an adversary’s capabilities are not well understood, then determining
what their goals are becomes difficult as the defender is uncertain if they have the necessary
tools to accomplish them. However, the understanding of these aspects are also mutually
supportive. If we have a clear picture of capabilities, intent can better be deciphered. If we
understand intent and capabilities, a defender may be able to see through deception schemes.
In this dissertation, I present three pieces of work to tackle these questions to obtain
a better understanding of cyber threats. First, we introduce a new reasoning framework
to address deception. We evaluate the framework by building a dataset from DEFCON
capture-the-flag exercise to identify the person or group responsible for a cyber attack.
We demonstrate that the framework not only handles cases of deception but also provides
transparent decision making in identifying the threat actor. The second task uses a cognitive
learning model to determine the intent – goals of the threat actor on the target system.
The third task looks at understanding the capabilities of threat actors to target systems by
identifying at-risk systems from hacker discussions on darkweb websites. To achieve this
task we gather discussions from more than 300 darkweb websites relating to malicious
hacking.
ContributorsNunes, Eric (Author) / Shakarian, Paulo (Thesis advisor) / Ahn, Gail-Joon (Committee member) / Baral, Chitta (Committee member) / Cooke, Nancy J. (Committee member) / Arizona State University (Publisher)
Created2018
Description
Reading partners’ actions correctly is essential for successful coordination, but interpretation does not always reflect reality. Attribution biases, such as self-serving and correspondence biases, lead people to misinterpret their partners’ actions and falsely assign blame after an unexpected event. These biases thus further influence people’s trust in their partners, including machine partners. The increasing capabilities and complexity of machines allow them to work physically with humans. However, their improvements may interfere with the accuracy for people to calibrate trust in machines and their capabilities, which requires an understanding of attribution biases’ effect on human-machine coordination. Specifically, the current thesis explores how the development of trust in a partner is influenced by attribution biases and people’s assignment of blame for a negative outcome. This study can also suggest how a machine partner should be designed to react to environmental disturbances and report the appropriate level of information about external conditions.
ContributorsHsiung, Chi-Ping (M.S.) (Author) / Chiou, Erin (Thesis advisor) / Cooke, Nancy J. (Thesis advisor) / Zhang, Wenlong (Committee member) / Arizona State University (Publisher)
Created2019
Description
Human-agent teams (HATs) are expected to play a larger role in future command and control systems where resilience is critical for team effectiveness. The question of how HATs interact to be effective in both normal and unexpected situations is worthy of further examination. Exploratory behaviors are one that way adaptive systems discover opportunities to expand and refine their performance. In this study, team interaction exploration is examined in a HAT composed of a human navigator, human photographer, and a synthetic pilot while they perform a remotely-piloted aerial reconnaissance task. Failures in automation and the synthetic pilot’s autonomy were injected throughout ten missions as roadblocks. Teams were clustered by performance into high-, middle-, and low-performing groups. It was hypothesized that high-performing teams would exchange more text-messages containing unique content or sender-recipient combinations than middle- and low-performing teams, and that teams would exchange less unique messages over time. The results indicate that high-performing teams had more unique team interactions than middle-performing teams. Additionally, teams generally had more exploratory team interactions in the first session of missions than the second session. Implications and suggestions for future work are discussed.
ContributorsLematta, Glenn Joseph (Author) / Chiou, Erin K. (Thesis advisor) / Cooke, Nancy J. (Committee member) / Roscoe, Rod D. (Committee member) / Arizona State University (Publisher)
Created2019
Description
Interface design has a large impact on the usability of a system, and the addition of multitasking only makes these systems more difficult to use. Information processing, mental workload, and interface design are determining factors that impact the performance of usability, and therefore interface design needs to be more adapted to users undergoing a high mental workload. This study examines how a primary task, visual tracking, is affected by a secondary task, memory. Findings show that a high mental workload effects reaction time and memory performance on layouts with a high index of difficulty. Further research should analyze the effects of manipulating target size and distance apart independently from manipulating the index of difficulty on performance.
ContributorsSrikantha, Sainjeev (Author) / Gray, Robert (Thesis advisor) / Cooke, Nancy J. (Committee member) / Branaghan, Russell (Committee member) / Arizona State University (Publisher)
Created2018
Description
Nicotine and tobacco use, whether it be through cigarette smoking or other devices, creates negative health conditions in pilots. The literature that was reviewed pertained to nicotine withdrawal symptoms and their negative impact on pilot performance. There have been studies conducted in order to explore how these symptoms impact pilot performance using cigarettes as the only nicotine device and does not specify the nicotine levels or the frequency of use. This thesis extends this work to examine the relationship between the nicotine withdrawal symptoms and the nicotine behaviors of pilots. It was hypothesized that the extent of withdrawal symptoms may differ by device and by nicotine levels and frequency of use, with higher levels and more frequent use being associated with more severe withdrawal symptoms. These behaviors included the device they use to take nicotine whether it be cigarettes, vaporizers, e-cigarettes, or smokeless tobacco. The behaviors also included exploration of how nicotine levels relate to withdrawal symptoms whether the nicotine level is as low as 3mg or high as 36mg. The last relationship that was explored was that between the withdrawal symptoms presented in pilots and how often they used nicotine, whether it be often as every day or less frequent as 1-2 times a year. It was found that there is no statistical relationship between nicotine withdrawal symptoms and the nicotine habits such as device used, nicotine level used, and frequency of use.
ContributorsBartlowe, Halie Marie (Author) / Cooke, Nancy J. (Thesis advisor) / Nullmeyer, Robert (Committee member) / Wende, Anthony (Committee member) / Arizona State University (Publisher)
Created2019
Description
The purpose of this research was to determine if students who are enrolled in a professional flight program exhibit significantly higher rates of depression, stress, and anxiety. This study compared professional flight students to non-professional flight students to determine whether professional flight students have higher rates of depression and anxiety. In addition, this study sought to determine if there were higher depression, anxiety, and stress levels in upperclassmen (juniors and seniors) than in lowerclassmen (freshman and sophomore). Finally, upperclassmen and underclassmen within professional flight programs were compared to test if upperclassmen professional flight students exhibit higher rates for depression, anxiety and stress. These groups were compared to each other by using a survey that measures depression, anxiety, and stress. There were no statistically significant results. No singular group is more or less prone to depression, anxiety, or stress.
ContributorsJacobs, Destry (Author) / Niemczyk, Mary (Thesis advisor) / Cooke, Nancy J. (Thesis advisor) / Nullmeyer, Robert (Committee member) / Cline, Paul (Committee member) / Arizona State University (Publisher)
Created2019
Description
Future autonomous vehicle systems will be diverse in design and functionality since they will be produced by different brands. In the automotive industry, trustworthiness of a vehicle is closely tied to its perceived safety. Trust involves dependence on another agent in an uncertain situation. Perceptions of system safety, trustworthiness, and performance are important because they guide people’s behavior towards automation. Specifically, these perceptions impact how reliant people believe they can be on the system to do a certain task. Over or under reliance can be a concern for safety because they involve the person allocating tasks between themselves and the system in inappropriate ways. If a person trusts a brand they may also believe the brand’s technology will keep them safe. The present study measured brand trust associations and performance expectations for safety between twelve different automobile brands using an online survey.
The literature and results of the present study suggest perceived trustworthiness for safety of the automation and the brand of the automation, could together impact trust. Results revelated that brands closely related to the trust-based attributes, Confidence, Secure, Integrity, and Trustworthiness were expected to produce autonomous vehicle technology that performs in a safer way. While, brands more related to the trust-based attributes Harmful, Deceptive, Underhanded, Suspicious, Beware, and Familiar were expected to produce autonomous vehicle technology that performs in a less safe way.
These findings contribute to both the fields of Human-Automation Interaction and Consumer Psychology. Typically, brands and automation are discussed separately however, this work suggests an important relationship may exist. A deeper understanding of brand trust as it relates to autonomous vehicles can help producers understand potential for over or under reliance and create safer systems that help users calibrate trust appropriately. Considering the impact on safety, more research should be conducted to explore brand trust and expectations for performance between various brands.
The literature and results of the present study suggest perceived trustworthiness for safety of the automation and the brand of the automation, could together impact trust. Results revelated that brands closely related to the trust-based attributes, Confidence, Secure, Integrity, and Trustworthiness were expected to produce autonomous vehicle technology that performs in a safer way. While, brands more related to the trust-based attributes Harmful, Deceptive, Underhanded, Suspicious, Beware, and Familiar were expected to produce autonomous vehicle technology that performs in a less safe way.
These findings contribute to both the fields of Human-Automation Interaction and Consumer Psychology. Typically, brands and automation are discussed separately however, this work suggests an important relationship may exist. A deeper understanding of brand trust as it relates to autonomous vehicles can help producers understand potential for over or under reliance and create safer systems that help users calibrate trust appropriately. Considering the impact on safety, more research should be conducted to explore brand trust and expectations for performance between various brands.
ContributorsCelmer, Natalie (Author) / Branaghan, Russell (Thesis advisor) / Chiou, Erin (Thesis advisor) / Cooke, Nancy J. (Committee member) / Arizona State University (Publisher)
Created2018
Description
There has been an ongoing debate between the relative deterrent power of certainty and severity on deceptive and criminal activity, certainty being the likelihood of capture and severity being the magnitude of the potential punishment. This paper is a review of the current body of research regarding risk assessment and deception in games, specifically regarding certainty and severity. The topics of game theoretical foundations, balance, and design were covered, as were heuristics and individual differences in deceptive behavior. Using this background knowledge, this study implemented a methodology through which the risk assessments of certainty and severity can be compared behaviorally in a repeated conflict context. It was found that certainty had a significant effect on a person’s likelihood to lie, while severity did not. Exploratory data was collected using the dark triad personality quiz, though it did not ultimately show a pattern.
ContributorsDay, Nicholas C (Author) / Chiou, Erin (Thesis advisor) / Cooke, Nancy J. (Committee member) / Becker, Vaughn (Committee member) / Arizona State University (Publisher)
Created2019
Description
Node-link diagrams are widely used to visualize the relational structure of real world datasets. As identical data can be visualized in infinite ways by simply changing the spatial arrangement of the nodes, one of the important research topics of the graph drawing community is to visualize the data in the way that can facilitate people's comprehension. The last three decades have witnessed the growth of algorithms for automatic visualization. However, despite the popularity of node-link diagrams and the enthusiasm in improving computational efficiency, little is known about how people read these graphs and what factors (layout, size, density, etc.) have impact on their effectiveness (the usability aspect of the graph, e.g., are they easy to understand?). This thesis is comprehensive research to investigate the factors that affect people's understanding of node-link diagrams using eye-tracking methods. Three experiments were conducted, including 1) a pilot study with 22 participants to explore the layout and size effect; 2) an eye tracking experiment with 43 participants to investigate the layout, size and density effect on people's graph comprehension using abstract node-link diagram and generic tasks; and 3) an eye tracking experiment with the same participants to investigate the same effects using a real visualization analytic application. Results showed that participants' spatial reasoning ability had significant impact on people's graph reading performance. Layout, size, and density were all found to be significant effects under different task circumstances. The applicability of the eye tracking methods on visualization evaluation has been confirmed by providing detailed evidence that demonstrates the cognitive process of participants' graph reading behavior.
ContributorsLiu, Qing (Author) / McKenna, Anna (Thesis advisor) / Jennifer, Jennifer (Committee member) / Cooke, Nancy J. (Committee member) / Arizona State University (Publisher)
Created2015
Description
Humans and robots need to work together as a team to accomplish certain shared goals due to the limitations of current robot capabilities. Human assistance is required to accomplish the tasks as human capabilities are often better suited for certain tasks and they complement robot capabilities in many situations. Given the necessity of human-robot teams, it has been long assumed that for the robotic agent to be an effective team member, it must be equipped with automated planning technologies that helps in achieving the goals that have been delegated to it by their human teammates as well as in deducing its own goal to proactively support its human counterpart by inferring their goals. However there has not been any systematic evaluation on the accuracy of this claim.
In my thesis, I perform human factors analysis on effectiveness of such automated planning technologies for remote human-robot teaming. In the first part of my study, I perform an investigation on effectiveness of automated planning in remote human-robot teaming scenarios. In the second part of my study, I perform an investigation on effectiveness of a proactive robot assistant in remote human-robot teaming scenarios.
Both investigations are conducted in a simulated urban search and rescue (USAR) scenario where the human-robot teams are deployed during early phases of an emergency response to explore all areas of the disaster scene. I evaluate through both the studies, how effective is automated planning technology in helping the human-robot teams move closer to human-human teams. I utilize both objective measures (like accuracy and time spent on primary and secondary tasks, Robot Attention Demand, etc.) and a set of subjective Likert-scale questions (on situation awareness, immediacy etc.) to investigate the trade-offs between different types of remote human-robot teams. The results from both the studies seem to suggest that intelligent robots with automated planning capability and proactive support ability is welcomed in general.
In my thesis, I perform human factors analysis on effectiveness of such automated planning technologies for remote human-robot teaming. In the first part of my study, I perform an investigation on effectiveness of automated planning in remote human-robot teaming scenarios. In the second part of my study, I perform an investigation on effectiveness of a proactive robot assistant in remote human-robot teaming scenarios.
Both investigations are conducted in a simulated urban search and rescue (USAR) scenario where the human-robot teams are deployed during early phases of an emergency response to explore all areas of the disaster scene. I evaluate through both the studies, how effective is automated planning technology in helping the human-robot teams move closer to human-human teams. I utilize both objective measures (like accuracy and time spent on primary and secondary tasks, Robot Attention Demand, etc.) and a set of subjective Likert-scale questions (on situation awareness, immediacy etc.) to investigate the trade-offs between different types of remote human-robot teams. The results from both the studies seem to suggest that intelligent robots with automated planning capability and proactive support ability is welcomed in general.
ContributorsNarayanan, Vignesh (Author) / Kambhampati, Subbarao (Thesis advisor) / Zhang, Yu (Thesis advisor) / Cooke, Nancy J. (Committee member) / Fainekos, Georgios (Committee member) / Arizona State University (Publisher)
Created2015