Matching Items (99)
Description
Despite the rapid adoption of robotics and machine learning in industry, their application to scientific studies remains under-explored. Combining industry-driven advances with scientific exploration provides new perspectives and a greater understanding of the planet and its environmental processes. Focusing on rock detection, mapping, and dynamics analysis, I present technical approaches and scientific results of developing robotics and machine learning technologies for geomorphology and seismic hazard analysis. I demonstrate an interdisciplinary research direction to push the frontiers of both robotics and geosciences, with potential translational contributions to commercial applications for hazard monitoring and prospecting. To understand the effects of rocky fault scarp development on rock trait distributions, I present a data-processing pipeline that utilizes unpiloted aerial vehicles (UAVs) and deep learning to segment densely distributed rocks in several orders of magnitude. Quantification and correlation analysis of rock trait distributions demonstrate a statistical approach for geomorphology studies. Fragile geological features such as precariously balanced rocks (PBRs) provide upper-bound ground motion constraints for hazard analysis. I develop an offboard method and onboard method as complementary to each other for PBR searching and mapping. Using deep learning, the offboard method segments PBRs in point clouds reconstructed from UAV surveys. The onboard method equips a UAV with edge-computing devices and stereo cameras, enabling onboard machine learning for real-time PBR search, detection, and mapping during surveillance. The offboard method provides an efficient solution to find PBR candidates in existing point clouds, which is useful for field reconnaissance. The onboard method emphasizes mapping individual PBRs for their complete visible surface features, such as basal contacts with pedestals–critical geometry to analyze fragility. After PBRs are mapped, I investigate PBR dynamics by building a virtual shake robot (VSR) that simulates ground motions to test PBR overturning. The VSR demonstrates that ground motion directions and niches are important factors determining PBR fragility, which were rarely considered in previous studies. The VSR also enables PBR large-displacement studies by tracking a toppled-PBR trajectory, presenting novel methods of rockfall hazard zoning. I build a real mini shake robot providing a reverse method to validate simulation experiments in the VSR.
ContributorsChen, Zhiang (Author) / Arrowsmith, Ramon (Thesis advisor) / Das, Jnaneshwar (Thesis advisor) / Bell, James (Committee member) / Berman, Spring (Committee member) / Christensen, Philip (Committee member) / Whipple, Kelin (Committee member) / Arizona State University (Publisher)
Created2022
Description
A Graph Neural Network (GNN) is a type of neural network architecture that operates on data consisting of objects and their relationships, which are represented by a graph. Within the graph, nodes represent objects and edges represent associations between those objects. The representation of relationships and correlations between data is unique to graph structures. GNNs exploit this feature of graphs by augmenting both forms of data, individual and relational, and have been designed to allow for communication and sharing of data within each neural network layer. These benefits allow each node to have an enriched perspective, or a better understanding, of its neighbouring nodes and its connections to those nodes. The ability of GNNs to efficiently process high-dimensional node data and multi-faceted relationships among nodes gives them advantages over neural network architectures such as Convolutional Neural Networks (CNNs) that do not implicitly handle relational data. These quintessential characteristics of GNN models make them suitable for solving problems in which the correspondences among input data are needed to produce an accurate and precise representation of these data. GNN frameworks may significantly improve existing communication and control techniques for multi-agent tasks by implicitly representing not only information associated with the individual agents, such as agent position, velocity, and camera data, but also their relationships with one another, such as distances between the agents and their ability to communicate with one another. One such task is a multi-agent navigation problem in which the agents must coordinate with one another in a decentralized manner, using proximity sensors only, to navigate safely to their intended goal positions in the environment without collisions or deadlocks. The contribution of this thesis is the design of an end-to-end decentralized control scheme for multi-agent navigation that utilizes GNNs to prevent inter-agent collisions and deadlocks. The contributions consist of the development, simulation and evaluation of the performance of an advantage actor-critic (A2C) reinforcement learning algorithm that employs actor and critic networks for training that simultaneously approximate the policy function and value function, respectively. These networks are implemented using GNN frameworks for navigation by groups of 3, 5, 10 and 15 agents in simulated two-dimensional environments. It is observed that in $40\%$ to $50\%$ of the simulation trials, between 70$\%$ to 80$\%$ of the agents reach their goal positions without colliding with other agents or becoming trapped in deadlocks. The model is also compared to a random run simulation, where actions are chosen randomly for the agents and observe that the model performs notably well for smaller groups of agents.
ContributorsAyalasomayajula, Manaswini (Author) / Berman, Spring (Thesis advisor) / Mian, Sami (Committee member) / Pavlic, Theodore (Committee member) / Arizona State University (Publisher)
Created2022
Description
For a system of autonomous vehicles functioning together in a traffic scene, 3Dunderstanding of participants in the field of view or surrounding is very essential for
assessing the safety operation of the involved. This problem can be decomposed into online
pose and shape estimation, which has been a core research area of computer vision for over
a decade now. This work is an add-on to support and improve the joint estimate of the pose
and shape of vehicles from monocular cameras. The objective of jointly estimating the
vehicle pose and shape online is enabled by what is called an offline reconstruction
pipeline. In the offline reconstruction step, an approach to obtain the vehicle 3D shape with
keypoints labeled is formulated.
This work proposes a multi-view reconstruction pipeline using images and masks
which can create an approximate shape of vehicles and can be used as a shape prior. Then
a 3D model-fitting optimization approach to refine the shape prior using high quality
computer-aided design (CAD) models of vehicles is developed. A dataset of such 3D
vehicles with 20 keypoints annotated is prepared and call it the AvaCAR dataset. The
AvaCAR dataset can be used to estimate the vehicle shape and pose, without having the
need to collect significant amounts of data needed for adequate training of a neural
network. The online reconstruction can use this synthesis dataset to generate novel
viewpoints and simultaneously train a neural network for pose and shape estimation. Most
methods in the current literature using deep neural networks, that are trained to estimate
pose of the object from a single image, are inherently biased to the viewpoint of the images
used. This approach aims at addressing these existing limitations in the current method by
delivering the online estimation a shape prior which can generate novel views to account
for the bias due to viewpoint. The dataset is provided with ground truth extrinsic parameters
and the compact vector based shape representations which along with the multi-view
dataset can be used to efficiently trained neural networks for vehicle pose and shape
estimation. The vehicles in this library are evaluated with some standard metrics to assure
they are capable of aiding online estimation and model based tracking.
ContributorsDUTTA, PRABAL BIJOY (Author) / Yang, Yezhou (Thesis advisor) / Berman, Spring (Committee member) / Lu, Duo (Committee member) / Arizona State University (Publisher)
Created2022
Description
This work has improved the quality of the solution to the sparse rewards problemby combining reinforcement learning (RL) with knowledge-rich planning. Classical
methods for coping with sparse rewards during reinforcement learning modify the
reward landscape so as to better guide the learner. In contrast, this work combines
RL with a planner in order to utilize other information about the environment. As
the scope for representing environmental information is limited in RL, this work has
conflated a model-free learning algorithm – temporal difference (TD) learning – with
a Hierarchical Task Network (HTN) planner to accommodate rich environmental
information in the algorithm. In the perpetual sparse rewards problem, rewards
reemerge after being collected within a fixed interval of time, culminating in a lack of a
well-defined goal state as an exit condition to the problem. Incorporating planning in
the learning algorithm not only improves the quality of the solution, but the algorithm
also avoids the ambiguity of incorporating a goal of maximizing profit while using
only a planning algorithm to solve this problem. Upon occasionally using the HTN
planner, this algorithm provides the necessary tweak toward the optimal solution. In
this work, I have demonstrated an on-policy algorithm that has improved the quality
of the solution over vanilla reinforcement learning. The objective of this work has
been to observe the capacity of the synthesized algorithm in finding optimal policies to
maximize rewards, awareness of the environment, and the awareness of the presence
of other agents in the vicinity.
ContributorsNandan, Swastik (Author) / Pavlic, Theodore (Thesis advisor) / Das, Jnaneshwar (Thesis advisor) / Berman, Spring (Committee member) / Arizona State University (Publisher)
Created2022
Description
Navigation and mapping in GPS-denied environments, such as coal mines ordilapidated buildings filled with smog or particulate matter, pose a significant challenge
due to the limitations of conventional LiDAR or vision systems. Therefore there
exists a need for a navigation algorithm and mapping strategy which do not use vision
systems but are still able to explore and map the environment. The map can further
be used by first responders and cave explorers to access the environments.
This thesis presents the design of a collision-resilient Unmanned Aerial Vehicle
(UAV), XPLORER that utilizes a novel navigation algorithm for exploration and
simultaneous mapping of the environment. The real-time navigation algorithm uses
the onboard Inertial Measurement Units (IMUs) and arm bending angles for contact
estimation and employs an Explore and Exploit strategy. Additionally, the quadrotor
design is discussed, highlighting its improved stability over the previous design.
The generated map of the environment can be utilized by autonomous vehicles to
navigate the environment. The navigation algorithm is validated in multiple real-time
experiments in different scenarios consisting of concave and convex corners and circular
objects. Furthermore, the developed mapping framework can serve as an auxiliary
input for map generation along with conventional LiDAR or vision-based mapping
algorithms.
Both the navigation and mapping algorithms are designed to be modular, making
them compatible with conventional UAVs also. This research contributes to the
development of navigation and mapping techniques for GPS-denied environments,
enabling safer and more efficient exploration of challenging territories.
ContributorsPandian Saravanakumaran, Aravind Adhith (Author) / Zhang, Wenlong (Thesis advisor) / Das, Jnaneshwar (Committee member) / Berman, Spring (Committee member) / Arizona State University (Publisher)
Created2023
Description
This dissertation introduces and examines Soft Curved Reconfigurable Anisotropic Mechanisms (SCRAMs) as a solution to address actuation, manufacturing, and modeling challenges in the field of soft robotics, with the aim of facilitating the broader implementation of soft robots in various industries. SCRAM systems utilize the curved geometry of thin elastic structures to tackle these challenges in soft robots. SCRAM devices can modify their dynamic behavior by incorporating reconfigurable anisotropic stiffness, thereby enabling tailored locomotion patterns for specific tasks. This approach simplifies the actuation of robots, resulting in lighter, more flexible, cost-effective, and safer soft robotic systems. This dissertation demonstrates the potential of SCRAM devices through several case studies. These studies investigate virtual joints and shape change propagation in tubes, as well as anisotropic dynamic behavior in vibrational soft twisted beams, effectively demonstrating interesting locomotion patterns that are achievable using simple actuation mechanisms. The dissertation also addresses modeling and simulation challenges by introducing a reduced-order modeling approach. This approach enables fast and accurate simulations of soft robots and is compatible with existing rigid body simulators. Additionally, this dissertation investigates the prototyping processes of SCRAM devices and offers a comprehensive framework for the development of these devices. Overall, this dissertation demonstrates the potential of SCRAM devices to overcome actuation, modeling, and manufacturing challenges in soft robotics. The innovative concepts and approaches presented have implications for various industries that require cost-effective, adaptable, and safe robotic systems. SCRAM devices pave the way for the widespread application of soft robots in diverse domains.
ContributorsJiang, Yuhao (Author) / Aukes, Daniel (Thesis advisor) / Berman, Spring (Committee member) / Lee, Hyunglae (Committee member) / Marvi, Hamidreza (Committee member) / Srivastava, Siddharth (Committee member) / Arizona State University (Publisher)
Created2023
Description
Ferrofluidic microrobots have emerged as promising tools for minimally invasive medical procedures, leveraging their unique properties to navigate through complex fluids and reach otherwise inaccessible regions of the human body, thereby enabling new applications in areas such as targeted drug delivery, tissue engineering, and diagnostics. This dissertation develops a model-predictive controller for the external magnetic manipulation of ferrofluid microrobots. Several experiments are performed to illustrate the adaptability and generalizability of the control algorithm to changes in system parameters, including the three-dimensional reference trajectory, the velocity of the workspace fluid, and the size, orientation, deformation, and velocity of the microrobotic droplet. A linear time-invariant control system governing the dynamics of locomotion is derived and used as the constraints of a least squares optimal control algorithm to minimize the projected error between the actual trajectory and the desired trajectory of the microrobot. The optimal control problem is implemented after time discretization using quadratic programming. In addition to demonstrating generalizability and adaptability, the accuracy of the control algorithm is analyzed for several different types of experiments. The experiments are performed in a workspace with a static surrounding fluid and extended to a workspace with fluid flowing through it. The results suggest that the proposed control algorithm could enable new capabilities for ferrofluidic microrobots, opening up new opportunities for applications in minimally invasive medical procedures, lab-on-a-chip, and microfluidics.
ContributorsSkowronek, Elizabeth Olga (Author) / Marvi, Hamidreza (Thesis advisor) / Berman, Spring (Committee member) / Platte, Rodrigo (Committee member) / Xu, Zhe (Committee member) / Lee, Hyunglae (Committee member) / Arizona State University (Publisher)
Created2023
Description
This thesis presents a study on the user adaptive variable impedance control of a wearable ankle robot for robot-aided rehabilitation with a primary focus on enhancing accuracy and speed. The controller adjusts the impedance parameters based on the user's kinematic data to provide personalized assistance. Bayesian optimization is employed to minimize an objective function formulated from the user's kinematic data to adapt the impedance parameters per user, thereby enhancing speed and accuracy. Gaussian process is used as a surrogate model for optimization to account for uncertainties and outliers inherent to human experiments. Student-t process based outlier detection is utilized to enhance optimization robustness and accuracy. The efficacy of the optimization is evaluated based on measures of speed, accuracy, and effort, and compared with an untuned variable impedance controller during 2D curved trajectory following tasks. User effort was measured based on muscle activation data from the tibialis anterior, peroneus longus, soleus, and gastrocnemius muscles. The optimized controller was evaluated on 15 healthy subjects and demonstrated an average increase in speed of 9.85% and a decrease in deviation from the ideal trajectory of 7.57%, compared to an unoptimized variable impedance controller. The strategy also reduced the time to complete tasks by 6.57%, while maintaining a similar level of user effort.
ContributorsManoharan, Gautham (Author) / Lee, Hyunglae (Thesis advisor) / Berman, Spring (Committee member) / Xu, Zhe (Committee member) / Arizona State University (Publisher)
Created2023
Description
A swarm of unmanned aerial vehicles (UAVs) has many potential applications including disaster relief, search and rescue, and area surveillance. A critical factor to a UAV swarm’s success is its ability to collectively locate and pursue targets determined to be of high quality with minimal and decentralized communication. Prior work has investigated nature-based solutions to this problem, in particular the behavior of honeybees when making decisions on future nest sites. A UAV swarm may mimic this behavior for similar ends, taking advantage of widespread sensor coverage induced by a large population. To determine whether the proven success of honeybee strategies may still be found in UAV swarms in more complex and difficult conditions, a series of simulations were created in Python using a behavior modeled after the work of Cooke et al. UAV and environmental properties were varied to determine the importance of each to the success of the swarm and to find emergent behaviors caused by combinations of variables. From the simulation work done, it was found that agent population and lifespan were the two most important factors to swarm success, with preference towards small teams with long-lasting UAVs.
ContributorsGao, Max (Author) / Berman, Spring (Thesis director) / Pavlic, Theodore (Committee member) / Barrett, The Honors College (Contributor) / College of Integrative Sciences and Arts (Contributor) / Engineering Programs (Contributor)
Created2023-05
Description
In this work, I propose to bridge the gap between human users and adaptive control of robotic systems. The goal is to enable robots to consider user feedback and adjust their behaviors. A critical challenge with designing such systems is that users are often non-experts, with limited knowledge about the robot's hardware and dynamics. In the domain of human-robot interaction, there exist different modalities of conveying information regarding the desired behavior of the robot, most commonly used are demonstrations, and preferences. While it is challenging for non-experts to provide demonstrations of robot behavior, works that consider preferences expressed as trajectory rankings lead to users providing noisy and possibly conflicting information, leading to slow adaptation or system failures. The end user can be expected to be familiar with the dynamics and how they relate to their desired objectives through repeated interactions with the system. However, due to inadequate knowledge about the system dynamics, it is expected that the user would find it challenging to provide feedback on all dimension's of the system's behavior at all times. Thus, the key innovation of this work is to enable users to provide partial instead of completely specified preferences as with traditional methods that learn from user preferences. In particular, I consider partial preferences in the form of preferences over plant dynamic parameters, for which I propose Adaptive User Control (AUC) of robotic systems. I leverage the correlations between the observed and hidden parameter preferences to deal with incompleteness. I use a sparse Gaussian Process Latent Variable Model formulation to learn hidden variables that represent the relationships between the observed and hidden preferences over the system parameters. This model is trained using Stochastic Variational Inference with a distributed loss formulation. I evaluate AUC in a custom drone-swarm environment and several domains from DeepMind control suite. I compare AUC with the state-of-the-art preference-based reinforcement learning methods that are utilized with user preferences. Results show that AUC outperforms the baselines substantially in terms of sample and feedback complexity.
ContributorsBiswas, Upasana (Author) / Zhang, Yu (Thesis advisor) / Kambhampati, Subbarao (Committee member) / Berman, Spring (Committee member) / Liu, Lantao (Committee member) / Arizona State University (Publisher)
Created2023