Matching Items (74)
Description
Visual navigation is a multi-disciplinary field across computer vision, machine learning and robotics. It is of great significance in both research and industrial applications. An intelligent agent with visual navigation ability will be capable of performing the following tasks: actively explore in environments, distinguish and localize a requested target and approach the target following acquired strategies. Despite a variety of advances in mobile robotics, enabling an autonomous with above-mentioned abilities is still a challenging and complex task. However, the solution to the task is very likely to accelerate the landing of assistive robots.
Reinforcement learning is a method that trains autonomous robot based on rewarding desired behaviors to help it obtain an action policy that maximizes rewards while the robot interacting with the environment. Through trial and error, an agent learns sophisticated and skillful strategies to handle complex tasks in the environment. Inspired by navigation procedures of human beings that when navigating through environments, humans reason about accessible spaces and geometry of the environment a lot based on first-person view, figure out the destination and then ease over, this work develops a model that maps from pixels to actions and inherently estimate the target as well as the free-space map. The model has three major constituents: (i) a cognitive mapper that maps the topologic free-space map from first-person view images, (ii) a target recognition network that locates a desired object and (iii) an action policy deep reinforcement learning network. Further, a planner model with cascade architecture based on multi-scale semantic top-down occupancy map input is proposed.
Reinforcement learning is a method that trains autonomous robot based on rewarding desired behaviors to help it obtain an action policy that maximizes rewards while the robot interacting with the environment. Through trial and error, an agent learns sophisticated and skillful strategies to handle complex tasks in the environment. Inspired by navigation procedures of human beings that when navigating through environments, humans reason about accessible spaces and geometry of the environment a lot based on first-person view, figure out the destination and then ease over, this work develops a model that maps from pixels to actions and inherently estimate the target as well as the free-space map. The model has three major constituents: (i) a cognitive mapper that maps the topologic free-space map from first-person view images, (ii) a target recognition network that locates a desired object and (iii) an action policy deep reinforcement learning network. Further, a planner model with cascade architecture based on multi-scale semantic top-down occupancy map input is proposed.
ContributorsZheng, Shibin (Author) / Yang, Yezhou (Thesis advisor) / Zhang, Wenlong (Committee member) / Ren, Yi (Committee member) / Arizona State University (Publisher)
Created2019
Description
Daily collaborative tasks like pushing a table or a couch require haptic communication between the people doing the task. To design collaborative motion planning algorithms for such applications, it is important to understand human behavior. Collaborative tasks involve continuous adaptations and intent recognition between the people involved in the task. This thesis explores the coordination between the human-partners through a virtual setup involving continuous visual feedback. The interaction and coordination are modeled as a two-step process: 1) Collecting data for a collaborative couch-pushing task, where both the people doing the task have complete information about the goal but are unaware of each other's cost functions or intentions and 2) processing the emergent behavior from complete information and fitting a model for this behavior to validate a mathematical model of agent-behavior in multi-agent collaborative tasks. The baseline model is updated using different approaches to resemble the trajectories generated by these models to human trajectories. All these models are compared to each other. The action profiles of both the agents and the position and velocity of the manipulated object during a goal-oriented task is recorded and used as expert-demonstrations to fit models resembling human behaviors. Analysis through hypothesis teasing is also performed to identify the difference in behaviors when there are complete information and information asymmetry among agents regarding the goal position.
ContributorsShintre, Pallavi Shrinivas (Author) / Zhang, Wenlong (Thesis advisor) / Si, Jennie (Committee member) / Ren, Yi (Committee member) / Arizona State University (Publisher)
Created2020
Description
Bicycle stabilization has become a popular topic because of its complex dynamic behavior and the large body of bicycle modeling research. Riding a bicycle requires accurately performing several tasks, such as balancing and navigation which may be difficult for disabled people. Their problems could be partially reduced by providing steering assistance. For stabilization of these highly maneuverable and efficient machines, many control techniques have been applied – achieving interesting results, but with some limitations which includes strict environmental requirements. This thesis expands on the work of Randlov and Alstrom, using reinforcement learning for bicycle self-stabilization with robotic steering. This thesis applies the deep deterministic policy gradient algorithm, which can handle continuous action spaces which is not possible for Q-learning technique. The research involved algorithm training on virtual environments followed by simulations to assess its results. Furthermore, hardware testing was also conducted on Arizona State University’s RISE lab Smart bicycle platform for testing its self-balancing performance. Detailed analysis of the bicycle trial runs are presented. Validation of testing was done by plotting the real-time states and actions collected during the outdoor testing which included the roll angle of bicycle. Further improvements in regard to model training and hardware testing are also presented.
ContributorsTurakhia, Shubham (Author) / Zhang, Wenlong (Thesis advisor) / Yong, Sze Zheng (Committee member) / Ren, Yi (Committee member) / Arizona State University (Publisher)
Created2020
Description
Bicycles and motorcycles offer maneuverability, energy efficiency and acceleration that four wheeled vehicles cannot offer given similar budget for. Two wheeled vehicles have drastically different dynamics from four wheeled vehicles due to their instability and gyroscopic effect from their wheels.
This thesis focuses on self-stabilization of a motorcycle using an active control momentum gyroscope (CMG) and validation of this multi-degree-of-freedom system’s mathematical model. Physical platform was created to mimic the simulation as accurately as possible and all components used were justified. This process involves derivation of a 3 Degree-of-Freedom (DOF) system’s forward kinematics and its Jacobian matrix, simulation analysis of different controller algorithms, setting the system and subsystem specifications, and real system experimentation and data analysis.
A Jacobian matrix was used to calculate accurately decomposed resultant angular velocities which are used to create the dynamics model of the system torque using the Euler-Lagrange method. This produces a nonlinear second order differential equation that is modeled using MATLAB/Simulink. PID, and cascaded feedback loop are tested in this Simulink model. Cascaded feedback loop shows most promises in the simulation analysis. Therefore, system specifications are calculated according to the data produced by this controller method. The model validation is executed using the Vicon motion capture system which captured the roll angle of the motorcycle. This work contributes to creating a set of procedures for creating a validated dynamic model for a CMG stabilized motorcycle which can be used to create variants of other self-stabilizing motorcycle system.
This thesis focuses on self-stabilization of a motorcycle using an active control momentum gyroscope (CMG) and validation of this multi-degree-of-freedom system’s mathematical model. Physical platform was created to mimic the simulation as accurately as possible and all components used were justified. This process involves derivation of a 3 Degree-of-Freedom (DOF) system’s forward kinematics and its Jacobian matrix, simulation analysis of different controller algorithms, setting the system and subsystem specifications, and real system experimentation and data analysis.
A Jacobian matrix was used to calculate accurately decomposed resultant angular velocities which are used to create the dynamics model of the system torque using the Euler-Lagrange method. This produces a nonlinear second order differential equation that is modeled using MATLAB/Simulink. PID, and cascaded feedback loop are tested in this Simulink model. Cascaded feedback loop shows most promises in the simulation analysis. Therefore, system specifications are calculated according to the data produced by this controller method. The model validation is executed using the Vicon motion capture system which captured the roll angle of the motorcycle. This work contributes to creating a set of procedures for creating a validated dynamic model for a CMG stabilized motorcycle which can be used to create variants of other self-stabilizing motorcycle system.
ContributorsMoon, Hansol (Author) / Zhang, Wenlong (Thesis advisor) / Frank, Daniel (Committee member) / Delp, Deana (Committee member) / Sugar, Thomas (Committee member) / Arizona State University (Publisher)
Created2020
Description
This thesis introduces a new robotic leg design with three degrees of freedom that
can be adapted for both bipedal and quadrupedal locomotive systems, and serves as
a blueprint for designers attempting to create low cost robot legs capable of balancing
and walking. Currently, bipedal leg designs are mostly rigid and have not strongly
taken into account the advantages/disadvantages of using an active ankle, as opposed
to a passive ankle, for balancing. This design uses low-cost compliant materials, but
the materials used are thick enough to mimic rigid properties under low stresses, so
this paper will treat the links as rigid materials. A new leg design has been created
that contains three degrees of freedom that can be adapted to contain either a passive
ankle using springs, or an actively controlled ankle using an additional actuator. This
thesis largely aims to focus on the ankle and foot design of the robot and the torque
and speed requirements of the design for motor selection. The dynamics of the system,
including height, foot width, weight, and resistances will be analyzed to determine
how to improve design performance. Model-based control techniques will be used to
control the angle of the leg for balancing. In doing so, it will also be shown that it
is possible to implement model-based control techniques on robots made of laminate
materials.
can be adapted for both bipedal and quadrupedal locomotive systems, and serves as
a blueprint for designers attempting to create low cost robot legs capable of balancing
and walking. Currently, bipedal leg designs are mostly rigid and have not strongly
taken into account the advantages/disadvantages of using an active ankle, as opposed
to a passive ankle, for balancing. This design uses low-cost compliant materials, but
the materials used are thick enough to mimic rigid properties under low stresses, so
this paper will treat the links as rigid materials. A new leg design has been created
that contains three degrees of freedom that can be adapted to contain either a passive
ankle using springs, or an actively controlled ankle using an additional actuator. This
thesis largely aims to focus on the ankle and foot design of the robot and the torque
and speed requirements of the design for motor selection. The dynamics of the system,
including height, foot width, weight, and resistances will be analyzed to determine
how to improve design performance. Model-based control techniques will be used to
control the angle of the leg for balancing. In doing so, it will also be shown that it
is possible to implement model-based control techniques on robots made of laminate
materials.
ContributorsShafa, Taha A (Author) / Aukes, Daniel M (Thesis advisor) / Rogers, Bradley (Committee member) / Zhang, Wenlong (Committee member) / Arizona State University (Publisher)
Created2020
Description
This work introduces self-organizing techniques to reduce the complexity and burden of coordinating distributed energy resources (DERs) and microgrids that are rapidly increasing in scale globally. Technical and financial evaluations completed for power customers and for utilities identify how disruptions are occurring in conventional energy business models. Analyses completed for Chicago, Seattle, and Phoenix demonstrate site-specific and generalizable findings. Results indicate that net metering had a significant effect on the optimal amount of solar photovoltaics (PV) for households to install and how utilities could recover lost revenue through increasing energy rates or monthly fees. System-wide ramp rate requirements also increased as solar PV penetration increased. These issues are resolved using a generalizable, scalable transactive energy framework for microgrids to enable coordination and automation of DERs and microgrids to ensure cost effective use of energy for all stakeholders. This technique is demonstrated on a 3-node and 9-node network of microgrid nodes with various amounts of load, solar, and storage. Results found that enabling trading could achieve cost savings for all individual nodes and for the network up to 5.4%. Trading behaviors are expressed using an exponential valuation curve that quantifies the reputation of trading partners using historical interactions between nodes for compatibility, familiarity, and acceptance of trades. The same 9-node network configuration is used with varying levels of connectivity, resulting in up to 71% cost savings for individual nodes and up to 13% cost savings for the network as a whole. The effect of a trading fee is also explored to understand how electricity utilities may gain revenue from electricity traded directly between customers. If a utility imposed a trading fee to recoup lost revenue then trading is financially infeasible for agents, but could be feasible if only trying to recoup cost of distribution charges. These scientific findings conclude with a brief discussion of physical deployment opportunities.
ContributorsJanko, Samantha Ariel (Author) / Johnson, Nathan (Thesis advisor) / Zhang, Wenlong (Committee member) / Herche, Wesley (Committee member) / Arizona State University (Publisher)
Created2019
Description
Recent years, there has been many attempts with different approaches to the human-robot interaction (HRI) problems. In this paper, the multi-agent interaction is formulated as a differential game with incomplete information. To tackle this problem, the parameter estimation method is utilized to obtain the approximated solution in a real time basis. Previous studies in the parameter estimation made the assumption that the human parameters are known by the robot; but such may not be the case and there exists uncertainty in the modeling of the human rewards as well as human's modeling of the robot's rewards. The proposed method, empathetic estimation, is tested and compared with the ``non-empathetic'' estimation from the existing works. The case studies are conducted in an uncontrolled intersection with two agents attempting to pass efficiently. Results have shown that in the case of both agents having inconsistent belief of the other agent's parameters, the empathetic agent performs better at estimating the parameters and has higher reward values, which indicates the scenarios when empathy is essential: when agent's initial belief is mismatched from the true parameters/intent of the agents.
ContributorsChen, Yi (Author) / Ren, Yi (Thesis advisor) / Zhang, Wenlong (Committee member) / Yong, Sze Zheng (Committee member) / Arizona State University (Publisher)
Created2021
Description
Robotic assisted devices in gait rehabilitation have not seen penetration into clinical settings proportionate to the developments in this field. A possible reason for this is due to the development and evaluation of these devices from a predominantly engineering perspective. One way to mitigate this effect is to further include the principles of neurophysiology into the development of these systems. To further include these principles, this research proposes a method for grounded evaluation of three machine learning algorithms to gain insight on what modeling approaches are able to both replicate therapist assistance and emulate therapist strategies. The algorithms evaluated in this paper include ordinary least squares regression (OLS), gaussian process regression (GPR) and inverse reinforcement learning (IRL). The results show that grounded evaluation is able to provide evidence to support the algorithms at a higher resolution. Also, it was observed that GPR is likely the most accurate algorithm to replicate therapist assistance and to emulate therapist adaptation strategies.
ContributorsSmith, Mason Owen (Author) / Zhang, Wenlong (Thesis advisor) / Ben Amor, Hani (Committee member) / Sugar, Thomas (Committee member) / Arizona State University (Publisher)
Created2021
Description
This dissertation studies the methods to enhance the performance of foldable robots manufactured by laminated techniques. This class of robots are unique in their manufacturing process, which involves cutting and staking up thin layers of different materials with various stiffness. While inheriting the advantages of soft robots -- low weight, affordable manufacturing cost and a fast prototyping process -- a wider range of actuators is available to these mechanisms, while modeling their behavior requires less computational cost.The fundamental question this dissertation strives to answer is how to decode and leverage the effect of material stiffness in these robots. These robots' stiffness is relatively limited due to their slender design, specifically at larger scales. While compliant robots may have inherent advantages such as being safer to work around, this low rigidity makes modeling more complex. This complexity is mostly contained in material deformation since the conventional actuators such as servo motors can be easily leveraged in these robots. As a result, when introduced to real-world environments, efficient modeling and control of these robots are more achievable than conventional soft robots.
Various approaches have been taken to design, model, and control a variety of laminate robot platforms by investigating the effect of material deformation in prototypes while they interact with their working environments. The results obtained show that data-driven approaches such as experimental identification and machine learning techniques are more reliable in modeling and control of these mechanisms. Also, machine learning techniques for training robots in non-ideal experimental setups that encounter the uncertainties of real-world environments can be leveraged to find effective gaits with high performance. Our studies on the effect of stiffness of thin, curved sheets of materials has evolved into introducing a new class of soft elements which we call Soft, Curved, Reconfigurable, Anisotropic Mechanisms (SCRAMs). Like bio-mechanical systems, SCRAMs are capable of re-configuring the stiffness of curved surfaces to enhance their performance and adaptability. Finally, the findings of this thesis show promising opportunities for foldable robots to become an alternative for conventional soft robots since they still offer similar advantages in a fraction of computational expense.
ContributorsSharifzadeh, Mohammad (Author) / Aukes, Daniel (Thesis advisor) / Sugar, Thomas (Committee member) / Zhang, Wenlong (Committee member) / Arizona State University (Publisher)
Created2021
Description
The knee joint has essential functions to support the body weight and maintain normal walking. Neurological diseases like stroke and musculoskeletal disorders like osteoarthritis can affect the function of the knee. Besides physical therapy, robot-assisted therapy using wearable exoskeletons and exosuits has shown the potential as an efficient therapy that helps patients restore their limbs’ functions. Exoskeletons and exosuits are being developed for either human performance augmentation or medical purposes like rehabilitation. Although, the research on exoskeletons started early before exosuits, the research and development on exosuits have recently grown rapidly as exosuits have advantages that exoskeletons lack. The objective of this research is to develop a soft exosuit for knee flexion assistance and validate its ability to reduce the EMG activity of the knee flexor muscles. The exosuit has been developed with a novel soft fabric actuator and novel 3D printed adjustable braces to attach the actuator aligned with the knee. A torque analytical model has been derived and validate experimentally to characterize and predict the torque output of the actuator. In addition to that, the actuator’s deflation and inflation time has been experimentally characterized and a controller has been implemented and the exosuit has been tested on a healthy human subject. It is found that the analytical torque model succeeded to predict the torque output in flexion angle range from 0° to 60° more precisely than analytical models in the literature. Deviations existed beyond 60° might have happened because some factors like fabric extensibility and actuator’s bending behavior. After human testing, results showed that, for the human subject tested, the exosuit gave the best performance when the controller was tuned to inflate at 31.9 % of the gait cycle. At this inflation timing, the biceps femoris, the semitendinosus and the vastus lateralis muscles showed average electromyography (EMG) reduction of - 32.02 %, - 23.05 % and - 2.85 % respectively. Finally, it is concluded that the developed exosuit may assist the knee flexion of more diverse healthy human subjects and it may potentially be used in the future in human performance augmentation and rehabilitation of people with disabilities.
ContributorsHasan, Ibrahim Mohammed Ibrahim (Author) / Zhang, Wenlong (Thesis advisor) / Aukes, Daniel (Committee member) / McDaniel, Troy (Committee member) / Arizona State University (Publisher)
Created2021