Matching Items (24)
Filtering by
- All Subjects: engineering
- All Subjects: wastewater
- Creators: Liu, Yongming
- Member of: Theses and Dissertations
- Resource Type: Text
- Status: Published
Description
Machine learning has demonstrated great potential across a wide range of applications such as computer vision, robotics, speech recognition, drug discovery, material science, and physics simulation. Despite its current success, however, there are still two major challenges for machine learning algorithms: limited robustness and generalizability.
The robustness of a neural network is defined as the stability of the network output under small input perturbations. It has been shown that neural networks are very sensitive to input perturbations, and the prediction from convolutional neural networks can be totally different for input images that are visually indistinguishable to human eyes. Based on such property, hackers can reversely engineer the input to trick machine learning systems in targeted ways. These adversarial attacks have shown to be surprisingly effective, which has raised serious concerns over safety-critical applications like autonomous driving. In the meantime, many established defense mechanisms have shown to be vulnerable under more advanced attacks proposed later, and how to improve the robustness of neural networks is still an open question.
The generalizability of neural networks refers to the ability of networks to perform well on unseen data rather than just the data that they were trained on. Neural networks often fail to carry out reliable generalizations when the testing data is of different distribution compared with the training one, which will make autonomous driving systems risky under new environment. The generalizability of neural networks can also be limited whenever there is a scarcity of training data, while it can be expensive to acquire large datasets either experimentally or numerically for engineering applications, such as material and chemical design.
In this dissertation, we are thus motivated to improve the robustness and generalizability of neural networks. Firstly, unlike traditional bottom-up classifiers, we use a pre-trained generative model to perform top-down reasoning and infer the label information. The proposed generative classifier has shown to be promising in handling input distribution shifts. Secondly, we focus on improving the network robustness and propose an extension to adversarial training by considering the transformation invariance. Proposed method improves the robustness over state-of-the-art methods by 2.5% on MNIST and 3.7% on CIFAR-10. Thirdly, we focus on designing networks that generalize well at predicting physics response. Our physics prior knowledge is used to guide the designing of the network architecture, which enables efficient learning and inference. Proposed network is able to generalize well even when it is trained with a single image pair.
The robustness of a neural network is defined as the stability of the network output under small input perturbations. It has been shown that neural networks are very sensitive to input perturbations, and the prediction from convolutional neural networks can be totally different for input images that are visually indistinguishable to human eyes. Based on such property, hackers can reversely engineer the input to trick machine learning systems in targeted ways. These adversarial attacks have shown to be surprisingly effective, which has raised serious concerns over safety-critical applications like autonomous driving. In the meantime, many established defense mechanisms have shown to be vulnerable under more advanced attacks proposed later, and how to improve the robustness of neural networks is still an open question.
The generalizability of neural networks refers to the ability of networks to perform well on unseen data rather than just the data that they were trained on. Neural networks often fail to carry out reliable generalizations when the testing data is of different distribution compared with the training one, which will make autonomous driving systems risky under new environment. The generalizability of neural networks can also be limited whenever there is a scarcity of training data, while it can be expensive to acquire large datasets either experimentally or numerically for engineering applications, such as material and chemical design.
In this dissertation, we are thus motivated to improve the robustness and generalizability of neural networks. Firstly, unlike traditional bottom-up classifiers, we use a pre-trained generative model to perform top-down reasoning and infer the label information. The proposed generative classifier has shown to be promising in handling input distribution shifts. Secondly, we focus on improving the network robustness and propose an extension to adversarial training by considering the transformation invariance. Proposed method improves the robustness over state-of-the-art methods by 2.5% on MNIST and 3.7% on CIFAR-10. Thirdly, we focus on designing networks that generalize well at predicting physics response. Our physics prior knowledge is used to guide the designing of the network architecture, which enables efficient learning and inference. Proposed network is able to generalize well even when it is trained with a single image pair.
ContributorsYao, Houpu (Author) / Ren, Yi (Thesis advisor) / Liu, Yongming (Committee member) / Li, Baoxin (Committee member) / Yang, Yezhou (Committee member) / Marvi, Hamidreza (Committee member) / Arizona State University (Publisher)
Created2019
Description
Corrosion is one of the key failure modes for stainless steel (SS) piping assets handling water resources managed by utility companies. During downtime, the costs start to incur as the field engineer procures its replacement parts. The parts may or may not be in stock depending on how old, complex, and common the part model is. As a result, water utility companies and its resilience to operate amid part failure are a strong function of the supply chain for replacement piping. Metal additive manufacturing (AM) has been widely recognized for its ability to (a) deliver small production scales, (b) address complex part geometries, (c) offer large elemental metal and alloy selections, (d) provide superior material properties. The key motive is to harvest the short lead time of metal AM to explore its use for replacement parts for legacy piping assets in utility-scale water management facilities. In this paper, the goal was to demonstrate 3D printing of stainless steel (SS) 316L parts using selective laser melting (SLM) technology. The corrosion resistance of 3D printed SS 316L was investigated using (a) Chronoamperometry (b) Cyclic Potentiodynamic Polarization (CPP) and Electrochemical Impedance Spectroscopy (EIS) and its improved resistance from wrought (conventional) part was also studied. Then the weldability of 3D printed SS 316L to wrought SS 316L was illustrated and finally, the mechanical strength of the weld and the effect of corrosion on weld strength was investigated using uniaxial tensile testing. The results show that 3D printed part compared to the wrought part has a) lower mass loss before and after corrosion, (b) higher pitting potential, and (c) higher charge transfer resistance. The tensile testing of welded dog bone specimens indicates that the 3D printed parts despite being less ductile were observed to have higher weld strength compared to the wrought part. On this basis, metal AM holds great value to be explored further for replacement piping parts owing to their better corrosion resistance and mechanical performance.
ContributorsSampath, Venkata Krishnan (Author) / Azeredo, Bruno (Thesis advisor) / Torres, Cesar (Committee member) / Mu, Bin (Committee member) / Arizona State University (Publisher)
Created2021
Description
Two fatigue life prediction methods using the energy-based approach have been proposed. A number of approaches have been developed in the past five decades. This study reviews some common models and discusses the model that is most suitable for each different condition, no matter whether the model is designed to solve uniaxial, multiaxial, or biaxial loading paths in fatigue prediction. In addition, different loading cases such as various loading and constant loading are also discussed. These models are suitable for one or two conditions in fatigue prediction. While most of the existing models can only solve single cases, the proposed new energy-based approach not only can deal with different loading paths but is applicable for various loading cases. The first energy-based model using the linear cumulative rule is developed to calculate random loading cases. The method is developed by combining Miner’s rule and the rainflow-counting algorithm. For the second energy-based method, I propose an alternative method and develop an approach to avert the rainflow-counting algorithm. Specifically, I propose to use an energy-based model by directly using the time integration concept. In this study, first, the equivalent energy concept that can transform three-dimensional loading into an equivalent loading will be discussed. Second, the new damage propagation method modified by fatigue crack growth will be introduced to deal with cycle-based fatigue prediction. Third, the time-based concept will be implemented to determine fatigue damage under every cycle in the random loading case. The formulation will also be explained in detail. Through this new model, the fatigue life can be calculated properly in different loading cases. In addition, the proposed model is verified with experimental datasets from several published studies. The data include both uniaxial and multiaxial loading paths under constant loading and random loading cases. Finally, the discussion and conclusion based on the results, are included. Additional loading cases such as the spectrum including both elastic and plastic regions will be explored in future research.
ContributorsTien, Shih-Chuan (Author) / Liu, Yongming (Thesis advisor) / Nian, Qiong (Committee member) / Jiao, Yang (Committee member) / Arizona State University (Publisher)
Created2021
Description
Collision-free path planning is also a major challenge in managing unmanned aerial vehicles (UAVs) fleets, especially in uncertain environments. The design of UAV routing policies using multi-agent reinforcement learning has been considered, and propose a Multi-resolution, Multi-agent, Mean-field reinforcement learning algorithm, named 3M-RL, for flight planning, where multiple vehicles need to avoid collisions with each other while moving towards their destinations. In this system, each UAV makes decisions based on local observations, and does not communicate with other UAVs. The algorithm trains a routing policy using an Actor-Critic neural network with multi-resolution observations, including detailed local information and aggregated global information based on mean-field. The algorithm tackles the curse-of-dimensionality problem in multi-agent reinforcement learning and provides a scalable solution. The proposed algorithm is tested in different complex scenarios in both 2D and 3D space and the simulation results show that 3M-RL result in good routing policies. Also as a compliment, dynamic data communications between UAVs and a control center has also been studied, where the control center needs to monitor the safety state of each UAV in the system in real time, where the transition of risk level is simply considered as a Markov process. Given limited communication bandwidth, it is impossible for the control center to communicate with all UAVs at the same time. A dynamic learning problem with limited communication bandwidth is also discussed in this paper where the objective is to minimize the total information entropy in real-time risk level tracking. The simulations also demonstrate that the algorithm outperforms policies such as a Round & Robin policy.
ContributorsWang, Weichang (Author) / Ying, Lei (Thesis advisor) / Liu, Yongming (Thesis advisor) / Zhang, Junshan (Committee member) / Zhang, Yanchao (Committee member) / Arizona State University (Publisher)
Created2021