Matching Items (2)
Filtering by
- Genre: Doctoral Dissertation
Description
Object detection is an interesting computer vision area that is concerned with the detection of object instances belonging to specific classes of interest as well as the localization of these instances in images and/or videos. Object detection serves as a vital module in many computer vision based applications. This work focuses on the development of object detection methods that exhibit increased robustness to varying illuminations and image quality. In this work, two methods for robust object detection are presented.
In the context of varying illumination, this work focuses on robust generic obstacle detection and collision warning in Advanced Driver Assistance Systems (ADAS) under varying illumination conditions. The highlight of the first method is the ability to detect all obstacles without prior knowledge and detect partially occluded obstacles including the obstacles that have not completely appeared in the frame (truncated obstacles). It is first shown that the angular distortion in the Inverse Perspective Mapping (IPM) domain belonging to obstacle edges varies as a function of their corresponding 2D location in the camera plane. This information is used to generate object proposals. A novel proposal assessment method based on fusing statistical properties from both the IPM image and the camera image to perform robust outlier elimination and false positive reduction is also proposed.
In the context of image quality, this work focuses on robust multiple-class object detection using deep neural networks for images with varying quality. The use of Generative Adversarial Networks (GANs) is proposed in a novel generative framework to generate features that provide robustness for object detection on reduced quality images. The proposed GAN-based Detection of Objects (GAN-DO) framework is not restricted to any particular architecture and can be generalized to several deep neural network (DNN) based architectures. The resulting deep neural network maintains the exact architecture as the selected baseline model without adding to the model parameter complexity or inference speed. Performance results provided using GAN-DO on object detection datasets establish an improved robustness to varying image quality and a higher object detection and classification accuracy compared to the existing approaches.
In the context of varying illumination, this work focuses on robust generic obstacle detection and collision warning in Advanced Driver Assistance Systems (ADAS) under varying illumination conditions. The highlight of the first method is the ability to detect all obstacles without prior knowledge and detect partially occluded obstacles including the obstacles that have not completely appeared in the frame (truncated obstacles). It is first shown that the angular distortion in the Inverse Perspective Mapping (IPM) domain belonging to obstacle edges varies as a function of their corresponding 2D location in the camera plane. This information is used to generate object proposals. A novel proposal assessment method based on fusing statistical properties from both the IPM image and the camera image to perform robust outlier elimination and false positive reduction is also proposed.
In the context of image quality, this work focuses on robust multiple-class object detection using deep neural networks for images with varying quality. The use of Generative Adversarial Networks (GANs) is proposed in a novel generative framework to generate features that provide robustness for object detection on reduced quality images. The proposed GAN-based Detection of Objects (GAN-DO) framework is not restricted to any particular architecture and can be generalized to several deep neural network (DNN) based architectures. The resulting deep neural network maintains the exact architecture as the selected baseline model without adding to the model parameter complexity or inference speed. Performance results provided using GAN-DO on object detection datasets establish an improved robustness to varying image quality and a higher object detection and classification accuracy compared to the existing approaches.
ContributorsPrakash, Charan Dudda (Author) / Karam, Lina (Thesis advisor) / Abousleman, Glen (Committee member) / Jayasuriya, Suren (Committee member) / Yu, Hongbin (Committee member) / Arizona State University (Publisher)
Created2020
Description
Unmanned aerial vehicles (UAVs) have reshaped the world of aviation. With the emergence of different types of UAVs, a multitude of mission critical applications, e.g., aerial photography, package delivery, grasping and manipulation, aerial reconnaissance and surveillance have been accomplished successfully. All of the aforementioned applications require the UAVs to be robust to external disturbances and safe while flying in cluttered environments and these factors are of paramount importance for task completion. In the first phase, this dissertation starts by presenting the synthesis and experimental validation of real-time low-level estimation and robust attitude and position controllers for multirotors. For the task of reliable position estimation, a hybrid low-pass de-trending filter is proposed for attenuating noise and drift in the velocity and position estimates respectively. Subsequently, a disturbance observer (DOB) approach with online Q-filter tuning is proposed for disturbance rejection and precise position control. Finally, a non-linear disturbance observer (NDOB) approach, along with a parameter optimization framework, is proposed for robust attitude control of multirotors. Multiple simulation and experimental flight tests are performed to demonstrate the efficacy of the proposed algorithms. Aerial grasping and collection is a type of mission-critical task which requires vision based sensing and robust control algorithms for successful task completion. In the second phase, this dissertation initially explores different object grasping approaches utilizing soft and rigid graspers. Additionally, vision based control paradigms are developed for object grasping and collection applications, specifically from water surfaces. Autonomous object collection from water surfaces presents a multitude of challenges: i) object drift due to propeller outwash, ii) reflection and glare from water surfaces makes object detection extremely challenging and iii) lack of reliable height sensors above water surface (for autonomous landing on water). Finally, a first of its kind aerial manipulation system, with an integrated net system and a robust vision based control structure, is proposed for floating object collection from water surfaces. Objects of different shapes and sizes are collected, through multiple experimental flight tests, with a success rate of 91.6%. To the best of the author's knowledge, this is the first work demonstrating autonomous object collection from water surfaces.
ContributorsMishra, Shatadal (Author) / Zhang, Wenlong (Thesis advisor) / Berman, Spring M (Committee member) / Sugar, Thomas G (Committee member) / Arizona State University (Publisher)
Created2021