In this thesis, vanishing points are the perspective cues used to control and navigate a quadrotor in an indoor corridor. Indoor corridors are an abundant source of parallel lines. As a consequence of perspective projection, parallel lines in the real world, that are not parallel to the plane of the camera, intersect at a point in the image. This point is called the vanishing point of the image. The vanishing point is sensitive to the lateral motion of the camera and hence the quadrotor. By tracking the position of the vanishing point in every image frame, the quadrotor can navigate along the center of the corridor.
Experiments are conducted using the Augmented Reality (AR) Drone 2.0. The drone is equipped with the following componenets: (1) 720p forward facing camera for vanishing point detection, (2) 240p downward facing camera, (3) Inertial Measurement Unit (IMU) for attitude control , (4) Ultrasonic sensor for estimating altitude, (5) On-board 1 GHz Processor for processing low level commands. The reliability of the vision algorithm is presented by flying the drone in indoor corridors.
Several simple ball intercept policies are examined. This includes open loop and closed loop policies. It is also shown how a low-cost differential-drive research grade robot can be built, modeled and controlled. Directions for developing more complex xy planar intercept policies are also briefly discussed. In short, the thesis establishes a foundation for future work on developing a practical ball catching robot.
In this work, I address the challenges of controlling a swarm of resource-constrained robots to achieve boundary coverage, which I refer to as the problem of stochastic boundary coverage. I first examined an instance of this behavior in the biological phenomenon of group food retrieval by desert ants, and developed a hybrid dynamical system model of this process from experimental data. Subsequently, with the aid of collaborators, I used a continuum abstraction of swarm population dynamics, adapted from a modeling framework used in chemical kinetics, to derive stochastic robot control policies that drive a swarm to target steady-state allocations around multiple boundaries in a way that is robust to environmental variations.
Next, I determined the statistical properties of the random graph that is formed by a group of robots, each with the same capabilities, that have attached to a boundary at random locations. I also computed the probability density functions (pdfs) of the robot positions and inter-robot distances for this case.
I then extended this analysis to cases in which the robots have heterogeneous communication/sensing radii and attach to a boundary according to non-uniform, non-identical pdfs. I proved that these more general coverage strategies generate random graphs whose probability of connectivity is Sharp-P Hard to compute. Finally, I investigated possible approaches to validating our boundary coverage strategies in multi-robot simulations with realistic Wi-fi communication.
Based on measurement from multiple vehicles, motor-wheel system dynamic model considering gearbox transmission has been developed. Noticing the difference between on ground vehicle behavior and off-ground vehicle behavior, on ground vehicle-motor model considering friction and battery internal resistance has been put forward and experimentally validated by multiple same type of vehicles. Then simplified longitudinal platoon model based on on-ground test were used as basis for platoon controller design.
Hardware and software has been updated to facilitate the goal of control a platoon of ground vehicles. Based on previous work of Lin on low-cost differential-drive
(DD) RC vehicles called Thunder Tumbler, new robot platform named Enhanced
Thunder Tumbler (ETT 2) has been developed with following improvement: (1) optical wheel-encoder which has 2.5 times higher resolution than magnetic based one,
(2) BNO055 IMU can read out orientation directly that LSM9DS0 IMU could not,
(3) TL-WN722N Wifi USB Adapter with external antenna which can support more stable communication compared to Edimax adapter, (4) duplex serial communication between Pi and Arduino than single direction communication from Pi to Arduino, (5) inter-vehicle communication based on UDP protocol.
All demonstrations presented using ETT vehicles. The following summarizes key hardware demonstrations: (1) cruise-control along line, (2) longitudinal platoon control based on local information (ultrasonic sensor) without inter-vehicle communication, (3) longitudinal platoon control based on local information (ultrasonic sensor) and leader information (speed). Hardware data/video is compared with, and corroborated by, model-based simulations. Platoon simulation and hardware data reveals that with necessary information from platoon leader, the control effort will be reduced and space deviation be diminished among propagation along the fleet of vehicles. In short, many capabilities that are critical for reaching the longer-term FAME goal are demonstrated.
To address these challenges, this thesis presents a formal approach to designing biologically-inspired swarm control strategies for spatially-confined coverage and payload transport tasks, as well as a novel low-cost, customizable robotic platform for testing swarm control approaches. Stochastic control strategies are developed that provably allocate a swarm of robots around the boundaries of multiple regions of interest or payloads to be transported. These strategies account for spatially-dependent effects on the robots' physical distribution and are largely robust to environmental variations. In addition, a control approach based on reinforcement learning is presented for collective payload towing that accommodates robots with heterogeneous maximum speeds. For both types of collective transport tasks, rigorous approaches are developed to identify and translate observed group retrieval behaviors in Novomessor cockerelli ants to swarm robotic control strategies. These strategies can replicate features of ant transport and inherit its properties of robustness to different environments and to varying team compositions. The approaches incorporate dynamical models of the swarm that are amenable to analysis and control techniques, and therefore provide theoretical guarantees on the system's performance. Implementation of these strategies on robotic swarms offers a way for biologists to test hypotheses about the individual-level mechanisms that drive collective behaviors. Finally, this thesis describes Pheeno, a new swarm robotic platform with a three degree-of-freedom manipulator arm, and describes its use in validating a variety of swarm control strategies.
Lunar Rover Navigation: Impact of Illumination Conditions on AI and Human Perception of Crater Sizes
When rover mission planners are laying out the path for their rover, they use a combination of stereo images and statistical and geological data in order to plot a course for the vehicle to follow for its mission. However, there is a lack of detailed images of the lunar surface that indicate the specific presence of hazards, such as craters, and the creation of such crater maps is time-consuming. There is also little known about how varying lighting conditions caused by the changing solar incidence angle affects perception as well. This paper addresses this issue by investigating how varying the incidence angle of the sun affects how well the human and AI can detect craters. It will also see how AI can accelerate the crater-mapping process, and how well it performs relative to a human annotating crater maps by hand. To accomplish this, several sets of images of the lunar surface were taken with varying incidence angles for the same spot and were annotated both by hand and by an AI. The results are observed, and then the AI performance was rated by calculating its resulting precision and recall, considering the human annotations as being the ground truth. It was found that there seems to be a maximum incidence angle for which detect rates are the highest, and that, at the moment, the AI’s detection of craters is poor, but it can be improved. With this, it can inform future and more expansive investigations into how lighting can affect the perception of hazards to rovers, as well as the role AI can play in creating these crater maps.