Robots are often used in long-duration scenarios, such as on the surface of Mars,where they may need to adapt to environmental changes. Typically, robots have been built specifically for single tasks, such as moving boxes in a warehouse or surveying construction sites. However, there is a modern trend away from human hand-engineering and toward robot learning. To this end, the ideal robot is not engineered,but automatically designed for a specific task. This thesis focuses on robots which learn path-planning algorithms for specific environments. Learning is accomplished via genetic programming. Path-planners are represented as Python code, which is optimized via Pareto evolution. These planners are encouraged to explore curiously and efficiently. This research asks the questions: “How can robots exhibit life-long learning where they adapt to changing environments in a robust way?”, and “How can robots learn to be curious?”.

Optimal foraging theory provides a suite of tools that model the best way that an animal will <br/>structure its searching and processing decisions in uncertain environments. It has been <br/>successful characterizing real patterns of animal decision making, thereby providing insights<br/>into why animals behave the way they do. However, it does not speak to how animals make<br/>decisions that tend to be adaptive. Using simulation studies, prior work has shown empirically<br/>that a simple decision-making heuristic tends to produce prey-choice behaviors that, on <br/>average, match the predicted behaviors of optimal foraging theory. That heuristic chooses<br/>to spend time processing an encountered prey item if that prey item's marginal rate of<br/>caloric gain (in calories per unit of processing time) is greater than the forager's<br/>current long-term rate of accumulated caloric gain (in calories per unit of total searching<br/>and processing time). Although this heuristic may seem intuitive, a rigorous mathematical<br/>argument for why it tends to produce the theorized optimal foraging theory behavior has<br/>not been developed. In this thesis, an analytical argument is given for why this<br/>simple decision-making heuristic is expected to realize the optimal performance<br/>predicted by optimal foraging theory. This theoretical guarantee not only provides support<br/>for why such a heuristic might be favored by natural selection, but it also provides<br/>support for why such a heuristic might a reliable tool for decision-making in autonomous<br/>engineered agents moving through theatres of uncertain rewards. Ultimately, this simple<br/>decision-making heuristic may provide a recipe for reinforcement learning in small robots<br/>with little computational capabilities.

Despite the fact that seizures are commonly associated with autism spectrum disorder (ASD), the effectiveness of treatments for seizures has not been well studied in individuals with ASD. This manuscript reviews both traditional and novel treatments for seizures associated with ASD. Studies were selected by systematically searching major electronic databases and by a panel of experts that treat ASD individuals. Only a few anti-epileptic drugs (AEDs) have undergone carefully controlled trials in ASD, but these trials examined outcomes other than seizures. Several lines of evidence point to valproate, lamotrigine, and levetiracetam as the most effective and tolerable AEDs for individuals with ASD. Limited evidence supports the use of traditional non-AED treatments, such as the ketogenic and modified Atkins diet, multiple subpial transections, immunomodulation, and neurofeedback treatments. Although specific treatments may be more appropriate for specific genetic and metabolic syndromes associated with ASD and seizures, there are few studies which have documented the effectiveness of treatments for seizures for specific syndromes. Limited evidence supports l-carnitine, multivitamins, and N-acetyl-l-cysteine in mitochondrial disease and dysfunction, folinic acid in cerebral folate abnormalities and early treatment with vigabatrin in tuberous sclerosis complex. Finally, there is limited evidence for a number of novel treatments, particularly magnesium with pyridoxine, omega-3 fatty acids, the gluten-free casein-free diet, and low-frequency repetitive transcranial magnetic simulation. Zinc and l-carnosine are potential novel treatments supported by basic research but not clinical studies. This review demonstrates the wide variety of treatments used to treat seizures in individuals with ASD as well as the striking lack of clinical trials performed to support the use of these treatments. Additional studies concerning these treatments for controlling seizures in individuals with ASD are warranted.

There is a growing body of scientific evidence that the health of the microbiome (the trillions of microbes that inhabit the human host) plays an important role in maintaining the health of the host and that disruptions in the microbiome may play a role in certain disease processes. An increasing number of research studies have provided evidence that the composition of the gut (enteric) microbiome (GM) in at least a subset of individuals with autism spectrum disorder (ASD) deviates from what is usually observed in typically developing individuals. There are several lines of research that suggest that specific changes in the GM could be causative or highly associated with driving core and associated ASD symptoms, pathology, and comorbidities which include gastrointestinal symptoms, although it is also a possibility that these changes, in whole or in part, could be a consequence of underlying pathophysiological features associated with ASD. However, if the GM truly plays a causative role in ASD, then the manipulation of the GM could potentially be leveraged as a therapeutic approach to improve ASD symptoms and/or comorbidities, including gastrointestinal symptoms.

One approach to investigating this possibility in greater detail includes a highly controlled clinical trial in which the GM is systematically manipulated to determine its significance in individuals with ASD. To outline the important issues that would be required to design such a study, a group of clinicians, research scientists, and parents of children with ASD participated in an interdisciplinary daylong workshop as an extension of the 1st International Symposium on the Microbiome in Health and Disease with a Special Focus on Autism (www.microbiome-autism.com). The group considered several aspects of designing clinical studies, including clinical trial design, treatments that could potentially be used in a clinical trial, appropriate ASD participants for the clinical trial, behavioral and cognitive assessments, important biomarkers, safety concerns, and ethical considerations. Overall, the group not only felt that this was a promising area of research for the ASD population and a promising avenue for potential treatment but also felt that further basic and translational research was needed to clarify the clinical utility of such treatments and to elucidate possible mechanisms responsible for a clinical response, so that new treatments and approaches may be discovered and/or fostered in the future.

Background: Despite the high prevalence of seizure, epilepsy and abnormal electroencephalograms in individuals with autism spectrum disorder (ASD), there is little information regarding the relative effectiveness of treatments for seizures in the ASD population. In order to determine the effectiveness of traditional and non-traditional treatments for improving seizures and influencing other clinical factor relevant to ASD, we developed a comprehensive on-line seizure survey.

Methods: Announcements (by email and websites) by ASD support groups asked parents of children with ASD to complete the on-line surveys. Survey responders choose one of two surveys to complete: a survey about treatments for individuals with ASD and clinical or subclinical seizures or abnormal electroencephalograms, or a control survey for individuals with ASD without clinical or subclinical seizures or abnormal electroencephalograms. Survey responders rated the perceived effect of traditional antiepileptic drug (AED), non-AED seizure treatments and non-traditional ASD treatments on seizures and other clinical factors (sleep, communication, behavior, attention and mood), and listed up to three treatment side effects.

Results: Responses were obtained concerning 733 children with seizures and 290 controls. In general, AEDs were perceived to improve seizures but worsened other clinical factors for children with clinical seizure. Valproic acid, lamotrigine, levetiracetam and ethosuximide were perceived to improve seizures the most and worsen other clinical factors the least out of all AEDs in children with clinical seizures. Traditional non-AED seizure and non-traditional treatments, as a group, were perceived to improve other clinical factors and seizures but the perceived improvement in seizures was significantly less than that reported for AEDs. Certain traditional non-AED treatments, particularly the ketogenic diet, were perceived to improve both seizures and other clinical factors. For ASD individuals with reported subclinical seizures, other clinical factors were reported to be worsened by AEDs and improved by non-AED traditional seizure and non-traditional treatments. The rate of side effects was reportedly higher for AEDs compared to traditional non-AED treatments.

Conclusion: Although this survey-based method only provides information regarding parental perceptions of effectiveness, this information may be helpful for selecting seizure treatments in individuals with ASD.

Background:
Drosophila gene expression pattern images document the spatiotemporal dynamics of gene expression during embryogenesis. A comparative analysis of these images could provide a fundamentally important way for studying the regulatory networks governing development. To facilitate pattern comparison and searching, groups of images in the Berkeley Drosophila Genome Project (BDGP) high-throughput study were annotated with a variable number of anatomical terms manually using a controlled vocabulary. Considering that the number of available images is rapidly increasing, it is imperative to design computational methods to automate this task.

Results:
We present a computational method to annotate gene expression pattern images automatically. The proposed method uses the bag-of-words scheme to utilize the existing information on pattern annotation and annotates images using a model that exploits correlations among terms. The proposed method can annotate images individually or in groups (e.g., according to the developmental stage). In addition, the proposed method can integrate information from different two-dimensional views of embryos. Results on embryonic patterns from BDGP data demonstrate that our method significantly outperforms other methods.

Conclusion:
The proposed bag-of-words scheme is effective in representing a set of annotations assigned to a group of images, and the model employed to annotate images successfully captures the correlations among different controlled vocabulary terms. The integration of existing annotation information from multiple embryonic views improves annotation performance.