Filtering by
- All Subjects: Computer Science
- All Subjects: Materials Science
- Genre: Academic theses
For each of these cases, I present a feasible image restoration pipeline to correct for their particular limitations. For the pinhole camera, I present an early pipeline to allow for practical pinhole photography by reducing noise levels caused by low-light imaging, enhancing exposure levels, and sharpening the blur caused by the pinhole. For lensless cameras, we explore a neural network architecture that performs joint image reconstruction and point spread function (PSF) estimation to robustly recover images captured with multiple PSFs from different cameras. Using adversarial learning, this approach achieves improved reconstruction results that do not require explicit knowledge of the PSF at test-time and shows an added improvement in the reconstruction model’s ability to generalize to variations in the camera’s PSF. This allows lensless cameras to be utilized in a wider range of applications that require multiple cameras without the need to explicitly train a separate model for each new camera. For UDCs, we utilize a multi-stage approach to correct for low light transmission, blur, and haze. This pipeline uses a PyNET deep neural network architecture to perform a majority of the restoration, while additionally using a traditional optimization approach which is then fused in a learned manner in the second stage to improve high-frequency features. I show results from this novel fusion approach that is on-par with the state of the art.
This dissertation focuses on “working with the data, not just on data”, i.e. leveraging feature saliency through pre-training, in-training, and post-training analysis of the data. In particular, non-neural localized multi-scale feature extraction, in images and time series, are relatively cheap to obtain and can provide a rough overview of the patterns in the data. Furthermore, localized features coupled with deep features can help learn a high performing network. A pre-training analysis of sizes, complexities, and distribution of these localized features can help intelligently allocate a user-provided kernel budget in the network as a single-shot hyper-parameter search. Additionally, these localized features can be used as a secondary input modality to the network for cross-attention. Retraining pre-trained networks can be a costly process, yet, a post-training analysis of model inferences can allow for learning the importance of individual network parameters to the model inferences thus facilitating a retraining-free network sparsification with minimal impact on the model performance. Furthermore, effective in-training analysis of the intermediate features in the network help learn the importance of individual intermediate features (neural attention) and this analysis can be achieved through simulating local-extrema detection or learning features simultaneously and understanding their co-occurrences. In summary, this dissertation argues and establishes that, if appropriately leveraged, localized features and their feature saliency can help learn high-accurate, yet cheaper networks.
In highly hydrogenated IO:H, ne significantly decreased as temperature increased from 5 K to 140 K. To probe this unusual behavior, samples were illuminated, then ne, surface work function (WF), and spatially resolved microscopic current mapping were measured and tracked. Large increases in ne and corresponding decreases in WF were observed---these both exhibited slow reversions toward pre-illumination values over 6-12 days. A hydrogen-related defect was proposed as source of the photoexcitation, while a lattice defect diffusion mechanism causes the extended decay. Both arise from an under-coordination of the In.
An enhancement of μe was observed with increasing amorphous fraction in IO:H. An increase in population of corner- and edge-sharing polyhedra consisting of metal cations and oxygen anions is thought to be the origin. This indicates some measure of medium-range order in the amorphous structure, and gives rise to a general principle dictating μe in TCOs---even amorphous TCOs. Testing this principle resulted in observing an enhancement of μe up to 35 cm^2/Vs in amorphous ZTO (a-ZTO), one of the highest reported a-ZTO μe values (at ne > 10^19 cm^-3) to date. These results highlight the role of local distortions and cation coordination in determining the microscopic origins of carrier generation and transport. In addition, the strong likelihood of under-coordination of one cation species leading to high carrier concentrations is proposed. This diverges from the historical indictment of oxygen vacancies controlling carrier population in crystalline oxides, which by definition cannot occur in amorphous systems, and provides a framework to discuss key structural descriptors in these disordered phase materials.
In this dissertation, a novel framework is introduced for the development of anticipatory devices that augment the proprioceptive system in individuals with neurodegenerative disorders in a seamless way that scaffolds off of existing cognitive feedback models. The framework suggests three main categories of consideration in the development of devices which are anticipatory and invisible:
• Idiosyncratic Design: How do can a design encapsulate the unique characteristics of the individual in the design of assistive aids?
• Adaptation to Intrapersonal Variations: As individuals progress through the various stages of a disability
eurological disorder, how can the technology adapt thresholds for feedback over time to address these shifts in ability?
• Context Aware Invisibility: How can the mechanisms of interaction be modified in order to reduce cognitive load?
The concepts proposed in this framework can be generalized to a broad range of domains; however, there are two primary applications for this work: rehabilitation and assistive aids. In preliminary studies, the framework is applied in the areas of Parkinsonian freezing of gait anticipation and the anticipation of body non-compliance during rehabilitative exercise.
Bio-modification of asphalt binder brings significant benefits in terms of increasing sustainable and environmental practices, stabilizing prices, and decreasing costs. However, bio-modified asphalt binders have shown varying performance regarding susceptibility to moisture damage; some bio-oil modifiers significantly increase asphalt binder's susceptibility to moisture damage. This variability in performance is largely due to the large number of bio-masses available for use as sources of bio-oil, as well as the type of processing procedure followed in converting the bio-mass into a bio-oil for modifying asphalt binder. Therefore, there is a need for a method of properly evaluating the potential impact of a bio-oil modifier for asphalt binder on the overall performance of asphalt pavement, in order to properly distinguish whether a particular bio-oil modifier increases or decreases the moisture susceptibility of asphalt binder. Therefore, the goal of this study is a multi-scale investigation of bio-oils with known chemical compositions to determine if there is a correlation between a fundamental property of a bio-oil and the resulting increase or decrease in moisture susceptibility of a binder when it is modified with the bio-oil. For instance, it was found that polarizability of asphalt constituents can be a promising indicator of moisture susceptibility of bitumen. This study will also evaluate the linkage of the fundamental property to newly developed binder-level test methods. It was found that moisture-induced shear thinning of bitumen containing glass beads can differentiate moisture susceptible bitumen samples. Based on the knowledge determined, alternative methods of reducing the moisture susceptibility of asphalt pavement will also be evaluated. It was shown that accumulation of acidic compounds at the interface of bitumen and aggregate could promote moisture damage. It was further found that detracting acidic compounds from the interface could be done by either of neutralizing active site of stone aggregate to reduce affinity for acids or by arresting acidic compounds using active mineral filler. The study results showed there is a strong relation between composition of bitumen and its susceptibility to moisture. This in turn emphasize the importance of integrating knowledge of surface chemistry and bitumen composition into the pavement design and evaluation.
While probabilistic ranking functions, such as the Okapi BM25 function, have been utilized in IR systems since the 1970's, modern neural approaches pose certain advantages compared to their classical counterparts. In particular, the release of BERT (Bidirectional Encoder Representations from Transformers) has had a significant impact in the NLP community by demonstrating how the use of a Masked Language Model (MLM) trained on a considerable corpus of data can improve a variety of downstream NLP tasks, including sentence classification and passage re-ranking.
IR Systems are also important in the biomedical and clinical domains. Given the continuously-increasing amount of scientific literature across biomedical domain, the ability find answers to specific clinical queries from a repository of millions of articles is a matter of practical value to medics, doctors, and other medical professionals. Moreover, there are domain-specific challenges present in the biomedical domain, including handling clinical jargon and evaluating the similarity or relatedness of various medical symptoms when determining the relevance between a query and a sentence.
This work presents contributions to several aspects of the Biomedical Semantic Information Retrieval domain. First, it introduces Multi-Perspective Sentence Relevance, a novel methodology of utilizing BERT-based models for contextual IR. The system is evaluated using the BioASQ Biomedical IR Challenge. Finally, practical contributions in the form of a live IR system for medics and a proposed challenge on the Living Systematic Review clinical task are provided.