Filtering by
- Language: English
etc. Given a low resolution image, it aims to reconstruct a high resolution
image. The problem is ill-posed since there can be more than one high resolution
image corresponding to the same low-resolution image. To address this problem, a
number of machine learning-based approaches have been proposed.
In this dissertation, I present my works on single image super-resolution (SISR)
and accelerated magnetic resonance imaging (MRI) (a.k.a. super-resolution on MR
images), followed by the investigation on transfer learning for accelerated MRI reconstruction.
For the SISR, a dictionary-based approach and two reconstruction based
approaches are presented. To be precise, a convex dictionary learning (CDL)
algorithm is proposed by constraining the dictionary atoms to be formed by nonnegative
linear combination of the training data, which is a natural, desired property.
Also, two reconstruction-based single methods are presented, which make use
of (i)the joint regularization, where a group-residual-based regularization (GRR) and
a ridge-regression-based regularization (3R) are combined; (ii)the collaborative representation
and non-local self-similarity. After that, two deep learning approaches
are proposed, aiming at reconstructing high-quality images from accelerated MRI
acquisition. Residual Dense Block (RDB) and feedback connection are introduced
in the proposed models. In the last chapter, the feasibility of transfer learning for
accelerated MRI reconstruction is discussed.
To overcome the above data scarcity and generalization issues, in my dissertation, I first propose two unsupervised conventional machine learning algorithms, hyperbolic stochastic coding, and multi-resemble multi-target low-rank coding, to solve the incomplete data and missing label problem. I further introduce a deep multi-domain adaptation network to leverage the power of deep learning by transferring the rich knowledge from a large-amount labeled source dataset. I also invent a novel time-sequence dynamically hierarchical network that adaptively simplifies the network to cope with the scarce data.
To learn a large number of unseen concepts, lifelong machine learning enjoys many advantages, including abstracting knowledge from prior learning and using the experience to help future learning, regardless of how much data is currently available. Incorporating this capability and making it versatile, I propose deep multi-task weight consolidation to accumulate knowledge continuously and significantly reduce data requirements in a variety of domains. Inspired by the recent breakthroughs in automatically learning suitable neural network architectures (AutoML), I develop a nonexpansive AutoML framework to train an online model without the abundance of labeled data. This work automatically expands the network to increase model capability when necessary, then compresses the model to maintain the model efficiency.
In my current ongoing work, I propose an alternative method of supervised learning that does not require direct labels. This could utilize various supervision from an image/object as a target value for supervising the target tasks without labels, and it turns out to be surprisingly effective. The proposed method only requires few-shot labeled data to train, and can self-supervised learn the information it needs and generalize to datasets not seen during training.
The apolipoprotein E (APOE) e4 allele is the most prevalent genetic risk factor for Alzheimer's disease (AD). Hippocampal volumes are generally smaller in AD patients carrying the e4 allele compared to e4 noncarriers. Here we examined the effect of APOE e4 on hippocampal morphometry in a large imaging database—the Alzheimer's Disease Neuroimaging Initiative (ADNI). We automatically segmented and constructed hippocampal surfaces from the baseline MR images of 725 subjects with known APOE genotype information including 167 with AD, 354 with mild cognitive impairment (MCI), and 204 normal controls. High-order correspondences between hippocampal surfaces were enforced across subjects with a novel inverse consistent surface fluid registration method. Multivariate statistics consisting of multivariate tensor-based morphometry (mTBM) and radial distance were computed for surface deformation analysis. Using Hotelling's T2 test, we found significant morphological deformation in APOE e4 carriers relative to noncarriers in the entire cohort as well as in the nondemented (pooled MCI and control) subjects, affecting the left hippocampus more than the right, and this effect was more pronounced in e4 homozygotes than heterozygotes. Our findings are consistent with previous studies that showed e4 carriers exhibit accelerated hippocampal atrophy; we extend these findings to a novel measure of hippocampal morphometry. Hippocampal morphometry has significant potential as an imaging biomarker of early stage AD.
Mild Cognitive Impairment (MCI) is a transitional stage between normal aging and dementia and people with MCI are at high risk of progression to dementia. MCI is attracting increasing attention, as it offers an opportunity to target the disease process during an early symptomatic stage. Structural magnetic resonance imaging (MRI) measures have been the mainstay of Alzheimer's disease (AD) imaging research, however, ventricular morphometry analysis remains challenging because of its complicated topological structure. Here we describe a novel ventricular morphometry system based on the hyperbolic Ricci flow method and tensor-based morphometry (TBM) statistics. Unlike prior ventricular surface parameterization methods, hyperbolic conformal parameterization is angle-preserving and does not have any singularities. Our system generates a one-to-one diffeomorphic mapping between ventricular surfaces with consistent boundary matching conditions. The TBM statistics encode a great deal of surface deformation information that could be inaccessible or overlooked by other methods. We applied our system to the baseline MRI scans of a set of MCI subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI: 71 MCI converters vs. 62 MCI stable). Although the combined ventricular area and volume features did not differ between the two groups, our fine-grained surface analysis revealed significant differences in the ventricular regions close to the temporal lobe and posterior cingulate, structures that are affected early in AD. Significant correlations were also detected between ventricular morphometry, neuropsychological measures, and a previously described imaging index based on fluorodeoxyglucose positron emission tomography (FDG-PET) scans. This novel ventricular morphometry method may offer a new and more sensitive approach to study preclinical and early symptomatic stage AD.
Introduction: The ketogenic diet (KD) is a high-fat, low-carbohydrate diet that alters metabolism by increasing the level of ketone bodies in the blood. KetoCal® (KC) is a nutritionally complete, commercially available 4∶1 (fat∶ carbohydrate+protein) ketogenic formula that is an effective non-pharmacologic treatment for the management of refractory pediatric epilepsy. Diet-induced ketosis causes changes to brain homeostasis that have potential for the treatment of other neurological diseases such as malignant gliomas.
Methods: We used an intracranial bioluminescent mouse model of malignant glioma. Following implantation animals were maintained on standard diet (SD) or KC. The mice received 2×4 Gy of whole brain radiation and tumor growth was followed by in vivo imaging.
Results: Animals fed KC had elevated levels of β-hydroxybutyrate (p = 0.0173) and an increased median survival of approximately 5 days relative to animals maintained on SD. KC plus radiation treatment were more than additive, and in 9 of 11 irradiated animals maintained on KC the bioluminescent signal from the tumor cells diminished below the level of detection (p<0.0001). Animals were switched to SD 101 days after implantation and no signs of tumor recurrence were seen for over 200 days.
Conclusions: KC significantly enhances the anti-tumor effect of radiation. This suggests that cellular metabolic alterations induced through KC may be useful as an adjuvant to the current standard of care for the treatment of human malignant gliomas.
Background: The successful treatment of malignant gliomas remains a challenge despite the current standard of care, which consists of surgery, radiation and temozolomide. Advances in the survival of brain cancer patients require the design of new therapeutic approaches that take advantage of common phenotypes such as the altered metabolism found in cancer cells. It has therefore been postulated that the high-fat, low-carbohydrate, adequate protein ketogenic diet (KD) may be useful in the treatment of brain tumors. We have demonstrated that the KD enhances survival and potentiates standard therapy in a mouse model of malignant glioma, yet the mechanisms are not fully understood.
Methods: To explore the effects of the KD on various aspects of tumor growth and progression, we used the immunocompetent, syngeneic GL261-Luc2 mouse model of malignant glioma.
Results: Tumors from animals maintained on KD showed reduced expression of the hypoxia marker carbonic anhydrase 9, hypoxia inducible factor 1-alpha, and decreased activation of nuclear factor kappa B. Additionally, tumors from animals maintained on KD had reduced tumor microvasculature and decreased expression of vascular endothelial growth factor receptor 2, matrix metalloproteinase-2 and vimentin. Peritumoral edema was significantly reduced in animals fed the KD and protein analyses showed altered expression of zona occludens-1 and aquaporin-4.
Conclusions: The KD directly or indirectly alters the expression of several proteins involved in malignant progression and may be a useful tool for the treatment of gliomas.
The apolipoprotein E (APOE) e4 genotype is a powerful risk factor for late-onset Alzheimer’s disease (AD). In the Alzheimer’s Disease Neuroimaging Initiative (ADNI) cohort, we previously reported significant baseline structural differences in APOE e4 carriers relative to non-carriers, involving the left hippocampus more than the right—a difference more pronounced in e4 homozygotes than heterozygotes. We now examine the longitudinal effects of APOE genotype on hippocampal morphometry at 6-, 12- and 24-months, in the ADNI cohort. We employed a new automated surface registration system based on conformal geometry and tensor-based morphometry. Among different hippocampal surfaces, we computed high-order correspondences, using a novel inverse-consistent surface-based fluid registration method and multivariate statistics consisting of multivariate tensor-based morphometry (mTBM) and radial distance. At each time point, using Hotelling’s T2 test, we found significant morphological deformation in APOE e4 carriers relative to non-carriers in the full cohort as well as in the non-demented (pooled MCI and control) subjects at each follow-up interval. In the complete ADNI cohort, we found greater atrophy of the left hippocampus than the right, and this asymmetry was more pronounced in e4 homozygotes than heterozygotes. These findings, combined with our earlier investigations, demonstrate an e4 dose effect on accelerated hippocampal atrophy, and support the enrichment of prevention trial cohorts with e4 carriers.
Background: Malignant brain tumors affect people of all ages and are the second leading cause of cancer deaths in children. While current treatments are effective and improve survival, there remains a substantial need for more efficacious therapeutic modalities. The ketogenic diet (KD) - a high-fat, low-carbohydrate treatment for medically refractory epilepsy - has been suggested as an alternative strategy to inhibit tumor growth by altering intrinsic metabolism, especially by inducing glycopenia.
Methods: Here, we examined the effects of an experimental KD on a mouse model of glioma, and compared patterns of gene expression in tumors vs. normal brain from animals fed either a KD or a standard diet.
Results: Animals received intracranial injections of bioluminescent GL261-luc cells and tumor growth was followed in vivo. KD treatment significantly reduced the rate of tumor growth and prolonged survival. Further, the KD reduced reactive oxygen species (ROS) production in tumor cells. Gene expression profiling demonstrated that the KD induces an overall reversion to expression patterns seen in non-tumor specimens. Notably, genes involved in modulating ROS levels and oxidative stress were altered, including those encoding cyclooxygenase 2, glutathione peroxidases 3 and 7, and periredoxin 4.
Conclusions: Our data demonstrate that the KD improves survivability in our mouse model of glioma, and suggests that the mechanisms accounting for this protective effect likely involve complex alterations in cellular metabolism beyond simply a reduction in glucose.
The sensitivity of Earth’s wetlands to observed shifts in global precipitation and temperature patterns and their ability to produce large quantities of methane gas are key global change questions. We present a microwave satellite-based approach for mapping fractional surface water (FW) globally at 25-km resolution. The approach employs a land cover-supported, atmospherically-corrected dynamic mixture model applied to 20+ years (1992–2013) of combined, daily, passive/active microwave remote sensing data. The resulting product, known as Surface Water Microwave Product Series (SWAMPS), shows strong microwave sensitivity to sub-grid scale open water and inundated wetlands comprising open plant canopies. SWAMPS’ FW compares favorably (R2 = 91%–94%) with higher-resolution, global-scale maps of open water from MODIS and SRTM-MOD44W. Correspondence of SWAMPS with open water and wetland products from satellite SAR in Alaska and the Amazon deteriorates when exposed wetlands or inundated forests captured by the SAR products were added to the open water fraction reflecting SWAMPS’ inability to detect water underneath the soil surface or beneath closed forest canopies. Except for a brief period of drying during the first 4 years of observation, the inundation extent for the global domain excluding the coast was largely stable. Regionally, inundation in North America is advancing while inundation is on the retreat in Tropical Africa and North Eurasia. SWAMPS provides a consistent and long-term global record of daily FW dynamics, with documented accuracies suitable for hydrologic assessment and global change-related investigations.
A warming climate is altering land-atmosphere exchanges of carbon, with a potential for increased vegetation productivity as well as the mobilization of permafrost soil carbon stores. Here we investigate land-atmosphere carbon dioxide (CO2) cycling through analysis of net ecosystem productivity (NEP) and its component fluxes of gross primary productivity (GPP) and ecosystem respiration (ER) and soil carbon residence time, simulated by a set of land surface models (LSMs) over a region spanning the drainage basin of Northern Eurasia. The retrospective simulations cover the period 1960–2009 at 0.5° resolution, which is a scale common among many global carbon and climate model simulations. Model performance benchmarks were drawn from comparisons against both observed CO2 fluxes derived from site-based eddy covariance measurements as well as regional-scale GPP estimates based on satellite remote-sensing data.
The site-based comparisons depict a tendency for overestimates in GPP and ER for several of the models, particularly at the two sites to the south. For several models the spatial pattern in GPP explains less than half the variance in the MODIS MOD17 GPP product. Across the models NEP increases by as little as 0.01 to as much as 0.79 g C m-2 yr-2, equivalent to 3 to 340 % of the respective model means, over the analysis period. For the multimodel average the increase is 135 % of the mean from the first to last 10 years of record (1960–1969 vs. 2000–2009), with a weakening CO2 sink over the latter decades. Vegetation net primary productivity increased by 8 to 30 % from the first to last 10 years, contributing to soil carbon storage gains. The range in regional mean NEP among the group is twice the multimodel mean, indicative of the uncertainty in CO2 sink strength.
The models simulate that inputs to the soil carbon pool exceeded losses, resulting in a net soil carbon gain amid a decrease in residence time. Our analysis points to improvements in model elements controlling vegetation productivity and soil respiration as being needed for reducing uncertainty in land-atmosphere CO2 exchange. These advances will require collection of new field data on vegetation and soil dynamics, the development of benchmarking data sets from measurements and remote-sensing observations, and investments in future model development and intercomparison studies.