Matching Items (12)
Filtering by
- Genre: Doctoral Dissertation
Description
Random Forests is a statistical learning method which has been proposed for propensity score estimation models that involve complex interactions, nonlinear relationships, or both of the covariates. In this dissertation I conducted a simulation study to examine the effects of three Random Forests model specifications in propensity score analysis. The results suggested that, depending on the nature of data, optimal specification of (1) decision rules to select the covariate and its split value in a Classification Tree, (2) the number of covariates randomly sampled for selection, and (3) methods of estimating Random Forests propensity scores could potentially produce an unbiased average treatment effect estimate after propensity scores weighting by the odds adjustment. Compared to the logistic regression estimation model using the true propensity score model, Random Forests had an additional advantage in producing unbiased estimated standard error and correct statistical inference of the average treatment effect. The relationship between the balance on the covariates' means and the bias of average treatment effect estimate was examined both within and between conditions of the simulation. Within conditions, across repeated samples there was no noticeable correlation between the covariates' mean differences and the magnitude of bias of average treatment effect estimate for the covariates that were imbalanced before adjustment. Between conditions, small mean differences of covariates after propensity score adjustment were not sensitive enough to identify the optimal Random Forests model specification for propensity score analysis.
ContributorsCham, Hei Ning (Author) / Tein, Jenn-Yun (Thesis advisor) / Enders, Stephen G (Thesis advisor) / Enders, Craig K. (Committee member) / Mackinnon, David P (Committee member) / Arizona State University (Publisher)
Created2013
Description
Type 1 Diabetes Mellitus (T1DM) is a chronic disease that requires maintaining tight metabolic control through complex behavioral and pharmaceutical regimens. Subtle cognitive impairments and stress response dysregulation may partially account for problems negotiating life changes and maintaining treatment adherence among emerging adults. The current study examined whether young adults with T1DM physiologically respond to psychological stress in a dysregulated manner compared to non-diabetic peers, and if such individuals also demonstrated greater cognitive declines following psychological stress. Participants included 23 young adults with T1DM and 52 non-diabetic controls yoked to T1DM participants based on age, gender, ethnicity, participant education, and maternal education. Participants completed a laboratory-based social stressor, pre- and post-stressor neurocognitive testing, provided fingerstick blood spots (for glucose levels) and salivary samples (for cortisol levels) at five points across the protocol, and completed psychosocial questionnaires. Related measures ANOVAs were conducted to assess differences between T1DM participants and the average of yoked controls on cortisol and cognitive outcomes. Results demonstrated that differences in cortisol reactivity were dependent on T1DM participants' use of insulin pump therapy (IPT). T1DM participants not using IPT demonstrated elevated cortisol reactivity compared to matched controls. There was no difference in cortisol reactivity between the T1DM participants on IPT and matched controls. On the Stroop task, performance patterns did not differ between participants with T1DM not on IPT and matched controls. The performance of participants with T1DM on IPT slightly improved following the stressor and matched controls slightly worsened. On the Trail Making Test, the performance of participants with T1DM was not different following the stressor whereas participants without T1DM demonstrated a decline following the stressor. Participants with and without T1DM did not differ in patterns of performance on the Rey Verbal Learning Task, Sustained Attention Allocation Task, Controlled Oral Word Association Task, or overall cortisol output across participation. The results of this study are suggestive of an exaggerated cortisol response to psychological stress in T1DM and indicate potential direct and indirect protective influences of IPT.
ContributorsMarreiro, Catherine (Author) / Luecken, Linda (Thesis advisor) / Doane, Leah (Thesis advisor) / Barrera, Manuel (Committee member) / Aiken, Leona (Committee member) / Arizona State University (Publisher)
Created2013
Description
Research demonstrating the importance of the paternal role has been largely conducted using samples of Caucasian men, leaving a gap in what is known about fathering in minority cultures. Family systems theories highlight the dynamic interrelations between familial roles and relationships, and suggest that comprehensive studies of fathering require attention to the broad family and cultural context. During the early infancy period, mothers' and fathers' postpartum adjustment may represent a critical source of influence on father involvement. For the current study, Mexican American (MA) women (N = 125) and a subset of their romantic partners/biological fathers (N = 57) reported on their depressive symptoms and levels of father involvement (paternal engagement, accessibility, and responsibility) during the postpartum period. Descriptive analyses suggested that fathers are involved in meaningful levels of care during infancy. Greater paternal postpartum depression (PPD) was associated with lower levels of father involvement. Maternal PPD interacted with paternal gender role attitudes to predict father involvement. At higher levels of maternal PPD, involvement increased among fathers adhering to less segregated gender role attitudes and decreased among fathers who endorsed more segregated gender role attitudes. Within select models, differences in the relations were observed between mothers' and fathers' reports of paternal involvement. Results bring attention to the importance of examining contextual influences on early fathering in MA families and highlight the unique information that may be gathered from separate maternal and paternal reports of father involvement.
ContributorsRoubinov, Danielle S (Author) / Luecken, Linda J. (Thesis advisor) / Crnic, Keith A (Committee member) / Enders, Craig K. (Committee member) / Gonzales, Nancy A. (Committee member) / Arizona State University (Publisher)
Created2014
Description
Missing data are common in psychology research and can lead to bias and reduced power if not properly handled. Multiple imputation is a state-of-the-art missing data method recommended by methodologists. Multiple imputation methods can generally be divided into two broad categories: joint model (JM) imputation and fully conditional specification (FCS) imputation. JM draws missing values simultaneously for all incomplete variables using a multivariate distribution (e.g., multivariate normal). FCS, on the other hand, imputes variables one at a time, drawing missing values from a series of univariate distributions. In the single-level context, these two approaches have been shown to be equivalent with multivariate normal data. However, less is known about the similarities and differences of these two approaches with multilevel data, and the methodological literature provides no insight into the situations under which the approaches would produce identical results. This document examined five multilevel multiple imputation approaches (three JM methods and two FCS methods) that have been proposed in the literature. An analytic section shows that only two of the methods (one JM method and one FCS method) used imputation models equivalent to a two-level joint population model that contained random intercepts and different associations across levels. The other three methods employed imputation models that differed from the population model primarily in their ability to preserve distinct level-1 and level-2 covariances. I verified the analytic work with computer simulations, and the simulation results also showed that imputation models that failed to preserve level-specific covariances produced biased estimates. The studies also highlighted conditions that exacerbated the amount of bias produced (e.g., bias was greater for conditions with small cluster sizes). The analytic work and simulations lead to a number of practical recommendations for researchers.
ContributorsMistler, Stephen (Author) / Enders, Craig K. (Thesis advisor) / Aiken, Leona (Committee member) / Levy, Roy (Committee member) / West, Stephen G. (Committee member) / Arizona State University (Publisher)
Created2015
Description
Although the issue of factorial invariance has received increasing attention in the literature, the focus is typically on differences in factor structure across groups that are directly observed, such as those denoted by sex or ethnicity. While establishing factorial invariance across observed groups is a requisite step in making meaningful cross-group comparisons, failure to attend to possible sources of latent class heterogeneity in the form of class-based differences in factor structure has the potential to compromise conclusions with respect to observed groups and may result in misguided attempts at instrument development and theory refinement. The present studies examined the sensitivity of two widely used confirmatory factor analytic model fit indices, the chi-square test of model fit and RMSEA, to latent class differences in factor structure. Two primary questions were addressed. The first of these concerned the impact of latent class differences in factor loadings with respect to model fit in a single sample reflecting a mixture of classes. The second question concerned the impact of latent class differences in configural structure on tests of factorial invariance across observed groups. The results suggest that both indices are highly insensitive to class-based differences in factor loadings. Across sample size conditions, models with medium (0.2) sized loading differences were rejected by the chi-square test of model fit at rates just slightly higher than the nominal .05 rate of rejection that would be expected under a true null hypothesis. While rates of rejection increased somewhat when the magnitude of loading difference increased, even the largest sample size with equal class representation and the most extreme violations of loading invariance only had rejection rates of approximately 60%. RMSEA was also insensitive to class-based differences in factor loadings, with mean values across conditions suggesting a degree of fit that would generally be regarded as exceptionally good in practice. In contrast, both indices were sensitive to class-based differences in configural structure in the context of a multiple group analysis in which each observed group was a mixture of classes. However, preliminary evidence suggests that this sensitivity may contingent on the form of the cross-group model misspecification.
ContributorsBlackwell, Kimberly Carol (Author) / Millsap, Roger E (Thesis advisor) / Aiken, Leona S. (Committee member) / Enders, Craig K. (Committee member) / Mackinnon, David P (Committee member) / Arizona State University (Publisher)
Created2011
Description
Designing studies that use latent growth modeling to investigate change over time calls for optimal approaches for conducting power analysis for a priori determination of required sample size. This investigation (1) studied the impacts of variations in specified parameters, design features, and model misspecification in simulation-based power analyses and (2) compared power estimates across three common power analysis techniques: the Monte Carlo method; the Satorra-Saris method; and the method developed by MacCallum, Browne, and Cai (MBC). Choice of sample size, effect size, and slope variance parameters markedly influenced power estimates; however, level-1 error variance and number of repeated measures (3 vs. 6) when study length was held constant had little impact on resulting power. Under some conditions, having a moderate versus small effect size or using a sample size of 800 versus 200 increased power by approximately .40, and a slope variance of 10 versus 20 increased power by up to .24. Decreasing error variance from 100 to 50, however, increased power by no more than .09 and increasing measurement occasions from 3 to 6 increased power by no more than .04. Misspecification in level-1 error structure had little influence on power, whereas misspecifying the form of the growth model as linear rather than quadratic dramatically reduced power for detecting differences in slopes. Additionally, power estimates based on the Monte Carlo and Satorra-Saris techniques never differed by more than .03, even with small sample sizes, whereas power estimates for the MBC technique appeared quite discrepant from the other two techniques. Results suggest the choice between using the Satorra-Saris or Monte Carlo technique in a priori power analyses for slope differences in latent growth models is a matter of preference, although features such as missing data can only be considered within the Monte Carlo approach. Further, researchers conducting power analyses for slope differences in latent growth models should pay greatest attention to estimating slope difference, slope variance, and sample size. Arguments are also made for examining model-implied covariance matrices based on estimated parameters and graphic depictions of slope variance to help ensure parameter estimates are reasonable in a priori power analysis.
ContributorsVan Vleet, Bethany Lucía (Author) / Thompson, Marilyn S. (Thesis advisor) / Green, Samuel B. (Committee member) / Enders, Craig K. (Committee member) / Arizona State University (Publisher)
Created2011
Description
Family plays an important yet understudied role in the development of psychopathology during childhood, particularly for children at developmental risk. Indeed, much of the research on families has actually concentrated more on risk processes in individual family members or within-family subsystems. In general, important and complex associations have been found among family-related constructs such as marital conflict, parent-child relationships, parental depression, and parenting stress, which have in turn been found to contribute to the emergence of children's behavioral problems. Research has begun to emerge that certain family system constructs, such as cohesion, organization, and control may influence children's development, but this research has been limited by a focus on parent-reports of family functioning, rather than utilizing observational methods. With notable exceptions, there is almost no observational research examining families of children at developmental risk. This study examined the longitudinal relations among family risk and family system constructs, as well as how family systems constructs mediated the relations between family risk and child outcome. Further, the study examined how developmental risk moderated these relations. The sample followed 242 families of children with and without developmental risk across the transition-to-school period. Family risk factors were assessed at 5 years, using parental reports of symptomatology, parenting stress, and marital adjustment, and observational assessments of the parent-child relationship. Family system constructs (cohesion, warmth, conflict, organization, control) were measured at age 6 using structured observations of the entire family playing a board game. Child behavior problems and social competence were assessed at age 7. Results indicated that families of children with developmental delays did not differ from families of typically developing children on the majority of family system attributes. Cohesion and organization mediated the relations between specific family risk factors and social competence for all families. For families of typically developing children only, higher levels of control were associated with more behavior problems and less social competence. These findings underscore the importance of family-level assessment in understanding the development of psychopathology. Important family effects on children's social competence were found, although the pathways among family risk and family systems attributes are complex.
ContributorsGerstein, Emily Davis (Author) / Crnic, Keith A (Thesis advisor) / Aiken, Leona (Committee member) / Bradley, Robert (Committee member) / Gonzales, Nancy (Committee member) / Arizona State University (Publisher)
Created2012
Description
This dissertation examines a planned missing data design in the context of mediational analysis. The study considered a scenario in which the high cost of an expensive mediator limited sample size, but in which less expensive mediators could be gathered on a larger sample size. Simulated multivariate normal data were generated from a latent variable mediation model with three observed indicator variables, M1, M2, and M3. Planned missingness was implemented on M1 under the missing completely at random mechanism. Five analysis methods were employed: latent variable mediation model with all three mediators as indicators of a latent construct (Method 1), auxiliary variable model with M1 as the mediator and M2 and M3 as auxiliary variables (Method 2), auxiliary variable model with M1 as the mediator and M2 as a single auxiliary variable (Method 3), maximum likelihood estimation including all available data but incorporating only mediator M1 (Method 4), and listwise deletion (Method 5).
The main outcome of interest was empirical power to detect the mediated effect. The main effects of mediation effect size, sample size, and missing data rate performed as expected with power increasing for increasing mediation effect sizes, increasing sample sizes, and decreasing missing data rates. Consistent with expectations, power was the greatest for analysis methods that included all three mediators, and power decreased with analysis methods that included less information. Across all design cells relative to the complete data condition, Method 1 with 20% missingness on M1 produced only 2.06% loss in power for the mediated effect; with 50% missingness, 6.02% loss; and 80% missingess, only 11.86% loss. Method 2 exhibited 20.72% power loss at 80% missingness, even though the total amount of data utilized was the same as Method 1. Methods 3 – 5 exhibited greater power loss. Compared to an average power loss of 11.55% across all levels of missingness for Method 1, average power losses for Methods 3, 4, and 5 were 23.87%, 29.35%, and 32.40%, respectively. In conclusion, planned missingness in a multiple mediator design may permit higher quality characterization of the mediator construct at feasible cost.
The main outcome of interest was empirical power to detect the mediated effect. The main effects of mediation effect size, sample size, and missing data rate performed as expected with power increasing for increasing mediation effect sizes, increasing sample sizes, and decreasing missing data rates. Consistent with expectations, power was the greatest for analysis methods that included all three mediators, and power decreased with analysis methods that included less information. Across all design cells relative to the complete data condition, Method 1 with 20% missingness on M1 produced only 2.06% loss in power for the mediated effect; with 50% missingness, 6.02% loss; and 80% missingess, only 11.86% loss. Method 2 exhibited 20.72% power loss at 80% missingness, even though the total amount of data utilized was the same as Method 1. Methods 3 – 5 exhibited greater power loss. Compared to an average power loss of 11.55% across all levels of missingness for Method 1, average power losses for Methods 3, 4, and 5 were 23.87%, 29.35%, and 32.40%, respectively. In conclusion, planned missingness in a multiple mediator design may permit higher quality characterization of the mediator construct at feasible cost.
ContributorsBaraldi, Amanda N (Author) / Enders, Craig K. (Thesis advisor) / Mackinnon, David P (Thesis advisor) / Aiken, Leona S. (Committee member) / Tein, Jenn-Yun (Committee member) / Arizona State University (Publisher)
Created2015
Description
Accurate data analysis and interpretation of results may be influenced by many potential factors. The factors of interest in the current work are the chosen analysis model(s), the presence of missing data, and the type(s) of data collected. If analysis models are used which a) do not accurately capture the structure of relationships in the data such as clustered/hierarchical data, b) do not allow or control for missing values present in the data, or c) do not accurately compensate for different data types such as categorical data, then the assumptions associated with the model have not been met and the results of the analysis may be inaccurate. In the presence of clustered
ested data, hierarchical linear modeling or multilevel modeling (MLM; Raudenbush & Bryk, 2002) has the ability to predict outcomes for each level of analysis and across multiple levels (accounting for relationships between levels) providing a significant advantage over single-level analyses. When multilevel data contain missingness, multilevel multiple imputation (MLMI) techniques may be used to model both the missingness and the clustered nature of the data. With categorical multilevel data with missingness, categorical MLMI must be used. Two such routines for MLMI with continuous and categorical data were explored with missing at random (MAR) data: a formal Bayesian imputation and analysis routine in JAGS (R/JAGS) and a common MLM procedure of imputation via Bayesian estimation in BLImP with frequentist analysis of the multilevel model in Mplus (BLImP/Mplus). Manipulated variables included interclass correlations, number of clusters, and the rate of missingness. Results showed that with continuous data, R/JAGS returned more accurate parameter estimates than BLImP/Mplus for almost all parameters of interest across levels of the manipulated variables. Both R/JAGS and BLImP/Mplus encountered convergence issues and returned inaccurate parameter estimates when imputing and analyzing dichotomous data. Follow-up studies showed that JAGS and BLImP returned similar imputed datasets but the choice of analysis software for MLM impacted the recovery of accurate parameter estimates. Implications of these findings and recommendations for further research will be discussed.
ested data, hierarchical linear modeling or multilevel modeling (MLM; Raudenbush & Bryk, 2002) has the ability to predict outcomes for each level of analysis and across multiple levels (accounting for relationships between levels) providing a significant advantage over single-level analyses. When multilevel data contain missingness, multilevel multiple imputation (MLMI) techniques may be used to model both the missingness and the clustered nature of the data. With categorical multilevel data with missingness, categorical MLMI must be used. Two such routines for MLMI with continuous and categorical data were explored with missing at random (MAR) data: a formal Bayesian imputation and analysis routine in JAGS (R/JAGS) and a common MLM procedure of imputation via Bayesian estimation in BLImP with frequentist analysis of the multilevel model in Mplus (BLImP/Mplus). Manipulated variables included interclass correlations, number of clusters, and the rate of missingness. Results showed that with continuous data, R/JAGS returned more accurate parameter estimates than BLImP/Mplus for almost all parameters of interest across levels of the manipulated variables. Both R/JAGS and BLImP/Mplus encountered convergence issues and returned inaccurate parameter estimates when imputing and analyzing dichotomous data. Follow-up studies showed that JAGS and BLImP returned similar imputed datasets but the choice of analysis software for MLM impacted the recovery of accurate parameter estimates. Implications of these findings and recommendations for further research will be discussed.
ContributorsKunze, Katie L (Author) / Levy, Roy (Thesis advisor) / Enders, Craig K. (Committee member) / Thompson, Marilyn S (Committee member) / Arizona State University (Publisher)
Created2016
Description
Purpose: Over-identification of Navajo Head Start children into special education on the Navajo Reservation has come to the attention of Tribal leaders, Educational leaders, and parents due to the use of invalid assessment measures. Dynamic assessment (DA) of narratives may be a tool for distinguishing language differences from language disorders. The purpose of this study is to determine whether the Predictive Early Assessment of Reading and Language (PEARL), a dynamic assessment of narratives, accurately classifies Navajo Head Start students with typically developing (TD) language or with language impairment (LI), and to examine which measures best predict children’s overall performances on the PEARL.
Method: Ninety, 4- and 5-year-old Navajo preschoolers with LI and with TD language were selected. Children completed the PEARL, which measured both language comprehension and production using pretest and posttest scores, and a modifiability scale. In addition, children completed the Clinical Evaluation of Language Fundamental, Preschool, Second Edition (CELF – Preschool 2) and language samples. A Navajo Speech Language Pathologist confirmed the diagnosis of the participants. Research assistants pretested, briefly taught the principles of narrative structure (story grammar, language complexity and episode) and evaluated response to learning using an index of modifiability.
Results: Results of discriminant analysis indicated that PEARL pretest differentiated both ability groups with 89% accuracy. In addition, posttest scores discriminated with 89% accuracy and modifiability scores with 100% accuracy. Further, the subtest story grammar was the best predictor at pretest and posttest, although modifiability scores were better predictors of both ability groups.
Conclusion: Findings indicate that the PEARL is a promising assessment for accurately differentiating Navajo preschool children with LI from Navajo preschool children with TD language. The PEARL’s recommended pretest cut score over-identified Navajo children with TD language; therefore, a new recommended cut score was determined.
Method: Ninety, 4- and 5-year-old Navajo preschoolers with LI and with TD language were selected. Children completed the PEARL, which measured both language comprehension and production using pretest and posttest scores, and a modifiability scale. In addition, children completed the Clinical Evaluation of Language Fundamental, Preschool, Second Edition (CELF – Preschool 2) and language samples. A Navajo Speech Language Pathologist confirmed the diagnosis of the participants. Research assistants pretested, briefly taught the principles of narrative structure (story grammar, language complexity and episode) and evaluated response to learning using an index of modifiability.
Results: Results of discriminant analysis indicated that PEARL pretest differentiated both ability groups with 89% accuracy. In addition, posttest scores discriminated with 89% accuracy and modifiability scores with 100% accuracy. Further, the subtest story grammar was the best predictor at pretest and posttest, although modifiability scores were better predictors of both ability groups.
Conclusion: Findings indicate that the PEARL is a promising assessment for accurately differentiating Navajo preschool children with LI from Navajo preschool children with TD language. The PEARL’s recommended pretest cut score over-identified Navajo children with TD language; therefore, a new recommended cut score was determined.
ContributorsHenderson, Davis E (Author) / Restrepo, Maria Adelaida (Thesis advisor) / Aiken, Leona (Committee member) / Petersen, Douglas (Committee member) / Romero-Little, Mary Eunice (Committee member) / Kleinsasser, Robert (Committee member) / Arizona State University (Publisher)
Created2017