Matching Items (11)
Filtering by
- Genre: Doctoral Dissertation
Description
Random Forests is a statistical learning method which has been proposed for propensity score estimation models that involve complex interactions, nonlinear relationships, or both of the covariates. In this dissertation I conducted a simulation study to examine the effects of three Random Forests model specifications in propensity score analysis. The results suggested that, depending on the nature of data, optimal specification of (1) decision rules to select the covariate and its split value in a Classification Tree, (2) the number of covariates randomly sampled for selection, and (3) methods of estimating Random Forests propensity scores could potentially produce an unbiased average treatment effect estimate after propensity scores weighting by the odds adjustment. Compared to the logistic regression estimation model using the true propensity score model, Random Forests had an additional advantage in producing unbiased estimated standard error and correct statistical inference of the average treatment effect. The relationship between the balance on the covariates' means and the bias of average treatment effect estimate was examined both within and between conditions of the simulation. Within conditions, across repeated samples there was no noticeable correlation between the covariates' mean differences and the magnitude of bias of average treatment effect estimate for the covariates that were imbalanced before adjustment. Between conditions, small mean differences of covariates after propensity score adjustment were not sensitive enough to identify the optimal Random Forests model specification for propensity score analysis.
ContributorsCham, Hei Ning (Author) / Tein, Jenn-Yun (Thesis advisor) / Enders, Stephen G (Thesis advisor) / Enders, Craig K. (Committee member) / Mackinnon, David P (Committee member) / Arizona State University (Publisher)
Created2013
Description
Research demonstrating the importance of the paternal role has been largely conducted using samples of Caucasian men, leaving a gap in what is known about fathering in minority cultures. Family systems theories highlight the dynamic interrelations between familial roles and relationships, and suggest that comprehensive studies of fathering require attention to the broad family and cultural context. During the early infancy period, mothers' and fathers' postpartum adjustment may represent a critical source of influence on father involvement. For the current study, Mexican American (MA) women (N = 125) and a subset of their romantic partners/biological fathers (N = 57) reported on their depressive symptoms and levels of father involvement (paternal engagement, accessibility, and responsibility) during the postpartum period. Descriptive analyses suggested that fathers are involved in meaningful levels of care during infancy. Greater paternal postpartum depression (PPD) was associated with lower levels of father involvement. Maternal PPD interacted with paternal gender role attitudes to predict father involvement. At higher levels of maternal PPD, involvement increased among fathers adhering to less segregated gender role attitudes and decreased among fathers who endorsed more segregated gender role attitudes. Within select models, differences in the relations were observed between mothers' and fathers' reports of paternal involvement. Results bring attention to the importance of examining contextual influences on early fathering in MA families and highlight the unique information that may be gathered from separate maternal and paternal reports of father involvement.
ContributorsRoubinov, Danielle S (Author) / Luecken, Linda J. (Thesis advisor) / Crnic, Keith A (Committee member) / Enders, Craig K. (Committee member) / Gonzales, Nancy A. (Committee member) / Arizona State University (Publisher)
Created2014
Description
Missing data are common in psychology research and can lead to bias and reduced power if not properly handled. Multiple imputation is a state-of-the-art missing data method recommended by methodologists. Multiple imputation methods can generally be divided into two broad categories: joint model (JM) imputation and fully conditional specification (FCS) imputation. JM draws missing values simultaneously for all incomplete variables using a multivariate distribution (e.g., multivariate normal). FCS, on the other hand, imputes variables one at a time, drawing missing values from a series of univariate distributions. In the single-level context, these two approaches have been shown to be equivalent with multivariate normal data. However, less is known about the similarities and differences of these two approaches with multilevel data, and the methodological literature provides no insight into the situations under which the approaches would produce identical results. This document examined five multilevel multiple imputation approaches (three JM methods and two FCS methods) that have been proposed in the literature. An analytic section shows that only two of the methods (one JM method and one FCS method) used imputation models equivalent to a two-level joint population model that contained random intercepts and different associations across levels. The other three methods employed imputation models that differed from the population model primarily in their ability to preserve distinct level-1 and level-2 covariances. I verified the analytic work with computer simulations, and the simulation results also showed that imputation models that failed to preserve level-specific covariances produced biased estimates. The studies also highlighted conditions that exacerbated the amount of bias produced (e.g., bias was greater for conditions with small cluster sizes). The analytic work and simulations lead to a number of practical recommendations for researchers.
ContributorsMistler, Stephen (Author) / Enders, Craig K. (Thesis advisor) / Aiken, Leona (Committee member) / Levy, Roy (Committee member) / West, Stephen G. (Committee member) / Arizona State University (Publisher)
Created2015
Description
Although the issue of factorial invariance has received increasing attention in the literature, the focus is typically on differences in factor structure across groups that are directly observed, such as those denoted by sex or ethnicity. While establishing factorial invariance across observed groups is a requisite step in making meaningful cross-group comparisons, failure to attend to possible sources of latent class heterogeneity in the form of class-based differences in factor structure has the potential to compromise conclusions with respect to observed groups and may result in misguided attempts at instrument development and theory refinement. The present studies examined the sensitivity of two widely used confirmatory factor analytic model fit indices, the chi-square test of model fit and RMSEA, to latent class differences in factor structure. Two primary questions were addressed. The first of these concerned the impact of latent class differences in factor loadings with respect to model fit in a single sample reflecting a mixture of classes. The second question concerned the impact of latent class differences in configural structure on tests of factorial invariance across observed groups. The results suggest that both indices are highly insensitive to class-based differences in factor loadings. Across sample size conditions, models with medium (0.2) sized loading differences were rejected by the chi-square test of model fit at rates just slightly higher than the nominal .05 rate of rejection that would be expected under a true null hypothesis. While rates of rejection increased somewhat when the magnitude of loading difference increased, even the largest sample size with equal class representation and the most extreme violations of loading invariance only had rejection rates of approximately 60%. RMSEA was also insensitive to class-based differences in factor loadings, with mean values across conditions suggesting a degree of fit that would generally be regarded as exceptionally good in practice. In contrast, both indices were sensitive to class-based differences in configural structure in the context of a multiple group analysis in which each observed group was a mixture of classes. However, preliminary evidence suggests that this sensitivity may contingent on the form of the cross-group model misspecification.
ContributorsBlackwell, Kimberly Carol (Author) / Millsap, Roger E (Thesis advisor) / Aiken, Leona S. (Committee member) / Enders, Craig K. (Committee member) / Mackinnon, David P (Committee member) / Arizona State University (Publisher)
Created2011
Description
The purpose of this mixed-methods study was to understand the key constructs and processes underlying the mentoring relationships between doctoral students and their mentors. First, exploratory and confirmatory factor analyses were used to evaluate the measurement structure underlying the 34-item Ideal Mentor Scale (IMS; Rose, 2003), followed by an examination of factorial invariance and differences in latent means between graduate students differing by gender, age, and Master's vs. Doctoral status. The IMS was administered to 1,187 graduate students from various departments across the university at Arizona State University (ASU); this sample was split into two independent samples. Exploratory factory analysis on Sample 1 (N = 607) suggested a new four-factor mentoring model consisting of Affective Advocacy, Academic Guidance, Scholarly Example, and Personal Relationship. Subsequent confirmatory factor analysis on Sample 2 (N = 580) found that this four-factor solution was superior to the fit of a previously hypothesized three-factor model including Integrity, Guidance, and Relationship factors (Rose, 2003). Latent mean differences were evaluated for the four-factor model using structured means modeling. Results showed that females placed more value on factors relating to Affective Advocacy, Academic Guidance, and Scholarly Example, and less value on Personal Relationship than males. Students 30 and older placed less value on Scholarly Example and Personal Relationship than students under 30. There were no significant differences in means for graduate students pursuing a Master's versus a Doctoral degree. iii Further study qualitatively examined mentoring relationships between doctoral students and their faculty mentor using the Questionnaire on Supervisor Doctoral Student Interaction (QSDI) coupled with semi-structured interviews. Graduate support staff were interviewed to gather data on program characteristics and to provide additional context. Data were analyzed using Erickson's Modified Analytical Inductive method (Erickson, 1986). Findings showed that the doctoral students valued guidance, advocacy and constructive, timely feedback but realized the need to practice self-reliance to complete. Peer mentoring was important. Most of the participants valued a mentor's advocacy and longed to co-publish with their advisor. All students valued intellectual freedom, but wished for more direction to facilitate timelier completion of the degree. Development of the scholarly identity received little or no overt attention.
ContributorsGarrett, Pamela S (Author) / Smith, Mary Lee (Thesis advisor) / Potts, Shelly A. (Thesis advisor) / Thompson, Marilyn S. (Committee member) / Arizona State University (Publisher)
Created2012
Description
Designing studies that use latent growth modeling to investigate change over time calls for optimal approaches for conducting power analysis for a priori determination of required sample size. This investigation (1) studied the impacts of variations in specified parameters, design features, and model misspecification in simulation-based power analyses and (2) compared power estimates across three common power analysis techniques: the Monte Carlo method; the Satorra-Saris method; and the method developed by MacCallum, Browne, and Cai (MBC). Choice of sample size, effect size, and slope variance parameters markedly influenced power estimates; however, level-1 error variance and number of repeated measures (3 vs. 6) when study length was held constant had little impact on resulting power. Under some conditions, having a moderate versus small effect size or using a sample size of 800 versus 200 increased power by approximately .40, and a slope variance of 10 versus 20 increased power by up to .24. Decreasing error variance from 100 to 50, however, increased power by no more than .09 and increasing measurement occasions from 3 to 6 increased power by no more than .04. Misspecification in level-1 error structure had little influence on power, whereas misspecifying the form of the growth model as linear rather than quadratic dramatically reduced power for detecting differences in slopes. Additionally, power estimates based on the Monte Carlo and Satorra-Saris techniques never differed by more than .03, even with small sample sizes, whereas power estimates for the MBC technique appeared quite discrepant from the other two techniques. Results suggest the choice between using the Satorra-Saris or Monte Carlo technique in a priori power analyses for slope differences in latent growth models is a matter of preference, although features such as missing data can only be considered within the Monte Carlo approach. Further, researchers conducting power analyses for slope differences in latent growth models should pay greatest attention to estimating slope difference, slope variance, and sample size. Arguments are also made for examining model-implied covariance matrices based on estimated parameters and graphic depictions of slope variance to help ensure parameter estimates are reasonable in a priori power analysis.
ContributorsVan Vleet, Bethany Lucía (Author) / Thompson, Marilyn S. (Thesis advisor) / Green, Samuel B. (Committee member) / Enders, Craig K. (Committee member) / Arizona State University (Publisher)
Created2011
Description
Differentiating bilingual children with primary language impairment (PLI) from those with typical development in the process of learning a second language has been a challenge. Studies have focused on improving the diagnostic accuracy of language measures for bilinguals. However, researchers are faced with two main challenges when estimating the diagnostic accuracy of new measures: (a) using an a priori diagnosis of children (children with and without PLI), as a reference may introduce error given there is no gold standard for the a priori classification; and (b) classifying children into only two groups may be another source of error given evidence that there may be more than two language ability groups with different strengths and weaknesses or, alternatively, a single group characterized by a continuum of language performance. The current study tested for the number of distinct language ability groups and their characteristics in predominately Spanish-speaking children in the U.S. without using an a priori classification as a reference. In addition, the study examined to what extent the latent groups differed on each measure, and the stability of language ability groups across three assessment methods in Spanish (standardized tests, language sample analyses, and comprehensive assessment), taking in to account English and non-verbal cognitive skills. The study included 431 bilingual children attending English-only education. Three latent profile analyses were conducted, one for each method of assessment. Results suggested more than two distinct language ability groups in the population with the method of assessment influencing the number and characteristics of the groups. Specifically, four groups were estimated based on the comprehensive assessment, and three based on standardized assessment or language sample analysis in Spanish. The stability of the groups was high on average, particularly between the comprehensive assessment and the standardized measures. Results indicate that an a priori classification of children into two groups, those with and without PLI, could lead to misclassification, depending on the measures used.
ContributorsKapantzoglou, Maria (Author) / Restrepo, Maria A. (Thesis advisor) / Gray, Shelley S. (Committee member) / Thompson, Marilyn S. (Committee member) / Arizona State University (Publisher)
Created2012
Description
This dissertation examines a planned missing data design in the context of mediational analysis. The study considered a scenario in which the high cost of an expensive mediator limited sample size, but in which less expensive mediators could be gathered on a larger sample size. Simulated multivariate normal data were generated from a latent variable mediation model with three observed indicator variables, M1, M2, and M3. Planned missingness was implemented on M1 under the missing completely at random mechanism. Five analysis methods were employed: latent variable mediation model with all three mediators as indicators of a latent construct (Method 1), auxiliary variable model with M1 as the mediator and M2 and M3 as auxiliary variables (Method 2), auxiliary variable model with M1 as the mediator and M2 as a single auxiliary variable (Method 3), maximum likelihood estimation including all available data but incorporating only mediator M1 (Method 4), and listwise deletion (Method 5).
The main outcome of interest was empirical power to detect the mediated effect. The main effects of mediation effect size, sample size, and missing data rate performed as expected with power increasing for increasing mediation effect sizes, increasing sample sizes, and decreasing missing data rates. Consistent with expectations, power was the greatest for analysis methods that included all three mediators, and power decreased with analysis methods that included less information. Across all design cells relative to the complete data condition, Method 1 with 20% missingness on M1 produced only 2.06% loss in power for the mediated effect; with 50% missingness, 6.02% loss; and 80% missingess, only 11.86% loss. Method 2 exhibited 20.72% power loss at 80% missingness, even though the total amount of data utilized was the same as Method 1. Methods 3 – 5 exhibited greater power loss. Compared to an average power loss of 11.55% across all levels of missingness for Method 1, average power losses for Methods 3, 4, and 5 were 23.87%, 29.35%, and 32.40%, respectively. In conclusion, planned missingness in a multiple mediator design may permit higher quality characterization of the mediator construct at feasible cost.
The main outcome of interest was empirical power to detect the mediated effect. The main effects of mediation effect size, sample size, and missing data rate performed as expected with power increasing for increasing mediation effect sizes, increasing sample sizes, and decreasing missing data rates. Consistent with expectations, power was the greatest for analysis methods that included all three mediators, and power decreased with analysis methods that included less information. Across all design cells relative to the complete data condition, Method 1 with 20% missingness on M1 produced only 2.06% loss in power for the mediated effect; with 50% missingness, 6.02% loss; and 80% missingess, only 11.86% loss. Method 2 exhibited 20.72% power loss at 80% missingness, even though the total amount of data utilized was the same as Method 1. Methods 3 – 5 exhibited greater power loss. Compared to an average power loss of 11.55% across all levels of missingness for Method 1, average power losses for Methods 3, 4, and 5 were 23.87%, 29.35%, and 32.40%, respectively. In conclusion, planned missingness in a multiple mediator design may permit higher quality characterization of the mediator construct at feasible cost.
ContributorsBaraldi, Amanda N (Author) / Enders, Craig K. (Thesis advisor) / Mackinnon, David P (Thesis advisor) / Aiken, Leona S. (Committee member) / Tein, Jenn-Yun (Committee member) / Arizona State University (Publisher)
Created2015
Description
The overarching goal of this dissertation was to contribute to the field’s understanding of young children’s development of ethnic-racial identification. In particular, Study 1 presented the adaptation of three measures that are developmentally appropriate for assessing young children’s ethnic-racial attitudes, ethnic-racial centrality, and ethnic-racial knowledge, and tested the psychometric properties of each measure. Findings from Study 1 provided limited initial support for the construct validity and reliability of the measures; importantly, there were many differences in the descriptives and measurement properties based on the language in which children completed the measures. In addition to measurement of ethnic-racial identification, Study 2 used the measures developed in Study 1 and tested whether Mexican-origin mothers’ adaptive cultural characteristics (i.e., ERI affirmation, ethnic-racial centrality, and involvement in Mexican culture) when children were 3 years of age predicted greater cultural socialization efforts with children at 4 years of age and, in turn, children’s ethnic-racial identification (i.e., children’s ethnic-racial attitudes, ethnic-racial centrality, ethnic-racial knowledge, and identification as Mexican) at 5 years of age. Furthermore, children’s characteristics (i.e., gender and skin tone) were tested as moderators of these processes. Findings supported expected processes from mothers’ adaptive cultural characteristics to children’s ethnic-racial identification via mothers’ cultural socialization across boys and girls, however, relations varied by children’s skin tone. Findings highlight the important role of children’s individual characteristics in cultural socialization and young children’s developing ethnic-racial identification over time. Overall, given the paucity of studies that have examined ethnic-racial identification among young children, the results from Study 1 and Study 2 have the potential to stimulate growth of knowledge in this area.
ContributorsDerlan, Chelsea L (Author) / Umaña-Taylor, Adriana J. J (Thesis advisor) / Updegraff, Kimberly A. (Committee member) / Seaton, Eleanor (Committee member) / Martin, Carol L. (Committee member) / Thompson, Marilyn S. (Committee member) / Arizona State University (Publisher)
Created2016
Description
Accurate data analysis and interpretation of results may be influenced by many potential factors. The factors of interest in the current work are the chosen analysis model(s), the presence of missing data, and the type(s) of data collected. If analysis models are used which a) do not accurately capture the structure of relationships in the data such as clustered/hierarchical data, b) do not allow or control for missing values present in the data, or c) do not accurately compensate for different data types such as categorical data, then the assumptions associated with the model have not been met and the results of the analysis may be inaccurate. In the presence of clustered
ested data, hierarchical linear modeling or multilevel modeling (MLM; Raudenbush & Bryk, 2002) has the ability to predict outcomes for each level of analysis and across multiple levels (accounting for relationships between levels) providing a significant advantage over single-level analyses. When multilevel data contain missingness, multilevel multiple imputation (MLMI) techniques may be used to model both the missingness and the clustered nature of the data. With categorical multilevel data with missingness, categorical MLMI must be used. Two such routines for MLMI with continuous and categorical data were explored with missing at random (MAR) data: a formal Bayesian imputation and analysis routine in JAGS (R/JAGS) and a common MLM procedure of imputation via Bayesian estimation in BLImP with frequentist analysis of the multilevel model in Mplus (BLImP/Mplus). Manipulated variables included interclass correlations, number of clusters, and the rate of missingness. Results showed that with continuous data, R/JAGS returned more accurate parameter estimates than BLImP/Mplus for almost all parameters of interest across levels of the manipulated variables. Both R/JAGS and BLImP/Mplus encountered convergence issues and returned inaccurate parameter estimates when imputing and analyzing dichotomous data. Follow-up studies showed that JAGS and BLImP returned similar imputed datasets but the choice of analysis software for MLM impacted the recovery of accurate parameter estimates. Implications of these findings and recommendations for further research will be discussed.
ested data, hierarchical linear modeling or multilevel modeling (MLM; Raudenbush & Bryk, 2002) has the ability to predict outcomes for each level of analysis and across multiple levels (accounting for relationships between levels) providing a significant advantage over single-level analyses. When multilevel data contain missingness, multilevel multiple imputation (MLMI) techniques may be used to model both the missingness and the clustered nature of the data. With categorical multilevel data with missingness, categorical MLMI must be used. Two such routines for MLMI with continuous and categorical data were explored with missing at random (MAR) data: a formal Bayesian imputation and analysis routine in JAGS (R/JAGS) and a common MLM procedure of imputation via Bayesian estimation in BLImP with frequentist analysis of the multilevel model in Mplus (BLImP/Mplus). Manipulated variables included interclass correlations, number of clusters, and the rate of missingness. Results showed that with continuous data, R/JAGS returned more accurate parameter estimates than BLImP/Mplus for almost all parameters of interest across levels of the manipulated variables. Both R/JAGS and BLImP/Mplus encountered convergence issues and returned inaccurate parameter estimates when imputing and analyzing dichotomous data. Follow-up studies showed that JAGS and BLImP returned similar imputed datasets but the choice of analysis software for MLM impacted the recovery of accurate parameter estimates. Implications of these findings and recommendations for further research will be discussed.
ContributorsKunze, Katie L (Author) / Levy, Roy (Thesis advisor) / Enders, Craig K. (Committee member) / Thompson, Marilyn S (Committee member) / Arizona State University (Publisher)
Created2016