Matching Items (4)
Filtering by
- All Subjects: Multilevel Modeling
- Creators: Mackinnon, David P
- Creators: Brewer, Gene A.
- Creators: Enders, Stephen G
Description
Random Forests is a statistical learning method which has been proposed for propensity score estimation models that involve complex interactions, nonlinear relationships, or both of the covariates. In this dissertation I conducted a simulation study to examine the effects of three Random Forests model specifications in propensity score analysis. The results suggested that, depending on the nature of data, optimal specification of (1) decision rules to select the covariate and its split value in a Classification Tree, (2) the number of covariates randomly sampled for selection, and (3) methods of estimating Random Forests propensity scores could potentially produce an unbiased average treatment effect estimate after propensity scores weighting by the odds adjustment. Compared to the logistic regression estimation model using the true propensity score model, Random Forests had an additional advantage in producing unbiased estimated standard error and correct statistical inference of the average treatment effect. The relationship between the balance on the covariates' means and the bias of average treatment effect estimate was examined both within and between conditions of the simulation. Within conditions, across repeated samples there was no noticeable correlation between the covariates' mean differences and the magnitude of bias of average treatment effect estimate for the covariates that were imbalanced before adjustment. Between conditions, small mean differences of covariates after propensity score adjustment were not sensitive enough to identify the optimal Random Forests model specification for propensity score analysis.
ContributorsCham, Hei Ning (Author) / Tein, Jenn-Yun (Thesis advisor) / Enders, Stephen G (Thesis advisor) / Enders, Craig K. (Committee member) / Mackinnon, David P (Committee member) / Arizona State University (Publisher)
Created2013
Description
In most of the work using event-related potentials (ERPs), researchers presume the function of specific components based on the careful manipulation of experimental factors, but rarely report direct evidence supporting a relationship between the neural signal and other outcomes. Perhaps most troubling is the lack of evidence that ERPs correlate with related behavioral outcomes which should result, at least in part, from the neural processes that ERPs capture. One such example is the NoGo-N2 component, an ERP component elicited in Go/NoGo paradigms. There are two primary theories regarding the functional significance of this component in this context: that the signal represents response inhibition and that the component reflects conflict. In this paper, a trial-level method of analysis for the relationship between ERP component potentials and downstream behavioral outcomes (in this case, response accuracy) using a multi-level modeling framework is proposed to provide discriminatory evidence for one of these theories. Following a description of the research on the NoGo-N2, preliminary data supporting the conflict monitoring theory are presented, noting important limitations. Next, an EEG simulation study is presented in which NoGo-N2 data are generated with a known relationship to fabricated reaction time data, showing that, with added levels of complexity and noise within the data, the MLM approach is consistently successful at extracting the known relationships that occur in real NoGo-N2 data. Next, using independent components analysis (ICA) to extract spatiotemporal components that best represent the signal of interest, a well-powered analysis of the relationship between the NoGo-N2 and response accuracy is used to provide strong discriminatory evidence for the conflict monitoring theory of the NoGo-N2. Finally, implications for the NoGo-N2, as well as all ERP components, are discussed with a focus on how this approach can and should be used. the paper concludes with potential expansions of this approach to areas beyond identifying the function of ERP components.
ContributorsHampton, Ryan Scott (Author) / Varnum, Michael E.W. (Thesis advisor) / Shiota, Michelle N. (Committee member) / Brewer, Gene A. (Committee member) / Blais, Chris (Committee member) / Arizona State University (Publisher)
Created2019
Description
The comparison of between- versus within-person relations addresses a central issue in psychological research regarding whether group-level relations among variables generalize to individual group members. Between- and within-person effects may differ in magnitude as well as direction, and contextual multilevel models can accommodate this difference. Contextual multilevel models have been explicated mostly for cross-sectional data, but they can also be applied to longitudinal data where level-1 effects represent within-person relations and level-2 effects represent between-person relations. With longitudinal data, estimating the contextual effect allows direct evaluation of whether between-person and within-person effects differ. Furthermore, these models, unlike single-level models, permit individual differences by allowing within-person slopes to vary across individuals. This study examined the statistical performance of the contextual model with a random slope for longitudinal within-person fluctuation data.
A Monte Carlo simulation was used to generate data based on the contextual multilevel model, where sample size, effect size, and intraclass correlation (ICC) of the predictor variable were varied. The effects of simulation factors on parameter bias, parameter variability, and standard error accuracy were assessed. Parameter estimates were in general unbiased. Power to detect the slope variance and contextual effect was over 80% for most conditions, except some of the smaller sample size conditions. Type I error rates for the contextual effect were also high for some of the smaller sample size conditions. Conclusions and future directions are discussed.
A Monte Carlo simulation was used to generate data based on the contextual multilevel model, where sample size, effect size, and intraclass correlation (ICC) of the predictor variable were varied. The effects of simulation factors on parameter bias, parameter variability, and standard error accuracy were assessed. Parameter estimates were in general unbiased. Power to detect the slope variance and contextual effect was over 80% for most conditions, except some of the smaller sample size conditions. Type I error rates for the contextual effect were also high for some of the smaller sample size conditions. Conclusions and future directions are discussed.
ContributorsWurpts, Ingrid Carlson (Author) / Mackinnon, David P (Thesis advisor) / West, Stephen G. (Committee member) / Grimm, Kevin J. (Committee member) / Suk, Hye Won (Committee member) / Arizona State University (Publisher)
Created2016
Description
Mediation analysis is a statistical approach that examines the effect of a treatment (e.g., prevention program) on an outcome (e.g., substance use) achieved by targeting and changing one or more intervening variables (e.g., peer drug use norms). The increased use of prevention intervention programs with outcomes measured at multiple time points following the intervention requires multilevel modeling techniques to account for clustering in the data. Estimating multilevel mediation models, in which all the variables are measured at individual level (Level 1), poses several challenges to researchers. The first challenge is to conceptualize a multilevel mediation model by clarifying the underlying statistical assumptions and implications of those assumptions on cluster-level (Level-2) covariance structure. A second challenge is that variables measured at Level 1 potentially contain both between- and within-cluster variation making interpretation of multilevel analysis difficult. As a result, multilevel mediation analyses may yield coefficient estimates that are composites of coefficient estimates at different levels if proper centering is not used. This dissertation addresses these two challenges. Study 1 discusses the concept of a correctly specified multilevel mediation model by examining the underlying statistical assumptions and implication of those assumptions on Level-2 covariance structure. Further, Study 1 presents analytical results showing algebraic relationships between the population parameters in a correctly specified multilevel mediation model. Study 2 extends previous work on centering in multilevel mediation analysis. First, different centering methods in multilevel analysis including centering within cluster with the cluster mean as a Level-2 predictor of intercept (CWC2) are discussed. Next, application of the CWC2 strategy to accommodate multilevel mediation models is explained. It is shown that the CWC2 centering strategy separates the between- and within-cluster mediated effects. Next, Study 2 discusses assumptions underlying a correctly specified CWC2 multilevel mediation model and defines between- and within-cluster mediated effects. In addition, analytical results for the algebraic relationships between the population parameters in a CWC2 multilevel mediation model are presented. Finally, Study 2 shows results of a simulation study conducted to verify derived algebraic relationships empirically.
ContributorsTofighi, Davood (Author) / West, Stephen G. (Thesis advisor) / Mackinnon, David P (Thesis advisor) / Enders, Craig C (Committee member) / Millsap, Roger E (Committee member) / Arizona State University (Publisher)
Created2010