Matching Items (19)
Filtering by
- All Subjects: psychology
- All Subjects: psychometrics
Description
Although the issue of factorial invariance has received increasing attention in the literature, the focus is typically on differences in factor structure across groups that are directly observed, such as those denoted by sex or ethnicity. While establishing factorial invariance across observed groups is a requisite step in making meaningful cross-group comparisons, failure to attend to possible sources of latent class heterogeneity in the form of class-based differences in factor structure has the potential to compromise conclusions with respect to observed groups and may result in misguided attempts at instrument development and theory refinement. The present studies examined the sensitivity of two widely used confirmatory factor analytic model fit indices, the chi-square test of model fit and RMSEA, to latent class differences in factor structure. Two primary questions were addressed. The first of these concerned the impact of latent class differences in factor loadings with respect to model fit in a single sample reflecting a mixture of classes. The second question concerned the impact of latent class differences in configural structure on tests of factorial invariance across observed groups. The results suggest that both indices are highly insensitive to class-based differences in factor loadings. Across sample size conditions, models with medium (0.2) sized loading differences were rejected by the chi-square test of model fit at rates just slightly higher than the nominal .05 rate of rejection that would be expected under a true null hypothesis. While rates of rejection increased somewhat when the magnitude of loading difference increased, even the largest sample size with equal class representation and the most extreme violations of loading invariance only had rejection rates of approximately 60%. RMSEA was also insensitive to class-based differences in factor loadings, with mean values across conditions suggesting a degree of fit that would generally be regarded as exceptionally good in practice. In contrast, both indices were sensitive to class-based differences in configural structure in the context of a multiple group analysis in which each observed group was a mixture of classes. However, preliminary evidence suggests that this sensitivity may contingent on the form of the cross-group model misspecification.
ContributorsBlackwell, Kimberly Carol (Author) / Millsap, Roger E (Thesis advisor) / Aiken, Leona S. (Committee member) / Enders, Craig K. (Committee member) / Mackinnon, David P (Committee member) / Arizona State University (Publisher)
Created2011
Description
Research has shown that a developmental process of maturing out of alcohol involvement occurs during young adulthood, and that this process is related to both young adult role transitions (e.g., marriage) and personality developmental (e.g., decreased disinhibition and neuroticism). The current study extended past research by testing whether protective marriage and personality effects on maturing out were stronger among more severe late adolescent drinkers, and whether protective marriage effects were stronger among those who experienced more personality development. Parental alcoholism and gender were tested as moderators of marriage, personality, and late adolescent drinking effects on maturing out; and as distal predictors mediated by these effects. Participants were a subsample (N = 844; 51% children of alcoholics; 53% male, 71% non-Hispanic Caucasian, 27% Hispanic; Chassin, Barrera, Bech, & Kossak-Fuller, 1992) from a larger longitudinal study of familial alcoholism. Hypotheses were tested with latent growth models characterizing alcohol consumption and drinking consequence trajectories from late adolescence to adulthood (age 17-40). Past findings were replicated by showing protective effects of becoming married, sensation-seeking reductions, and neuroticism reductions on the drinking trajectories. Moderation tests showed that protective marriage effects on the drinking trajectories were stronger among those with higher pre-marriage drinking in late adolescence (i.e., higher growth intercepts). This might reflect role socialization mechanisms such that more severe drinking produces more conflict with the demands of new roles (i.e., role incompatibility), thus requiring greater drinking reductions to resolve this conflict. In contrast, little evidence was found for moderation of personality effects by late adolescent drinking or for moderation of marriage effects by personality. Parental alcoholism findings suggested complex moderated mediation pathways. Parental alcoholism predicted less drinking reduction through decreasing the likelihood of marriage (mediation) and muting marriage's effect on the drinking trajectories (moderation), but parental alcoholism also predicted more drinking reduction through increasing initial drinking in late adolescence (mediation). The current study provides new insights into naturally occurring processes of recovery during young adulthood and suggests that developmentally-tailored interventions for young adults could harness these natural recovery processes (e.g., by integrating role incompatibility themes and addressing factors that block role effects among those with familial alcoholism).
ContributorsLee, Matthew R. (Author) / Chassin, Laurie (Thesis advisor) / Corbin, William R. (Committee member) / Mackinnon, David P (Committee member) / Presson, Clark C. (Committee member) / Arizona State University (Publisher)
Created2013
Description
The development of self-regulation is believed to play a crucial role in predicting later psychopathology and is believed to begin in early childhood. The early postpartum period is particularly important in laying the groundwork for later self-regulation as infants' dispositional traits interact with caregivers' co-regulatory behaviors to produce the earliest forms of self-regulation. Moreover, although emerging literature suggests that infants' exposure to maternal stress even before birth may be integral in determining children's self-regulatory capacities, the complex pathways that characterize these developmental processes remain unclear. The current study considers the complex, transactional processes in a high-risk, Mexican American sample. Data were collected from 305 Mexican American infants and their mothers during prenatal, 6- and 12-week home interviews. Mother self-reports of stress were obtained prenatally between 34-37 weeks gestation. Mother reports of infant temperamental negativity and surgency were obtained at 6-weeks as were observed global ratings of maternal sensitivity during a structured peek-a-boo task. Microcoded ratings of infants' engagement orienting and self-comforting behaviors were obtained during the 12-week peek-a-boo task. Study findings suggest that self-comforting and orienting behaviors help to modulate infants' experiences of distress, and also that prenatal stress influences infants' engagement in each of those regulatory behaviors, both directly by influence tendencies to engage in orienting behaviors and indirectly by programming higher levels of infant negativity and surgency, both of which may confer risk for later regulatory disadvantage. Advancing our understandings about the nature of these developmental pathways could have significant implications for targets of early intervention in this high-risk population.
ContributorsLin, Betty (Author) / Crnic, Keith A (Thesis advisor) / Lemery-Chalfant, Kathryn S (Committee member) / Mackinnon, David P (Committee member) / Arizona State University (Publisher)
Created2013
Description
Daily dairies and other intensive measurement methods are increasingly used to study the relationships between two time varying variables X and Y. These data are commonly analyzed using longitudinal multilevel or bivariate growth curve models that allow for random effects of intercept (and sometimes also slope) but which do not address the effects of weekly cycles in the data. Three Monte Carlo studies investigated the impact of omitting the weekly cycles in daily dairy data under the multilevel model framework. In cases where cycles existed in both the time-varying predictor series (X) and the time-varying outcome series (Y) but were ignored, the effects of the within- and between-person components of X on Y tended to be biased, as were their corresponding standard errors. The direction and magnitude of the bias depended on the phase difference between the cycles in the two series. In cases where cycles existed in only one series but were ignored, the standard errors of the regression coefficients for the within- and between-person components of X tended to be biased, and the direction and magnitude of bias depended on which series contained cyclical components.
ContributorsLiu, Yu (Author) / West, Stephen G. (Thesis advisor) / Enders, Craig K. (Committee member) / Reiser, Mark R. (Committee member) / Arizona State University (Publisher)
Created2013
Description
An individual’s reputation can be beneficial or detrimental to their exchanges with others,
and these exchanges may be critical for achieving evolutionary goals, such as reproduction.
Depending on their reputation, an individual may or may not gain access to resources in order to
achieve their evolutionary goals. Reputation is typically described as being “positive” and
“negative,” but the current study aimed to identify potential nuances to reputations beyond the
traditional dichotomy. It was hypothesized that different types of reputations (such as “friendly”,
“dishonest”, and “aggressive”) would group together in categories beyond “positive” and
“negative.” Additionally, individuals with different life history strategies might find different
reputations important, because the reputations they find most important may help them get the
kinds of resources they need to attain their specific evolutionary goals. Therefore, it was also
predicted that the importance individuals place on different types of reputations would vary as a
function of life history strategy. Exploratory factor analysis identified a five factor structure for
reputations. Individuals also placed varying levels of importance on different types of
reputations, and found some reputations more important than others depending on their life
history strategy. This study demonstrates that reputational information is more nuanced than
previously thought and future research should consider that there may be more than just
“positive” and “negative” reputations in social interactions.
and these exchanges may be critical for achieving evolutionary goals, such as reproduction.
Depending on their reputation, an individual may or may not gain access to resources in order to
achieve their evolutionary goals. Reputation is typically described as being “positive” and
“negative,” but the current study aimed to identify potential nuances to reputations beyond the
traditional dichotomy. It was hypothesized that different types of reputations (such as “friendly”,
“dishonest”, and “aggressive”) would group together in categories beyond “positive” and
“negative.” Additionally, individuals with different life history strategies might find different
reputations important, because the reputations they find most important may help them get the
kinds of resources they need to attain their specific evolutionary goals. Therefore, it was also
predicted that the importance individuals place on different types of reputations would vary as a
function of life history strategy. Exploratory factor analysis identified a five factor structure for
reputations. Individuals also placed varying levels of importance on different types of
reputations, and found some reputations more important than others depending on their life
history strategy. This study demonstrates that reputational information is more nuanced than
previously thought and future research should consider that there may be more than just
“positive” and “negative” reputations in social interactions.
ContributorsPatterson, Danielle Nicole (Author) / Aktipis, Athena (Thesis director) / Corbin, William (Committee member) / West, Stephen G. (Committee member) / Ayers, Jessica D. (Committee member) / Department of Psychology (Contributor) / School of Human Evolution & Social Change (Contributor) / Barrett, The Honors College (Contributor)
Created2020-12
Description
This paper examines the effect of a weekly student self-assessment assignment on student performance in an undergraduate math course. Self-assessment is an increasingly popular type of formative assessment with close ties to self-regulated learning theory. In this randomized controlled trial, 88 students enrolled in MAT 142 were divided into four treatment groups, receiving the self-assessment assignment for either half the semester, the full semester, or not at all. There was no main effect of the treatment on students’ course performance (F(3,80) = 0.154, p = 0.999). However, students’ level of compliance with the assignments (F(1, 63) = 6.87, p = 0.011) and class attendance (F(1, 83) = 12.34, p < 0.001) both significantly predicted exam scores, suggesting that conscientiousness predicts performance. I conducted focus groups to understand how students felt toward the self-assessments. Participants expressed distaste toward the assignments and provided suggestions for improvements. I describe these improvements, among others, in an effort to outline future directions for this research. I also describe a new model of student self-assessment based on theories of adaptive testing and self-regulated learning.
ContributorsDuque-Baird, Santiago (Author) / Zheng, Yi (Thesis director) / West, Stephen G. (Thesis director) / Slominski, Tara (Committee member) / Barrett, The Honors College (Contributor) / Department of English (Contributor) / Department of Psychology (Contributor)
Created2024-05
Description
Mediation analysis is used to investigate how an independent variable, X, is related to an outcome variable, Y, through a mediator variable, M (MacKinnon, 2008). If X represents a randomized intervention it is difficult to make a cause and effect inference regarding indirect effects without making no unmeasured confounding assumptions using the potential outcomes framework (Holland, 1988; MacKinnon, 2008; Robins & Greenland, 1992; VanderWeele, 2015), using longitudinal data to determine the temporal order of M and Y (MacKinnon, 2008), or both. The goals of this dissertation were to (1) define all indirect and direct effects in a three-wave longitudinal mediation model using the causal mediation formula (Pearl, 2012), (2) analytically compare traditional estimators (ANCOVA, difference score, and residualized change score) to the potential outcomes-defined indirect effects, and (3) use a Monte Carlo simulation to compare the performance of regression and potential outcomes-based methods for estimating longitudinal indirect effects and apply the methods to an empirical dataset. The results of the causal mediation formula revealed the potential outcomes definitions of indirect effects are equivalent to the product of coefficient estimators in a three-wave longitudinal mediation model with linear and additive relations. It was demonstrated with analytical comparisons that the ANCOVA, difference score, and residualized change score models’ estimates of two time-specific indirect effects differ as a function of the respective mediator-outcome relations at each time point. The traditional model that performed the best in terms of the evaluation criteria in the Monte Carlo study was the ANCOVA model and the potential outcomes model that performed the best in terms of the evaluation criteria was sequential G-estimation. Implications and future directions are discussed.
ContributorsValente, Matthew J (Author) / Mackinnon, David P (Thesis advisor) / West, Stephen G. (Committee member) / Grimm, Keving (Committee member) / Chassin, Laurie (Committee member) / Arizona State University (Publisher)
Created2018
Description
The goal of diagnostic assessment is to discriminate between groups. In many cases, a binary decision is made conditional on a cut score from a continuous scale. Psychometric methods can improve assessment by modeling a latent variable using item response theory (IRT), and IRT scores can subsequently be used to determine a cut score using receiver operating characteristic (ROC) curves. Psychometric methods provide reliable and interpretable scores, but the prediction of the diagnosis is not the primary product of the measurement process. In contrast, machine learning methods, such as regularization or binary recursive partitioning, can build a model from the assessment items to predict the probability of diagnosis. Machine learning predicts the diagnosis directly, but does not provide an inferential framework to explain why item responses are related to the diagnosis. It remains unclear whether psychometric and machine learning methods have comparable accuracy or if one method is preferable in some situations. In this study, Monte Carlo simulation methods were used to compare psychometric and machine learning methods on diagnostic classification accuracy. Results suggest that classification accuracy of psychometric models depends on the diagnostic-test correlation and prevalence of diagnosis. Also, machine learning methods that reduce prediction error have inflated specificity and very low sensitivity compared to the data-generating model, especially when prevalence is low. Finally, machine learning methods that use ROC curves to determine probability thresholds have comparable classification accuracy to the psychometric models as sample size, number of items, and number of item categories increase. Therefore, results suggest that machine learning models could provide a viable alternative for classification in diagnostic assessments. Strengths and limitations for each of the methods are discussed, and future directions are considered.
ContributorsGonzález, Oscar (Author) / Mackinnon, David P (Thesis advisor) / Edwards, Michael C (Thesis advisor) / Grimm, Kevin J. (Committee member) / Zheng, Yi (Committee member) / Arizona State University (Publisher)
Created2018
Description
Research and theory in social psychology and related fields indicates that people simultaneously hold many cultural identities. And it is well evidenced across relevant fields (e.g., sociology, marketing, economics) that salient identities are instrumental in a variety of cognitive and behavioral processes, including decision-making. It is not, however, well understood how the relative salience of various cultural identities factors into the process of making identity-relevant choices, particularly ones that require an actor to choose between conflicting sets of cultural values or beliefs. It is also unclear whether the source of that salience (e.g., chronic or situational) is meaningful in this regard. The current research makes novel predictions concerning the roles of cultural identity centrality and cultural identity situational salience in three distinct aspects of the decision-making process: Direction of decision, speed of decision, and emotion related to decision. In doing so, the research highlights two under-researched forms of culture (i.e., political and religious) and uses as the focal dependent variable a decision-making scenario that forces participants to choose between the values of their religious and political cultures and, to some degree, behave in an identity-inconsistent manner. Results indicate main effects of Christian identity centrality and democrat identity centrality on preference for traditional versus gender-neutral (i.e., non-traditional/progressive) restrooms after statistically controlling for covariates. Additionally, results show a significant main effect of democrat identity centrality and a significant interaction effect of Christian and democrat identity centrality on positive emotion linked to the decision. Post hoc analyses further reveal a significant quadratic relationship between Christian identity centrality and emotion related to the decision. There was no effect of situational strength of democrat identity salience on the decision. Neither centrality or situational strength had any effect on the speed with which participants made their decisions. This research theoretically and empirically advances the study of cultural psychology and carries important implications for identity research and judgment and decision-making across a variety of fields, including management, behavioral economics, and marketing.
ContributorsBarbour, Joseph Eugene (Author) / Cohen, Adam B. (Thesis advisor) / Kenrick, Douglas T. (Committee member) / Mackinnon, David P (Committee member) / Mandel, Naomi (Committee member) / Arizona State University (Publisher)
Created2019
Description
Statistical mediation analysis allows researchers to identify the most important the mediating constructs in the causal process studied. Information about the mediating processes can be used to make interventions more powerful by enhancing successful program components and by not implementing components that did not significantly change the outcome. Identifying mediators is especially relevant when the hypothesized mediating construct consists of multiple related facets. The general definition of the construct and its facets might relate differently to external criteria. However, current methods do not allow researchers to study the relationships between general and specific aspects of a construct to an external criterion simultaneously. This study proposes a bifactor measurement model for the mediating construct as a way to represent the general aspect and specific facets of a construct simultaneously. Monte Carlo simulation results are presented to help to determine under what conditions researchers can detect the mediated effect when one of the facets of the mediating construct is the true mediator, but the mediator is treated as unidimensional. Results indicate that parameter bias and detection of the mediated effect depends on the facet variance represented in the mediation model. This study contributes to the largely unexplored area of measurement issues in statistical mediation analysis.
ContributorsGonzález, Oscar (Author) / Mackinnon, David P (Thesis advisor) / Grimm, Kevin J. (Committee member) / Zheng, Yi (Committee member) / Arizona State University (Publisher)
Created2016