Matching Items (5)
Filtering by
- All Subjects: psychometrics
- All Subjects: Middle-aged persons--Psychology.
- Creators: Grimm, Kevin J.
- Member of: Theses and Dissertations
- Resource Type: Text
- Status: Published
Description
The goal of diagnostic assessment is to discriminate between groups. In many cases, a binary decision is made conditional on a cut score from a continuous scale. Psychometric methods can improve assessment by modeling a latent variable using item response theory (IRT), and IRT scores can subsequently be used to determine a cut score using receiver operating characteristic (ROC) curves. Psychometric methods provide reliable and interpretable scores, but the prediction of the diagnosis is not the primary product of the measurement process. In contrast, machine learning methods, such as regularization or binary recursive partitioning, can build a model from the assessment items to predict the probability of diagnosis. Machine learning predicts the diagnosis directly, but does not provide an inferential framework to explain why item responses are related to the diagnosis. It remains unclear whether psychometric and machine learning methods have comparable accuracy or if one method is preferable in some situations. In this study, Monte Carlo simulation methods were used to compare psychometric and machine learning methods on diagnostic classification accuracy. Results suggest that classification accuracy of psychometric models depends on the diagnostic-test correlation and prevalence of diagnosis. Also, machine learning methods that reduce prediction error have inflated specificity and very low sensitivity compared to the data-generating model, especially when prevalence is low. Finally, machine learning methods that use ROC curves to determine probability thresholds have comparable classification accuracy to the psychometric models as sample size, number of items, and number of item categories increase. Therefore, results suggest that machine learning models could provide a viable alternative for classification in diagnostic assessments. Strengths and limitations for each of the methods are discussed, and future directions are considered.
ContributorsGonzález, Oscar (Author) / Mackinnon, David P (Thesis advisor) / Edwards, Michael C (Thesis advisor) / Grimm, Kevin J. (Committee member) / Zheng, Yi (Committee member) / Arizona State University (Publisher)
Created2018
Description
To make meaningful comparisons on a construct of interest across groups or over time, measurement invariance needs to exist for at least a subset of the observed variables that define the construct. Often, chi-square difference tests are used to test for measurement invariance. However, these statistics are affected by sample size such that larger sample sizes are associated with a greater prevalence of significant tests. Thus, using other measures of non-invariance to aid in the decision process would be beneficial. For this dissertation project, I proposed four new effect size measures of measurement non-invariance and analyzed a Monte Carlo simulation study to evaluate their properties and behavior in addition to the properties and behavior of an already existing effect size measure of non-invariance. The effect size measures were evaluated based on bias, variability, and consistency. Additionally, the factors that affected the value of the effect size measures were analyzed. All studied effect sizes were consistent, but three were biased under certain conditions. Further work is needed to establish benchmarks for the unbiased effect sizes.
ContributorsGunn, Heather J (Author) / Grimm, Kevin J. (Thesis advisor) / Edwards, Michael C (Thesis advisor) / Tein, Jenn-Yun (Committee member) / Anderson, Samantha F. (Committee member) / Arizona State University (Publisher)
Created2019
Description
Time metric is an important consideration for all longitudinal models because it can influence the interpretation of estimates, parameter estimate accuracy, and model convergence in longitudinal models with latent variables. Currently, the literature on latent difference score (LDS) models does not discuss the importance of time metric. Furthermore, there is little research using simulations to investigate LDS models. This study examined the influence of time metric on model estimation, interpretation, parameter estimate accuracy, and convergence in LDS models using empirical simulations. Results indicated that for a time structure with a true time metric where participants had different starting points and unequally spaced intervals, LDS models fit with a restructured and less informative time metric resulted in biased parameter estimates. However, models examined using the true time metric were less likely to converge than models using the restructured time metric, likely due to missing data. Where participants had different starting points but equally spaced intervals, LDS models fit with a restructured time metric resulted in biased estimates of intercept means, but all other parameter estimates were unbiased, and models examined using the true time metric had less convergence than the restructured time metric as well due to missing data. The findings of this study support prior research on time metric in longitudinal models, and further research should examine these findings under alternative conditions. The importance of these findings for substantive researchers is discussed.
ContributorsO'Rourke, Holly P (Author) / Grimm, Kevin J. (Thesis advisor) / Mackinnon, David P (Thesis advisor) / Chassin, Laurie (Committee member) / Aiken, Leona S. (Committee member) / Arizona State University (Publisher)
Created2016
Description
Interpersonal strain is linked with depressive symptoms in middle-aged adults. Self-compassion is an emerging resilience construct that may be advantageous in navigating relationship strain by helping individuals respond to emotions in a kind and nonjudgmental way. Although theory and empirical evidence suggests that self-compassion is protective against the impact of stress on mental health outcomes, many studies have not investigated how self-compassion operates in the context of relationship strain. In addition, few studies have examined psychological or physiological mechanisms by which self-compassion protects against mental health outcomes, depression in particular. Thus, this study examined 1) the extent to which trait self-compassion buffers the relation between family strain and depressive symptoms, and 2) whether these buffering effects are mediated by hope and inflammatory processes (IL-6) in a sample of 762 middle-aged, community-dwelling adults. Results from structural equation models indicated that family strain was unrelated to depressive symptoms and the relation was not moderated by self-compassion. Hope, but not IL-6, mediated the relation between family strain and depressive symptoms and the indirect effect was not conditional on levels of self-compassion. Taken together, the findings suggest that family strain may lead individuals to experience less hope and subsequent increases in depressive symptoms, and further, that a self-compassionate attitude does not affect this relation. Implications for future self-compassion interventions are discussed.
ContributorsMistretta, Erin (Author) / Davis, Mary C. (Thesis advisor) / Karoly, Paul (Committee member) / Infurna, Frank (Committee member) / Arizona State University (Publisher)
Created2019
Description
Lifespan psychological perspectives have long suggested the context in which individuals live having the potential to shape the course of development across the adult lifespan. Thus, it is imperative to examine the role of both the objective and subjective neighborhood context in mitigating the consequences of lifetime adversity on mental and physical health. To address the research questions, data was used from a sample of 362 individuals in midlife who were assessed on lifetime adversity, multiple outcomes of mental and physical health and aspects of the objective and subjective neighborhood. Results showed that reporting more lifetime adversity was associated with poorer mental and physical health. Aspects of the objective and subjective neighborhood, such as green spaces moderated these relationships. The discussion focuses on potential mechanisms underlying why objective and subjective indicators of the neighborhood are protective against lifetime adversity.
ContributorsStaben, Omar E (Author) / Infurna, Frank J. (Thesis advisor) / Luthar, Suniya S. (Committee member) / Grimm, Kevin J. (Committee member) / Arizona State University (Publisher)
Created2019