Matching Items (44)
Description
This simulation study compared the utility of various discrepancy measures within a posterior predictive model checking (PPMC) framework for detecting different types of data-model misfit in multidimensional Bayesian network (BN) models. The investigated conditions were motivated by an applied research program utilizing an operational complex performance assessment within a digital-simulation educational context grounded in theories of cognition and learning. BN models were manipulated along two factors: latent variable dependency structure and number of latent classes. Distributions of posterior predicted p-values (PPP-values) served as the primary outcome measure and were summarized in graphical presentations, by median values across replications, and by proportions of replications in which the PPP-values were extreme. An effect size measure for PPMC was introduced as a supplemental numerical summary to the PPP-value. Consistent with previous PPMC research, all investigated fit functions tended to perform conservatively, but Standardized Generalized Dimensionality Discrepancy Measure (SGDDM), Yen's Q3, and Hierarchy Consistency Index (HCI) only mildly so. Adequate power to detect at least some types of misfit was demonstrated by SGDDM, Q3, HCI, Item Consistency Index (ICI), and to a lesser extent Deviance, while proportion correct (PC), a chi-square-type item-fit measure, Ranked Probability Score (RPS), and Good's Logarithmic Scale (GLS) were powerless across all investigated factors. Bivariate SGDDM and Q3 were found to provide powerful and detailed feedback for all investigated types of misfit.
ContributorsCrawford, Aaron (Author) / Levy, Roy (Thesis advisor) / Green, Samuel (Committee member) / Thompson, Marilyn (Committee member) / Arizona State University (Publisher)
Created2014
Description
Research regarding social competence is growing rapidly, but there remain a few aspects of social development that merit more attention. The presented pair of studies were planned to address two such areas in the social development literature, specifically the longitudinal trajectories of social competence and the role of social competence in second language development in language minority (LM) students. The goal of the first investigation was to examine the developmental trends of interpersonal skills (IS) across the early childhood and elementary school years in a nationally representative, U.S. sample. The goal of the second study was to examine whether differing trajectories of IS development in language minority children in the U.S. were related to their language and literacy (LL) skills at grade 5. Both studies utilized data from the Early Childhood Longitudinal Study - Kindergarten Class of 1998-1999 and modeled ratings of children's IS at five time points between fall of kindergarten and spring of fifth grade using latent class growth analyses in Mplus. In study 1, the best model was a quadratic two-class latent class growth analysis. Trajectory class 1 was a higher-level path with a marginally significant non-linear shape and class 2 was a primarily stable, moderate level path with a slight, non-significant increase over time. The same pattern of results emerged for both boys and girls separately as with the combined-sex model, and in all three final models the proportion of the sample in the higher-level class was greater than the moderate-level class. In study 2 a sample of U.S. children whose primary language at home was something other than English was utilized. LL at the start of kindergarten and sex were included as covariates and LL in fifth grade as a distal outcome. The best model for the data was a cubic two-class latent class growth analysis. Class 1 followed a higher-level path with small, incremental change over time and class 2 was a moderate-level path with greater undulation. Both covariates significantly predicted latent class and language and literacy scores at grade 5 differed significantly across classes.
ContributorsDiDonato, Alicia (Author) / Wilcox, M. Jeanne (Thesis advisor) / Bradley, Robert (Committee member) / Wilkens, Natalie (Committee member) / Valiente, Carlos (Committee member) / Arizona State University (Publisher)
Created2014
Description
The measurement of competency in nursing is critical to ensure safe and effective care of patients. This study had two purposes. First, the psychometric characteristics of the Nursing Performance Profile (NPP), an instrument used to measure nursing competency, were evaluated using generalizability theory and a sample of 18 nurses in the Measuring Competency with Simulation (MCWS) Phase I dataset. The relative magnitudes of various error sources and their interactions were estimated in a generalizability study involving a fully crossed, three-facet random design with nurse participants as the object of measurement and scenarios, raters, and items as the three facets. A design corresponding to that of the MCWS Phase I data--involving three scenarios, three raters, and 41 items--showed nurse participants contributed the greatest proportion to total variance (50.00%), followed, in decreasing magnitude, by: rater (19.40%), the two-way participant x scenario interaction (12.93%), and the two-way participant x rater interaction (8.62%). The generalizability (G) coefficient was .65 and the dependability coefficient was .50. In decision study designs minimizing number of scenarios, the desired generalizability coefficients of .70 and .80 were reached at three scenarios with five raters, and five scenarios with nine raters, respectively. In designs minimizing number of raters, G coefficients of .72 and .80 were reached at three raters and five scenarios and four raters and nine scenarios, respectively. A dependability coefficient of .71 was attained with six scenarios and nine raters or seven raters and nine scenarios. Achieving high reliability with designs involving fewer raters may be possible with enhanced rater training to decrease variance components for rater main and interaction effects. The second part of this study involved the design and implementation of a validation process for evidence-based human patient simulation scenarios in assessment of nursing competency. A team of experts validated the new scenario using a modified Delphi technique, involving three rounds of iterative feedback and revisions. In tandem, the psychometric study of the NPP and the development of a validation process for human patient simulation scenarios both advance and encourage best practices for studying the validity of simulation-based assessments.
ContributorsO'Brien, Janet Elaine (Author) / Thompson, Marilyn (Thesis advisor) / Hagler, Debra (Thesis advisor) / Green, Samuel (Committee member) / Arizona State University (Publisher)
Created2014
Description
The current study delineated the developmental trajectories of early childhood externalizing and internalizing symptoms reported by mothers and fathers, and examined the role of the 18-month observed parenting quality × Respiratory Sinus Arrhythmia
(RSA) interaction in predicting these trajectories. Child sex was tested as a covariate and moderator. It was found that children's low baseline RSA or high RSA reactivity , in comparison to high baseline RSA or low RSA reactivity , was more reactive as a function
of early parenting quality when predicting the development of early childhood problem symptoms. Differential patterns of the interaction between parenting quality and RSA were detected for mothers' and fathers' reports. Mother-reported models showed a diathesis-stress pattern, whereas the father-reported model showed a vantage-sensitivity pattern, especially for internalizing symptoms. This may imply the potential benefit of fathers' active engagement in children's early development. In addition, the effect of the parenting quality × RSA interaction in predicting the mother-reported models was found
to be further moderated by child sex. Specifically, the parenting quality × baseline RSA interaction was significantly predictive of girls' 54-month internalizing, and the parenting quality × RSA reactivity interaction significantly predicted boys' internalizing slope. Girls with low baseline RSA or boys with high RSA reactivity were vulnerable to the less positive parenting, exhibiting high levels of 54-month internalizing symptoms or slow decline in internalizing over time, respectively. Future research directions were discussed in terms of integrating the measures of SNS and PNS in psychopathology study,
exploring the mechanisms underlying the sex difference in parenting quality × RSA interaction, and comparing the findings of children's typical and atypical development.
(RSA) interaction in predicting these trajectories. Child sex was tested as a covariate and moderator. It was found that children's low baseline RSA or high RSA reactivity , in comparison to high baseline RSA or low RSA reactivity , was more reactive as a function
of early parenting quality when predicting the development of early childhood problem symptoms. Differential patterns of the interaction between parenting quality and RSA were detected for mothers' and fathers' reports. Mother-reported models showed a diathesis-stress pattern, whereas the father-reported model showed a vantage-sensitivity pattern, especially for internalizing symptoms. This may imply the potential benefit of fathers' active engagement in children's early development. In addition, the effect of the parenting quality × RSA interaction in predicting the mother-reported models was found
to be further moderated by child sex. Specifically, the parenting quality × baseline RSA interaction was significantly predictive of girls' 54-month internalizing, and the parenting quality × RSA reactivity interaction significantly predicted boys' internalizing slope. Girls with low baseline RSA or boys with high RSA reactivity were vulnerable to the less positive parenting, exhibiting high levels of 54-month internalizing symptoms or slow decline in internalizing over time, respectively. Future research directions were discussed in terms of integrating the measures of SNS and PNS in psychopathology study,
exploring the mechanisms underlying the sex difference in parenting quality × RSA interaction, and comparing the findings of children's typical and atypical development.
ContributorsLi, Yi (Author) / Eisenberg, Nancy (Thesis advisor) / Spinrad, Tracy (Thesis advisor) / Lemery-Chalfant, Kathryn (Committee member) / Wilkens, Natalie (Committee member) / Arizona State University (Publisher)
Created2014
Description
In two separate publications, the average patterns of, and individual differences in, preschoolers' selective attention processes were investigated using a multilevel modeling framework. In Publication 1, using two independent samples (Ns= 42, 75), preschoolers' selective attention towards different types of emotions (both positive and negative) was examined using two eye-tracking tasks. The results showed that, on average, children selectively attended to valenced emotional information more than neutral emotional information. In addition, a majority of children were able to detect the different emotional stimulus among three neutral stimuli during the visual search task. Children were more likely to detect angry than sad emotional expressions among neutral faces; however, no difference was found between detection of angry and happy faces among neutral faces. In Publication 2, the associations of children's anger and sadness proneness to their attention biases towards anger and sad emotional information, respectively, and the relations of these biases to various aspects children's social functioning and adjustment were examined among preschool-aged children (N = 75). Children's predisposition to anger and sadness were shown to be related to attentional biases towards those specific emotions, particularly if children lacked the ability to regulate their attention. Similarly, components of attention regulation played an important role in moderating the associations of biases towards angry information to aggressive behaviors, social competence, and anxiety symptoms. Biases towards sadness were unrelated to maladjustment or social functioning. Findings were discussed in terms of the importance of attention biases and attention regulation as well as the implications of the findings for attention training programs.
ContributorsSeyed Nozadi, Sara (Author) / Spinrad, Tracy L. (Thesis advisor) / Eisenberg, Nancy (Committee member) / Johnson, Scott (Committee member) / Thompson, Marilyn (Committee member) / Arizona State University (Publisher)
Created2014
Description
Institutions of higher education often tout that they are developing students to become lifelong learners. Evaluative efforts in this area have been presumably hindered by the lack of a uniform conceptualization of lifelong learning. Lifelong learning has been defined from institutional, economic, socio-cultural, and pedagogical perspectives, among others. This study presents the existing operational definitions and theories of lifelong learning in the context of higher education and synthesizes them to propose a unified model of college students' orientation toward lifelong learning. The model theorizes that orientation toward lifelong learning is a latent construct which manifests as students' likelihood to engage in four types of learning activities: formal work-related activities, informal work-related activities, formal personal interest activities, and informal personal interest activities. The Postsecondary Orientation toward Lifelong Learning scale (POLL) was developed and the validity of the resulting score interpretations was examined. The instrument was used to compare potential differences in orientation toward lifelong learning between freshmen and seniors. Exploratory factor analyses of the responses of 138 undergraduate college students in the pilot study data provided tentative support for the factor structure within each type of learning activity. Guttman's <λ>λ2 estimates of the learning activity subscales ranged from .78 to .85. Follow-up confirmatory factor analysis using structural equation modeling did not corroborate support for the hypothesized four-factor model using the main student sample data of 405 undergraduate students. Several alternative reflective factor structures were explored. A two-factor model representing factors for Instructing/Presenting and Reading learning activities produced marginal model-data fit and warrants further investigation. The summed POLL total scores had a relatively strong positive correlation with global interest in learning (.58), moderate positive correlations with civic engagement and participation (.38) and life satisfaction (.29), and a small positive correlation with social desirability (.15). The results of the main study do not provide support for the malleability of postsecondary students' orientation toward lifelong learning, as measured by the summed POLL scores. The difference between freshmen and seniors' average total POLL scores was not statistically significant and was negligible in size.
ContributorsArcuria, Phil (Author) / Thompson, Marilyn (Thesis advisor) / Green, Samuel (Committee member) / Levy, Roy (Committee member) / Arizona State University (Publisher)
Created2011
Description
This study investigated the internal factor structure of the English language development Assessment (ELDA) using confirmatory factor analysis. ELDA is an English language proficiency test developed by a consortium of multiple states and is used to identify and reclassify English language learners in kindergarten to grade 12. Scores on item parcels based on the standards tested from the four domains of reading, writing, listening, and speaking were used for the analyses. Five different factor models were tested: a single factor model, a correlated two-factor model, a correlated four-factor model, a second-order factor model and a bifactor model. The results indicate that the four-factor model, second-order model, and bifactor model fit the data well. The four-factor model hypothesized constructs for reading, writing, listening and speaking. The second-order model hypothesized a second-order English language proficiency factor as well as the four lower-order factors of reading, writing, listening and speaking. The bifactor model hypothesized a general English language proficiency factor as well as the four domain specific factors of reading, writing, listening, and speaking. The Chi-square difference tests indicated that the bifactor model best explains the factor structure of the ELDA. The results from this study are consistent with the findings in the literature about the multifactorial nature of language but differ from the conclusion about the factor structures reported in previous studies. The overall proficiency levels on the ELDA gives more weight to the reading and writing sections of the test than the speaking and listening sections. This study has implications on the rules used for determining proficiency levels and recommends the use of conjunctive scoring where all constructs are weighted equally contrary to current practice.
ContributorsKuriakose, Anju Susan (Author) / Macswan, Jeff (Thesis advisor) / Haladyna, Thomas (Thesis advisor) / Thompson, Marilyn (Committee member) / Arizona State University (Publisher)
Created2011
Description
Few measurement tools provide reliable, valid data on both children's emotional and behavioral engagement in school. The School Liking and Avoidance Questionnaire (SLAQ) is one such self-report measure developed to evaluate a child's degree of engagement in the school setting as it is manifest in a child's school liking and school avoidance. This study evaluated the SLAQ's dimensionality, reliability, and validity. Data were gathered on children from kindergarten through 6th grade (n=396). Participants reported on their school liking and avoidance in the spring of each school year. Scores consistently represented two distinct, yet related subscales (i.e., school liking and school avoidance) that were reliable and stable over time. Validation analyses provided some corroboration of the construct validity of the SLAQ subscales, but evidence of predictive validity was inconsistent with the hypothesized relations (i.e., early report of school liking and school avoidance did not predict later achievement outcomes). In sum, the findings from this study provide some support for the dimensionality, reliability, and validity of the SLAQ and suggest that it can be used for the assessment of young children's behavioral and emotional engagement in school.
ContributorsSmith, Jillian (Author) / Ladd, Gary W. (Thesis advisor) / Ladd, Becky (Committee member) / Thompson, Marilyn (Committee member) / Arizona State University (Publisher)
Created2011
Description
ABSTRACT This study investigated the possibility of item parameter drift (IPD) in a calculus placement examination administered to approximately 3,000 students at a large university in the United States. A single form of the exam was administered continuously for a period of two years, possibly allowing later examinees to have prior knowledge of specific items on the exam. An analysis of IPD was conducted to explore evidence of possible item exposure. Two assumptions concerning items exposure were made: 1) item recall and item exposure are positively correlated, and 2) item exposure results in the items becoming easier over time. Special consideration was given to two contextual item characteristics: 1) item location within the test, specifically items at the beginning and end of the exam, and 2) the use of an associated diagram. The hypotheses stated that these item characteristics would make the items easier to recall and, therefore, more likely to be exposed, resulting in item drift. BILOG-MG 3 was used to calibrate the items and assess for IPD. No evidence was found to support the hypotheses that the items located at the beginning of the test or with an associated diagram drifted as a result of item exposure. Three items among the last ten on the exam drifted significantly and became easier, consistent with item exposure. However, in this study, the possible effects of item exposure could not be separated from the effects of other potential factors such as speededness, curriculum changes, better test preparation on the part of subsequent examinees, or guessing.
ContributorsKrause, Janet (Author) / Levy, Roy (Thesis advisor) / Thompson, Marilyn (Thesis advisor) / Gorin, Joanna (Committee member) / Arizona State University (Publisher)
Created2012
Description
Chronic illness can affect multiple domains of functioning, yet scientific understanding of the effects across the lifespan and under multiple contexts is still developing. For instance, research consistently indicates the early years of a child's life are pivotal for early intervening to positively affect physical, cognitive, and socio-emotional development; unfortunately, the impact of chronic illnesses, and thus appropriate interventions, during this time are not well-established. Academic achievement is one area in which children with chronic illness are negatively affected and research suggests that the effects of illness can be exacerbated by certain social determinants of health and demographic characteristics; however, no recent studies have examined these relationships for children at school entry. The current study utilized the Early Childhood Longitudinal Study-Birth Cohort (ECLS-B) to examine variations in early academic readiness in reading and mathematics by diabetes status, race, and social determinants, specifically mother's education and access to early childhood education, among children born in 2001. Results of the current study indicated that children with diabetes scored lower on reading and mathematics relative to their non-diabetic peers. Significant interactions were evident for diabetes status by mother's education, race/ethnicity, and by early childhood education. Children in homes whose mothers had the lowest level of education did not score as high as children in homes with mothers who had higher levels of education. Among children without diabetes, those identified as Asian, Pacific Islander, or Native Hawaiian outperformed White, Black, Hispanic, American Indian, and multi-race groups on measures of reading and mathematics, whereas among children with diabetes, those identified as multiracial scored highest. Regardless of diabetes status, children who attended preschool outperformed those who did not, yet children without diabetes who had not attended preschool outperformed diabetic children who did receive such services. Findings support the need for targeted early intervention as preschool alone did not mitigate the effects of diabetes on academic performance.
ContributorsKucera, Miranda (Author) / Sullivan, Amanda L (Thesis advisor) / Wodrich, David (Committee member) / Thompson, Marilyn (Committee member) / Arizona State University (Publisher)
Created2012