Matching Items (2)
Description
The current study explores the extent to which literacy game performance can be used to assess reading comprehension skill and vocabulary knowledge. Standardized reading assessments have the benefit of years of validation across different age groups and reading comprehension levels, allowing teachers to evaluate students’ reading performance and relate it to a national standard. However, these assessments reduce classroom time for learning activities, which may be more authentic indicators of student progress. Students’ reading skills can be measured during learning activities by using game-based stealth assessment of literacy. Game-based assessment may be more enjoyable and less likely to invoke test anxiety than traditional assessments, but enjoyment may also impact the validity of the assessment. The current study recruited participants (n=405) to play five literacy games: CON-Artist, Paraphrase Quest, Fix It, Map Conquest, and Vocab Flash. Students also completed the Gates-MacGinitie Reading Test (GMRT), which serves as a validated measure of reading comprehension skill and vocabulary knowledge. Students answered enjoyment questions after each game and the GMRT, and they completed the Cognitive Test Anxiety questionnaire, which measures trait-level negative thoughts about test-taking. The results indicate that Vocab Flash predicted 31% of variance in reading comprehension and 21% of variance in vocabulary knowledge. The other games were not predictive beyond Vocab Flash, but each of them was weakly correlated with reading comprehension skill and vocabulary knowledge. Three games were more enjoyable than GMRT Reading Comprehension, but no games were more enjoyable than GMRT Vocabulary. Cognitive Test Anxiety was negatively correlated with the GMRT and Vocab Flash, but not with the other games. Game enjoyment moderated the relationship between game performance and reading skill, albeit in differing directions. Paraphrase Quest was less predictive of reading comprehension for students who enjoyed the game, and Vocab Flash was more predictive of reading comprehension for those who enjoyed the game. The findings of this study suggest that a simple vocabulary game can be used to measure reading comprehension skill and vocabulary knowledge. Future research is needed to better understand how game-based assessments can be designed to minimize the effects of test anxiety and enjoyment on performance.
ContributorsChristhilf, Katerina (Author) / McNamara, Danielle S (Thesis advisor) / Roscoe, Rod (Committee member) / Brewer, Gene (Committee member) / Arizona State University (Publisher)
Created2023
Description
The current study explores the extent to which different processing strategies affect comprehension accuracy and integration of information across multiple texts. Reading comprehension of single texts is a difficult task, in which the challenges are compounded by the need to integrate information across texts. Processing strategies, such as self-explanation and source-evaluation, help reduce the challenges that readers face when attempting to comprehend texts. Self-explanation has been a successful strategy for coherence-building processes in single text comprehension, but the benefits for supporting inter-textual comprehension have not yet been explored. Source-evaluation supports identification of different sources, which helps resolve inconsistencies between texts; yet it remains unclear whether sourcing alone supports comprehension within as well as between texts. Think-aloud is a strategy intended to encourage further processing of the text without providing any explicit comprehension strategy. The differences between these two strategies prompts questions regarding the adequacy of either strategy for supporting inferencing and integration within and across texts. In this study, participants (n=80) were randomly assigned to one of three strategy conditions: self-explanation, source-evaluation, or think-aloud. Students read four texts after which they completed three types of open-ended comprehension questions (i.e., textbase, intra-textual inference, and inter-textual inference), a source memory task, and individual difference measures. Prior knowledge and reading skill were strongly correlated (r = .65) and showed moderate correlations (r = .31 to .60) with participants’ comprehension accuracy, total number of integrations within their responses, and their memory for sources. Participants were more likely to respond accurately and demonstrate integrations across texts for the text-based questions in comparison to the more challenging inference questions. There was a marginal effect of condition on comprehension question accuracy, wherein participants who self-explained responded more accurately than those who engaged in the think-aloud task. In addition, those in the self-explanation or source-evaluation conditions recalled more sources than those in the think-aloud condition. There were no significant differences in performance between the self-explanation and the source-evaluation conditions. Overall, the results of this study indicate that encouraging students to self-explain and/or evaluate sources while they read multiple documents enhances comprehension and memory for sources.
ContributorsPerret, Cecile Aline (Author) / McNamara, Danielle S (Thesis advisor) / Brewer, Gene (Committee member) / Glenberg, Arthur (Committee member) / Arizona State University (Publisher)
Created2021