The goal of this thesis project was to develop a digital, quantitative assessment of executive functioning skills and problem solving abilities. This assessment was intended to serve as a relative measure of executive functions and problem solving abilities rather than a diagnosis; the main purpose was to identify areas for improvement and provide individuals with an understanding of their current ability levels. To achieve this goal, we developed a web-based assessment through Unity that used gamelike modifications of Flanker, Antisaccade, Embedded Images, Raven’s Matrices, and Color / Order Memory tasks. Participants were invited to access the assessment at www.ExecutiveFunctionLevel.com to complete the assessment and their results were analyzed. The findings of this project indicate that these tasks accurately represent executive functioning skills, the Flanker Effect is present in the collected data, and there is a notable correlation between each of the REFLEX challenges. In conclusion, we successfully developed a short, gamelike, online assessment of executive functioning and problem solving abilities. Future developments of REFLEX could look into immediate scoring, developing a mobile application, and externally validating the results.
The goal of this thesis project was to develop a digital, quantitative assessment of executive functioning skills and problem solving abilities. This assessment was intended to serve as a relative measure of executive functions and problem solving abilities rather than a diagnosis; the main purpose was to identify areas for improvement and provide individuals with an understanding of their current ability levels. To achieve this goal, we developed a web-based assessment through Unity that used gamelike modifications of Flanker, Antisaccade, Embedded Images, Raven’s Matrices, and Color / Order Memory tasks. Participants were invited to access the assessment at www.ExecutiveFunctionLevel.com to complete the assessment and their results were analyzed. The findings of this project indicate that these tasks accurately represent executive functioning skills, the Flanker Effect is present in the collected data, and there is a notable correlation between each of the REFLEX challenges. In conclusion, we successfully developed a short, gamelike, online assessment of executive functioning and problem solving abilities. Future developments of REFLEX could look into immediate scoring, developing a mobile application, and externally validating the results.
Aphasia is an impairment that affects many different aspects of language and makes it more difficult for a person to communicate with those around them. Treatment for aphasia is often administered by a speech-language pathologist in a clinical setting, but researchers have recently begun exploring the potential of virtual reality (VR) interventions. VR provides an immersive environment and can allow multiple users to interact with digitized content. This exploratory paper proposes the design of a VR rehabilitation game –called Pact– for adults with aphasia that aims to improve the word-finding and picture-naming abilities of users to improve communication skills. Additionally, a study is proposed that will assess how well Pact improves the word-finding and picture-naming abilities of users when it is used in conjunction with speech therapy. If the results of the study show an increase in word-finding and picture-naming scores compared to the control group (patients receiving traditional speech therapy alone), the results would indicate that Pact can achieve its goal of promoting improvement in these domains. There is a further need to examine VR interventions for aphasia, particularly with larger sample sizes that explore the gains associated with or design issues associated with multi-user VR programs.
The study used a mixed-methods experimental design and involved a three-session VR STEM learning intervention. The quantitative data was collected through the intervention by survey questionnaire, session quiz, and pre- and post-tests, while the interviews were taken after the intervention. The structural equation modeling method was used to explore the relationships among factors in the VR learning experience. Longitudinal quantitative comparisons were conducted with the multiple imputation method. Its purpose was to evaluate the changing magnitude of factors across sessions. After quantitative analysis, interview transcripts were analyzed. They were used to triangulate or provide context for understanding of quantitative results.
The results showed that motivation and engagement play a critical mediation role in an effective VR learning experience. While individuals’ psychological responses and motivation may significantly increase in a VR learning experience for novelty, the novelty effect may not steeply decrease when individuals are becoming familiar with the novelty. This phenomenon is more observable in a VR condition having a high degree of immersion and embodiment. In addition, novelty does not necessarily increase learning achievement. The increase of learning achievement is more dependent on a match between the learning content and the learning method. The embodied learning method is appropriate for instructing difficult knowledge and spatial knowledge. Reserving enough time for reflection is important to deep learning in a VR environment.
In the United States, the word "earthquake" is extensively used. This natural disaster has a year-round impact on numerous states across the country. Earthquakes are simply more than a natural calamity; they also have a negative psychological impact. Earthquake safety measures are essential for ensuring citizens' safety. This paper proposes, a technique for evaluating earthquake safety activities and instructing individuals in selecting appropriate precautions. Earthquake protection using Reach.love plus Amazon Alexa is special in that it uses cutting-edge virtual reality technology. The platform developed by Reach.love takes earthquake prevention to a new and innovative direction. The feeling of presence in a VR headset linked within Reach.love, allows the user to feel that an earthquake is occurring right now. Additionally, each location includes audio instructions that explain what to do in specific scenarios. The user can practice and mentally train to respond appropriately when a real earthquake happens, comparable to a 3D drill. Finally, the user will be able to utilize Amazon Alexa for help within the rooms in Reach.love to improve the experience of earthquake safety training. For example, if the user speaks to Alexa during the simulation and says, "Alexa, turn off the audio instructions," Alexa will do so, and the user will no longer hear them. Alexa would be the user's personal assistant during the training of earthquake protection.
Augmented Reality (AR) especially when used with mobile devices enables the creation of applications that can help students in chemistry learn anything from basic to more advanced concepts. In Chemistry specifically, the 3D representation of molecules and chemical structures is of vital importance to students and yet when printed in 2D as on textbooks and lecture notes it can be quite hard to understand those vital 3D concepts. ARsome Chemistry is an app that aims to utilize AR to display complex and simple molecules in 3D to actively teach students these concepts through quizzes and other features. The ARsome chemistry app uses image target recognition to allow students to hand-draw or print line angle structures or chemical formulas of molecules and then scan those targets to get 3D representation of molecules. Students can use their fingers and the touch screen to zoom, rotate, and highlight different portions of the molecule to gain a better understanding of the molecule's 3D structure. The ARsome chemistry app also features the ability to utilize image recognition to allow students to quiz themselves on drawing line-angle structures and show it to the camera for the app to check their work. The ARsome chemistry app is an accessible and cost-effective study aid platform for students for on demand, interactive, 3D representations of complex molecules.
Embodiment theory proposes that knowledge is grounded in sensorimotor systems, and that learning can be facilitated to the extent that lessons can be mapped to these systems. This study with 109 college-age participants addresses two overarching questions: (a) how are immediate and delayed learning gains affected by the degree to which a lesson is embodied, and (b) how do the affordances of three different educational platforms affect immediate and delayed learning? Six 50 min-long lessons on centripetal force were created. The first factor was the degree of embodiment with two levels: (1) low and (2) high. The second factor was platform with three levels: (1) a large scale “mixed reality” immersive environment containing both digital and hands-on components called SMALLab, (2) an interactive whiteboard system, and (3) a mouse-driven desktop computer.
Pre-tests, post-tests, and 1-week follow-up (retention or delayed learning gains) tests were administered resulting in a 2 × 3 × 3 design. Two knowledge subtests were analyzed, one that relied on more declarative knowledge and one that relied on more generative knowledge, e.g., hand-drawing vectors. Regardless of condition, participants made significant immediate learning gains from pre-test to post-test. There were no significant main effects or interactions due to platform or embodiment on immediate learning. However, from post-test to follow-up the level of embodiment interacted significantly with time, such that participants in the high embodiment conditions performed better on the subtest devoted to generative knowledge questions. We posit that better retention of certain types of knowledge can be seen over time when more embodiment is present during the encoding phase. This sort of retention may not appear on more traditional factual/declarative tests. Educational technology designers should consider using more sensorimotor feedback and gestural congruency when designing and opportunities for instructor professional development need to be provided as well.
A mixed design was created using text and game-like multimedia to instruct in the content of physics. The study assessed which variables predicted learning gains after a 1-h lesson on the electric field. The three manipulated variables were: (1) level of embodiment; (2) level of active generativity; and (3) presence of story narrative. Two types of tests were administered: (1) a traditional text-based physics test answered with a keyboard; and (2) a more embodied, transfer test using the Wacom large tablet where learners could use gestures (long swipes) to create vectors and answers. The 166 participants were randomly assigned to four conditions: (1) symbols and text; (2) low embodied; (3) high embodied/active; or (4) high embodied/active with narrative. The last two conditions were active because the on-screen content could be manipulated with gross body gestures gathered via the Kinect sensor. Results demonstrated that the three groups that included embodiment learned significantly more than the symbols and text group on the traditional keyboard post-test. When knowledge was assessed with the Wacom tablet format that facilitated gestures, the two active gesture-based groups scored significantly higher. In addition, engagement scores were significantly higher for the two active embodied groups. The Wacom results suggest test sensitivity issues; the more embodied test revealed greater gains in learning for the more embodied conditions. We recommend that as more embodied learning comes to the fore, more sensitive tests that incorporate gesture be used to accurately assess learning. The predicted differences in engagement and learning for the condition with the graphically rich story narrative were not supported. We hypothesize that a narrative effect for motivation and learning may be difficult to uncover in a lab experiment where participants are primarily motivated by course credit. Several design principles for mediated and embodied science education are proposed.