Matching Items (2)
Filtering by

Clear all filters

Description
As the application of interactive media systems expands to address broader problems in health, education and creative practice, they fall within a higher dimensional space for which it is inherently more complex to design. In response to this need an emerging area of interactive system design, referred to as experiential

As the application of interactive media systems expands to address broader problems in health, education and creative practice, they fall within a higher dimensional space for which it is inherently more complex to design. In response to this need an emerging area of interactive system design, referred to as experiential media systems, applies hybrid knowledge synthesized across multiple disciplines to address challenges relevant to daily experience. Interactive neurorehabilitation (INR) aims to enhance functional movement therapy by integrating detailed motion capture with interactive feedback in a manner that facilitates engagement and sensorimotor learning for those who have suffered neurologic injury. While INR shows great promise to advance the current state of therapies, a cohesive media design methodology for INR is missing due to the present lack of substantial evidence within the field. Using an experiential media based approach to draw knowledge from external disciplines, this dissertation proposes a compositional framework for authoring visual media for INR systems across contexts and applications within upper extremity stroke rehabilitation. The compositional framework is applied across systems for supervised training, unsupervised training, and assisted reflection, which reflect the collective work of the Adaptive Mixed Reality Rehabilitation (AMRR) Team at Arizona State University, of which the author is a member. Formal structures and a methodology for applying them are described in detail for the visual media environments designed by the author. Data collected from studies conducted by the AMRR team to evaluate these systems in both supervised and unsupervised training contexts is also discussed in terms of the extent to which the application of the compositional framework is supported and which aspects require further investigation. The potential broader implications of the proposed compositional framework and methodology are the dissemination of interdisciplinary information to accelerate the informed development of INR applications and to demonstrate the potential benefit of generalizing integrative approaches, merging arts and science based knowledge, for other complex problems related to embodied learning.
ContributorsLehrer, Nicole (Author) / Rikakis, Thanassis (Committee member) / Olson, Loren (Committee member) / Wolf, Steven L. (Committee member) / Turaga, Pavan (Committee member) / Arizona State University (Publisher)
Created2014
156092-Thumbnail Image.png
Description
Guitar Hero III and similar games potentially offer a vehicle for improvement of musical rhythmic accuracy with training delivered in both visual and auditory formats and by use of its novel guitar-shaped interface; however, some theories regarding multimedia learning suggest sound is a possible source of extraneous cognitive load while

Guitar Hero III and similar games potentially offer a vehicle for improvement of musical rhythmic accuracy with training delivered in both visual and auditory formats and by use of its novel guitar-shaped interface; however, some theories regarding multimedia learning suggest sound is a possible source of extraneous cognitive load while playing so players may score higher with sound turned off. Also, existing studies have shown that differences in the physical format of interfaces affect learning outcomes. This study sought to determine whether (a) the game’s audio content affects rhythmic accuracy, and (b) the type of game controller used affects learning of rhythmic accuracy. One hundred participants were randomly assigned in approximately equal numbers (ns = 25) to the four cells of a 2x2 between-subjects design. The first variable was the audio content of the game with two levels: on or off. The second variable was the type of game controller: the standard guitar-style controller or tablet interface. Participants across all conditions completed a pre- and post-test with a system that required them to tap along with repeated rhythmic patterns on an electronic drum pad. Statistical evidence showed better outcomes with a tablet controller with respect to input time error, reduction of extra notes played, and reduction of missed notes; however, the guitar-style controller produced superior outcomes in terms of avoiding missed notes and was associated with higher satisfaction by participants. When audio was present better outcomes were achieved at multiple factor-levels of reduction of missed responses, but superior outcomes in input time error were seen without audio. There was no evidence to suggest an interaction between controller type and the presence or absence of audio.
ContributorsThomas, James William (Author) / Zuiker, Steven J (Thesis advisor) / Atkinson, Robert (Thesis advisor) / Savenye, Wilhelmina C (Committee member) / Arizona State University (Publisher)
Created2017