Matching Items (8)
Filtering by
- All Subjects: instructional design
- Creators: Nelson, Brian
- Member of: Theses and Dissertations
- Member of: ASU Electronic Theses and Dissertations
Description
The purpose of this study was to investigate the effects of instructor response prompts and rubrics on students' performance in an asynchronous discussion-board assignment, their learning achievement on an objective-type posttest, and their reported satisfaction levels. Researchers who have studied asynchronous computer-mediated student discussion transcripts have found evidence of mostly mid-level critical thinking skills, with fewer examples limited to lower or higher order thinking skill demonstration. Some researchers suggest that instructors may facilitate increased demonstration of higher-order critical thinking skills within asynchronous discussion-board activities. However, there is little empirical evidence available to compare the use of different external supports to facilitate students' critical thinking skills performance and learning achievement in blended learning environments. Results of the present study indicate that response prompts and rubrics can affect students' discussion performance, learning, and satisfaction ratings. The results, however, are complex, perhaps mirroring the complexity of instructor-led online learning environments. Regarding discussion board performance, presenting students with a rubric tended to yield higher scores on most aspects that is, on overall performance, as well as depth and breadth of performance, though these differences were not significant. In contrast, instructor prompts tended to yield lower scores on aspects of discussion board performance. On breadth, in fact, this main effect difference was significant. Interactions also indicated significant differences on several aspects of discussion board performance, in most cases indicating that the combination of rubric and prompt was detrimental to scores. The learning performance on the quiz showed, again, the effectiveness of rubrics, with students who received the rubric earning significantly higher scores, and with no main effects or interactions for instructor prompts. Regarding student satisfaction, again, the picture is complicated. Results indicated that, in some instances, the integration of prompts resulted in lower satisfaction ratings, particularly in the areas of students' perceptions of the amount of work required, learning in the partially online format, and student-to-student interaction. Based on these results, design considerations to support rubric use and explicit feedback in asynchronous discussions to support student learning are proposed.
ContributorsGiacumo, Lisa (Author) / Savenye, Wilhelmina (Thesis advisor) / Nelson, Brian (Committee member) / Legacy, Jane (Committee member) / Bitter, Gary (Committee member) / Arizona State University (Publisher)
Created2012
Description
This research study investigated the effects of high fidelity graphics on both learning and presence, or the "sense of being there," inside a Virtual Learning Environment (VLE). Four versions of a VLE on the subject of the element mercury were created, each with a different combination of high and low fidelity polygon models and high and low fidelity shaders. A total of 76 college age (18+ years of age) participants were randomly assigned to one of the four conditions. The participants interacted with the VLE and then completed several posttest measures on learning, presence, and attitudes towards the VLE experience. Demographic information was also collected, including age, computer gameplay experience, number of virtual environments interacted with, gender and time spent in this virtual environment. The data was analyzed as a 2 x 2 between subjects ANOVA.
The main effects of shader fidelity and polygon fidelity were both non- significant for both learning and all presence subscales inside the VLE. In addition, there was no significant interaction between shader fidelity and model fidelity. However, there were two significant results on the supplementary variables. First, gender was found to have a significant main effect on all the presence subscales. Females reported higher average levels of presence than their male counterparts. Second, gameplay hours, or the number of hours a participant played computer games per week, also had a significant main effect on participant score on the learning measure. The participants who reported playing 15+ hours of computer games per week, the highest amount of time in the variable, had the highest score as a group on the mercury learning measure while those participants that played 1-5 hours per week had the lowest scores.
The main effects of shader fidelity and polygon fidelity were both non- significant for both learning and all presence subscales inside the VLE. In addition, there was no significant interaction between shader fidelity and model fidelity. However, there were two significant results on the supplementary variables. First, gender was found to have a significant main effect on all the presence subscales. Females reported higher average levels of presence than their male counterparts. Second, gameplay hours, or the number of hours a participant played computer games per week, also had a significant main effect on participant score on the learning measure. The participants who reported playing 15+ hours of computer games per week, the highest amount of time in the variable, had the highest score as a group on the mercury learning measure while those participants that played 1-5 hours per week had the lowest scores.
ContributorsHorton, Scott (Author) / Nelson, Brian (Thesis advisor) / Savenye, Wilhelmina (Committee member) / Atkinson, Robert (Committee member) / Arizona State University (Publisher)
Created2014
Description
The overall purpose of this study was to explore the dynamics of teaching and learning in the context of an informal, online discussion forum. This investigation utilized the Community of Inquiry (CoI) elements of Teaching Presence and Social Presence along with the construct of Learning Presence to examine Adobe® Forums, Photoshop® for Beginners Forum (PfBF) an internet discussion forum designed to provide support for beginning users of Adobe Photoshop. The researcher collected four days of discussion post data comprising 62 discussion threads for a total of 202 discussion posts. During this initial pilot analysis, the discussion threads were divided into posts created by members who were deemed to be acting as teachers and posts written by members acting as learners. Three analyses were conducted. First, a pilot analysis was conducted where the researcher divided the data in half and coded 31 discussion threads and a total of 142 discussion posts with the Teaching Presence, Social Presence and Learning Presence coding schemes. Second, a reliability analysis was conducted to determine the interrater reliability of the coding schemes. For this analysis two additional coders were recruited, trained and coded a small subsample of data (4 discussion threads for a total of 29 discussion posts) using the same three coding schemes. Third, a final analysis was conducted where the researcher coded and analyzed 134 discussion posts created by 24 teachers using the Teaching Presence coding scheme. At the conclusion of the final analysis, it was determined that eighteen percent (18%) of the data could not be coded using the Teaching Presence coding scheme. However, this data were observed to contain behavioral indicators of Social Presence. Consequently, the Social Presence coding scheme was used to code and analyze the remaining data. The results of this study revealed that forum members who interact on PfBF do indeed exhibit Teaching Presence behaviors. Direct Instruction was the largest category of Teaching Presence behaviors exhibited, over and above Facilitating Discussion and Design and Organization. It was also observed that forum members serving in the role of teachers exhibit behaviors of Social Presence alongside Teaching Presence behaviors.
ContributorsWilliams, Indi Marie (Author) / Gee, Elizabeth (Thesis advisor) / Olaniran, Bolanle (Committee member) / Nelson, Brian (Committee member) / Arizona State University (Publisher)
Created2014
Description
The problem under investigation was to determine if a specific outline-style learning guide, called a Learning Agenda (LA), can improve a college algebra learning environment and if learner control can reduce the cognitive effort associated with note-taking in this instance. The 192 participants were volunteers from 47 different college algebra and pre-calculus classes at a community college in the southwestern United States. The approximate demographics of this college as of the academic year 2016 – 2017 are as follows: 53% women, 47% men; 61% ages 24 and under, 39% 25 and over; 43% Hispanic/Latino, 40% White, 7% other. Participants listened to an approximately 9-minute video lecture on solving a logarithmic equation. There were four dependent variables: encoding as measured by a posttest – pretest difference, perceived cognitive effort, attitude, and notes-quality/quantity. The perceived cognitive effort was measured by a self-reported questionnaire. The attitude was measured by an attitude survey. The note-quality/quantity measure included three sub-measures: expected mathematical expressions, expected phrases, and a total word count. There were two independent factors: note-taking method and learner control. The note-taking method had three levels: the Learning Agenda (LA), unguided note-taking (Usual), and no notes taken. The learner control factor had two levels: pausing allowed and pausing not allowed. The LA resulted in significantly improved notes on all three sub-measures (adjusted R2 = .298). There was a significant main effect of learner control on perceived cognitive effort with higher perceived cognitive effort occurring when pausing was not allowed and notes were taken. There was a significant interaction effect of the two factors on the attitude survey measure. The trend toward an improved attitude in both of the note-taking levels of the note-taking factor when pause was allowed was reversed in the no notes level when pausing was allowed. While significant encoding did occur as measured by the posttest – pretest difference (Cohen’s d = 1.81), this measure did not reliably vary across the levels of either the note-taking method factor or the learner control factor in this study. Interpretations were in terms of cognitive load management, split-attention, instructional design, and note-taking as a sense-making opportunity.
ContributorsTarr, Julie Charlotte (Author) / Nelson, Brian (Thesis advisor) / Atkinson, Robert (Committee member) / Savenye, Wilhelmina (Committee member) / Arizona State University (Publisher)
Created2018
Description
The purpose of this study was to investigate the effects of static pedagogical agents (included and excluded) and gamification practice (included and excluded) on vocabulary acquisition and perceptions of cognitive load by junior high students who studied Navajo
language via computer-based instructional program. A total of 153 students attending a junior high school in the southwestern United States were the participants for this study. Prior to the beginning of the study, students were randomly assigned to one of four
treatment groups who used a Navajo language computer-based program that contained a combination of static pedagogical agent (included and excluded) and gamification practice (included and excluded). There were two criterion measures in this study, a
vocabulary acquisition posttest and a survey designed both to measure students’ attitudes toward the program and to measure cognitive load. Anecdotal observations of students’ interactions were also examined.
Results indicated that there were no significant differences in posttest scores among treatment conditions; students were, however, generally successful in learning the Navajo vocabulary terms. Participants also reported positive attitudes toward the Navajo
language content and gamification practice and expressed a desire to see additional content and games during activities of this type. These findings provide evidence of the impact that computer-based training may have in teaching students an indigenous second
language. Furthermore, students seem to enjoy this type of language learning program. Many also indicated that, while static agent was not mentioned, gamification practice may enhance students’ attitudes in such instruction and is an area for future research.
Language learning programs could include a variety of gamification practice activities to assist student to learn new vocabulary. Further research is needed to study motivation and cognitive load in Navajo language computer-based training.
language via computer-based instructional program. A total of 153 students attending a junior high school in the southwestern United States were the participants for this study. Prior to the beginning of the study, students were randomly assigned to one of four
treatment groups who used a Navajo language computer-based program that contained a combination of static pedagogical agent (included and excluded) and gamification practice (included and excluded). There were two criterion measures in this study, a
vocabulary acquisition posttest and a survey designed both to measure students’ attitudes toward the program and to measure cognitive load. Anecdotal observations of students’ interactions were also examined.
Results indicated that there were no significant differences in posttest scores among treatment conditions; students were, however, generally successful in learning the Navajo vocabulary terms. Participants also reported positive attitudes toward the Navajo
language content and gamification practice and expressed a desire to see additional content and games during activities of this type. These findings provide evidence of the impact that computer-based training may have in teaching students an indigenous second
language. Furthermore, students seem to enjoy this type of language learning program. Many also indicated that, while static agent was not mentioned, gamification practice may enhance students’ attitudes in such instruction and is an area for future research.
Language learning programs could include a variety of gamification practice activities to assist student to learn new vocabulary. Further research is needed to study motivation and cognitive load in Navajo language computer-based training.
ContributorsShurley, Kenneth Alessandro (Author) / Savenye, Wilhelmina C (Thesis advisor) / Atkinson, Robert (Committee member) / Nelson, Brian (Committee member) / Arizona State University (Publisher)
Created2018
Description
Museum evaluation is an important process that aims to study an exhibit's effectiveness in engaging visitors and in teaching concepts. Imperatives and methods to strengthen museum evaluation have been suggested and implemented in the past, but ultimately faced several challenges including the collection of visitor feedback in an efficient, non-intrusive way. The Ask Dr. Discovery project seeks to address the challenge of conducting efficient, affordable, and large-scale science museum evaluation via an interactive app aimed at collecting direct visitor feedback through use of the app and through questionnaires that also collect demographics. This thesis investigates how the demographics of metro Phoenix science museum visitors as a whole compare to the Hispanic/Latino population of visitors, and makes use of visitor feedback from Ask Dr. Discovery to provide useful data for science museum evaluation. An analysis of responses revealed that the majority of the participants in the study (n=785) were White (Non-Hispanic) (65.59%), were 36-45 years old (36.18%) and hold a graduate degree (27.64%). Most Hispanic/Latino participants in the study were 26-35 years old (36.36%) and completed some college (28.67%). Most participants from both participant groups have never visited the museum before (32.99% of all participants; 33.57% of all Hispanics/Latinos). Further analysis suggest that museum visits may be independent of age and visitor group size. Visitor interest in science museum exhibits may be independent of their use of free time science-related activities. Data suggests that there was no real difference in exhibit interest across two different versions of the app ("modes"). Analysis of negative visitor feedback showed different question types, questions asked, and time spent on the app. Data log questions revealed the difference in time spent on the app and complexity of questions asked between adults and children, as well as the location of participants in the museum. There was no major correlation between mode type and number of questions asked, and length of use and number of questions asked.
ContributorsFernandez, Ivan (Author) / Bowman, Judd (Thesis director) / Bowman, Catherine (Committee member) / Nelson, Brian (Committee member) / School of Life Sciences (Contributor) / Barrett, The Honors College (Contributor)
Created2016-12
Web-Based Programming Grading Assistant: An Investigation of the Role of Students Reviewing Behavior
Description
Paper assessment remains to be an essential formal assessment method in today's classes. However, it is difficult to track student learning behavior on physical papers. This thesis presents a new educational technology—Web Programming Grading Assistant (WPGA). WPGA not only serves as a grading system but also a feedback delivery tool that connects paper-based assessments to digital space. I designed a classroom study and collected data from ASU computer science classes. I tracked and modeled students' reviewing and reflecting behaviors based on the use of WPGA. I analyzed students' reviewing efforts, in terms of frequency, timing, and the associations with their academic performances. Results showed that students put extra emphasis in reviewing prior to the exams and the efforts demonstrated the desire to review formal assessments regardless of if they were graded for academic performance or for attendance. In addition, all students paid more attention on reviewing quizzes and exams toward the end of semester.
ContributorsHuang, Po-Kai (Author) / Hsiao, I-Han (Thesis advisor) / Nelson, Brian (Committee member) / VanLehn, Kurt (Committee member) / Arizona State University (Publisher)
Created2017
Description
Research suggests there is no significant difference in outcomes for online learners and on-campus learners. Several decades of online learning have also consistently demonstrated online students are less likely to persist than those students attending on campus. The Community of Inquiry (CoI) framework describes social presence, teaching presence, and cognitive presence as components of a quality online learning experience, and research links these three constructs to student retention. Using the lens of the CoI framework, this mixed methods action research study sought to increase social presence and teaching presence in asynchronous online courses at Davenport University using embedded video feedback mechanisms, in support of student persistence and retention. The Community of Inquiry survey instrument was used to quantitatively measure the changes in social presence and teaching presence between courses with and without the video feedback mechanisms. Qualitative research interviews were conducted to probe for meaning and a greater understanding of both student and instructor experiences in the courses. Results of the study indicated small but significant gains in teaching presence, but other quantitative measures showed no changes with the introduction of the videos. Qualitative analysis suggests that students who watched the instructor videos reported higher levels of teaching presence for several subconstructs of teaching presence and social presence. However, the qualitative analysis also suggested that many students did not watch the instructor videos, and thus did not benefit from any increased presence. Student discussion response videos yielded similar results qualitatively, with benefits demonstrated by those students who watched the videos but none by those who abstained.
ContributorsMiller, Brian John-Suydam (Author) / Salik, Steve (Thesis advisor) / Nelson, Brian (Committee member) / Nyambane, Gerald (Committee member) / Arizona State University (Publisher)
Created2022