Matching Items (12)
Filtering by
- All Subjects: Collaboration
- All Subjects: Educational evaluation
- Creators: Buss, Ray R
- Creators: Walker, Erin
- Status: Published
Description
Abstract Much has been researched and written concerning the structure, attributes, and benefits of the professional learning community (PLC), yet many have found that this highly collaborative model is difficult to implement. One reason for this was that conflict among team members often limited communication and therefore halted collaboration. In an attempt to overcome conflict, the researcher introduced an intervention to five grade-level teaching teams at a suburban elementary school where staff had been struggling to develop teams into PLCs. The intervention consisted of training participants in the use of collaborative norms, and then tracking the use of these norms during team meetings, as well as gathering the teachers' perceptions on how their team was being affected by the use of the norms. Seven training sessions were conducted, each devoted to an individual norm such as pausing, putting ideas on the table, or presuming the positive, and so on. A mixed-methods action research model was utilized in gathering and analyzing the data in this study. Qualitative measures included reflection journals completed by the teachers, open-ended survey questions, and written responses in which the teachers described prior to the intervention and again after the intervention how their team: 1. Is like a PLC, 2. Is not like a PLC, and 3. Is becoming like a PLC. Quantitative measures included a survey of team communication that used questions regarding efficacy, conflict, and candor/trust. Quantitative measures also included an instrument developed as part of the System for Multi-Level Observation of Groups (SYMLOG) which is used for recording evidences of values observed in team members. Results demonstrated increases in teachers' perceptions of friendliness among their colleagues, ability to deal with conflict amicably and constructively, and in teachers' perception that they were now being listened to and understood more than they had been previously. Teachers also reported that they came to think of their team as a PLC, and began to perceive that there were benefits with respect to student achievement because they were becoming a PLC. Discussion focused on lessons learned, implications for practice, and implications for research.
ContributorsSterr, Ronald (Author) / Buss, Ray R (Thesis advisor) / Zucker, Stanley (Thesis advisor) / Roy, Patricia (Committee member) / Arizona State University (Publisher)
Created2011
Description
As the Director of Student Affairs for a developing two-year hybrid Doctor of Physical Therapy (DPT) program, I was tasked with developing a program to support the academic success of students. Limited evidence was available on supporting students who were geographically separated from campus during most of their preparation because hybrid programs only recently emerged. Academic coaching has been used in medical education and recently in hybrid DPT programs to support students’ academic and professional development. Coaching differs from advising and mentoring because it was focused on building relationships between students and coaches to promote students’ self-reflection, growth, persistence, and agency. I used asynchronous instructional videos, in-person workshops, and an online community of practice to train and support faculty members to serve as coaches. Coach training focused on specific coaching concepts including listening empathetically, asking powerful questions, and adhering to a coaching session structure. At orientation, faculty member coaches (FMCs) met with their 8-10 students in a group setting and also 1:1 to build rapport and establish communication. Subsequently, FMCs engaged each student in a coaching session twice, during the midterm of each of the first two academic terms of the program. In this mixed methods study, I employed quantitative survey and qualitative interview methods to evaluate faculty members’ attitudes, skills, and self-efficacy for serving as a coach as well as their relatedness to students. Additionally, I explored students’ perceptions of coach support, relatedness to their coach, and relatedness to peers. FMCs demonstrated increases in attitudes, perceived skills, and self-efficacy for the key coaching concepts because of the training. They rated their relatedness to students high and reported that building connections with students was a rewarding aspect of coaching. Similarly, students rated their coach and peers highly with respect to relatedness and had positive perspectives toward coaches’ support. FMCs were challenged by the time commitment to the coaching process. Moreover, students yearned for more opportunities to connect with their coach and peers. In the discussion, I highlighted the complementarity of the quantitative and qualitative outcomes, connected the findings to theoretical perspectives, and proposed implications for practice and for future research.
ContributorsBlack, Kayla Dawn (Author) / Buss, Ray R (Thesis advisor) / Kulinna, Pamela (Committee member) / Gagnon, Kendra (Committee member) / Arizona State University (Publisher)
Created2023
Description
With the advent of Massive Open Online Courses (MOOCs) educators have the opportunity to collect data from students and use it to derive insightful information about the students. Specifically, for programming based courses the ability to identify the specific areas or topics that need more attention from the students can be of immense help. But the majority of traditional, non-virtual classes lack the ability to uncover such information that can serve as a feedback to the effectiveness of teaching. In majority of the schools paper exams and assignments provide the only form of assessment to measure the success of the students in achieving the course objectives. The overall grade obtained in paper exams and assignments need not present a complete picture of a student’s strengths and weaknesses. In part, this can be addressed by incorporating research-based technology into the classrooms to obtain real-time updates on students' progress. But introducing technology to provide real-time, class-wide engagement involves a considerable investment both academically and financially. This prevents the adoption of such technology thereby preventing the ideal, technology-enabled classrooms. With increasing class sizes, it is becoming impossible for teachers to keep a persistent track of their students progress and to provide personalized feedback. What if we can we provide technology support without adding more burden to the existing pedagogical approach? How can we enable semantic enrichment of exams that can translate to students' understanding of the topics taught in the class? Can we provide feedback to students that goes beyond only numbers and reveal areas that need their focus. In this research I focus on bringing the capability of conducting insightful analysis to paper exams with a less intrusive learning analytics approach that taps into the generic classrooms with minimum technology introduction. Specifically, the work focuses on automatic indexing of programming exam questions with ontological semantics. The thesis also focuses on designing and evaluating a novel semantic visual analytics suite for in-depth course monitoring. By visualizing the semantic information to illustrate the areas that need a student’s focus and enable teachers to visualize class level progress, the system provides a richer feedback to both sides for improvement.
ContributorsPandhalkudi Govindarajan, Sesha Kumar (Author) / Hsiao, I-Han (Thesis advisor) / Nelson, Brian (Committee member) / Walker, Erin (Committee member) / Arizona State University (Publisher)
Created2016
Description
This thesis is an initial test of the hypothesis that superficial measures suffice for measuring collaboration among pairs of students solving complex math problems, where the degree of collaboration is categorized at a high level. Data were collected
in the form of logs from students' tablets and the vocal interaction between pairs of students. Thousands of different features were defined, and then extracted computationally from the audio and log data. Human coders used richer data (several video streams) and a thorough understand of the tasks to code episodes as
collaborative, cooperative or asymmetric contribution. Machine learning was used to induce a detector, based on random forests, that outputs one of these three codes for an episode given only a characterization of the episode in terms of superficial features. An overall accuracy of 92.00% (kappa = 0.82) was obtained when
comparing the detector's codes to the humans' codes. However, due irregularities in running the study (e.g., the tablet software kept crashing), these results should be viewed as preliminary.
in the form of logs from students' tablets and the vocal interaction between pairs of students. Thousands of different features were defined, and then extracted computationally from the audio and log data. Human coders used richer data (several video streams) and a thorough understand of the tasks to code episodes as
collaborative, cooperative or asymmetric contribution. Machine learning was used to induce a detector, based on random forests, that outputs one of these three codes for an episode given only a characterization of the episode in terms of superficial features. An overall accuracy of 92.00% (kappa = 0.82) was obtained when
comparing the detector's codes to the humans' codes. However, due irregularities in running the study (e.g., the tablet software kept crashing), these results should be viewed as preliminary.
ContributorsViswanathan, Sree Aurovindh (Author) / VanLehn, Kurt (Thesis advisor) / T.H CHI, Michelene (Committee member) / Walker, Erin (Committee member) / Arizona State University (Publisher)
Created2014
Description
In this dissertation I employed a culminating cycle of action research following two earlier ones to facilitate the creation of a professional learning community (PLC). My research took place at an elementary school in an urban area of the American southwest. As principal of this school I had initiated the policies and procedures that were often recommended to create PLCs. However, observations of teachers in PLC meetings indicated that conversations focused on logistical planning issues, rather than on the in-depth pedagogical discussions that characterize high functioning PLCs. To address this problem I introduced a form of peer observation into the PLC meeting. This was achieved by showing short video recordings of teachers in their classrooms. I used a mixed methods approach to investigate how this innovation influenced three constructs associated with PLC meetings: professional learning, the sharing of tacit teaching knowledge, and collaboration in the PLC.
Quantitative data consisted of responses to a survey given as a pre-, post-, and retrospective pre-test. Results showed significant gains for all three constructs between the retrospective pre-test and the post-test, but no significant gain between the pre- and post-test. Analysis of qualitative data produced four assertions. First, the process of peer observation during a PLC meeting benefitted the personal learning of teachers. Second, peer observation benefitted teacher teams' abilities to demonstrate the critical behaviors of a true PLC. Third, the process of facilitating peer observation through video recordings evoked negative emotions. Fourth, the degree to which teachers were able to learn from a video was influenced by their perceptions of the video's authenticity and similarity to their own classrooms.
In the discussion, complementarity of the quantitative and qualitative data was described and results were explained in terms of previous research and established theory. Additionally, practical lessons that were learned, limitations, and research implications were described. In a concluding section, I discussed my personal learning regarding leadership, innovation, and action research; the purpose of the doctorate in education; and strengthening connections between research and practitioners.
Quantitative data consisted of responses to a survey given as a pre-, post-, and retrospective pre-test. Results showed significant gains for all three constructs between the retrospective pre-test and the post-test, but no significant gain between the pre- and post-test. Analysis of qualitative data produced four assertions. First, the process of peer observation during a PLC meeting benefitted the personal learning of teachers. Second, peer observation benefitted teacher teams' abilities to demonstrate the critical behaviors of a true PLC. Third, the process of facilitating peer observation through video recordings evoked negative emotions. Fourth, the degree to which teachers were able to learn from a video was influenced by their perceptions of the video's authenticity and similarity to their own classrooms.
In the discussion, complementarity of the quantitative and qualitative data was described and results were explained in terms of previous research and established theory. Additionally, practical lessons that were learned, limitations, and research implications were described. In a concluding section, I discussed my personal learning regarding leadership, innovation, and action research; the purpose of the doctorate in education; and strengthening connections between research and practitioners.
ContributorsMacKinney, Bennett (Author) / Buss, Ray R (Thesis advisor) / Zucker, Stanley (Committee member) / Haghighat, Ibi (Committee member) / Arizona State University (Publisher)
Created2015
Description
Parent involvement in their children’s education has been a frequently sought after and highly regarded component in education that has repeatedly been identified as a significant influence that contributes to children’s success in school. Historically, Latino parent involvement has been markedly low in the United States. Researchers’ interest in Latino parents’ involvement in their children’s education has been spurred by this low level of involvement coupled with reports of significant differences in educational achievement between Latino students and students of other ethnic backgrounds. Perceptions of self-efficacy and role construction have been identified as motivators for parent involvement. The purpose of this action research study was to examine the relationship between the Espacio Iluminado Parent Engagement Program as a nontraditional Latino parent involvement opportunity and parents’ perceptions of self-efficacy and role construction as it pertains to supporting the education of their children. The foundation of the program was developed utilizing Third Space Theory (Bhabha, 1994) to generate a framework that had the potential to serve as a model for future parent involvement programs that validated the knowledge of diverse cultures and discourses and encouraged a mediation of the two. Participants’ ratings of Role Construction and Self-Efficacy were significantly improved after their involvement in the parent program. Participants also felt strongly that the program was personally valuable and useful. Future direction might include a longitudinal study to track the academic progress of children of the participants.
ContributorsBrotherton, Kathleen Scheehl (Author) / Caterino, Linda C (Thesis advisor) / Buss, Ray R (Committee member) / Weber, Christina (Committee member) / Arizona State University (Publisher)
Created2017
Description
As higher education embraces innovative educational models, support for the faculty members who must carry them out remains a vital ingredient for success. Despite this need, many institutions adopt innovations such as blended learning for all of the benefits afforded, with minimal consideration to meaningfully equip professors teaching these courses. “Faculty Learning Communities” (FLC’s) provide a powerful model of supporting and equipping faculty in their teaching practice. Nevertheless, ongoing and collaborative faculty development was historically unavailable to professors teaching undergraduate blended courses at Lancaster Bible College. Thus, the purpose of this qualitative action research study was to examine the ways that faculty perceived an FLC during the design and facilitation of a blended course. The Community of Inquiry (CoI) framework guided the design and facilitation of the FLC in fall 2018, as well as providing insight into measuring how learning communities formed during the FLC and while participants taught their courses. This FLC model blended learning for participants by occurring four times on campus, with online sessions following each in-person meeting. The faculty developer provided resources and support as faculty collaborated in designing their blended courses for the spring 2019 semester. Faculty perceptions of support were gathered in a focus group at the end of fall semester. During the spring 2019 semester, the faculty developer observed both on-campus and online sessions of the blended courses and led a second focus group about faculty perceptions of effectiveness and support. Qualitative data sets included video recordings of the FLC, focus groups, and class observations, field notes, and screenshots of online environments during the FLC and courses. Findings demonstrated substantial evidence of CoI measures of social presence, cognitive presence, and teaching presence were present in both the FLC and participants’ courses. These results affirmed the CoI framework provided a meaningful platform for faculty development. Additionally, participants perceived the FLC as supportive for their blended teaching practices, making direct mentions of support and indicating belief that broader institutional change be implemented toward this end to enhance faculty development opportunities. Limitations and implications of the study, as well as desired future research were explored.
ContributorsHarbin, Justin (Author) / Rotheram-Fuller, Erin (Thesis advisor) / Foulger, Teresa (Committee member) / Clawson, Penny (Committee member) / Buss, Ray R (Committee member) / Arizona State University (Publisher)
Created2019
Description
Students seldom spontaneously collaborate with each other. A system that can measure collaboration in real time could be useful, for example, by helping the teacher locate a group requiring guidance. To address this challenge, the research presented here focuses on building and comparing collaboration detectors for different types of classroom problem solving activities, such as card sorting and handwriting.
Transfer learning using different representations was also studied with a goal of building collaboration detectors for one task can be used with a new task. Data for building such detectors were collected in the form of verbal interaction and user action logs from students’ tablets. Three qualitative levels of interactivity were distinguished: Collaboration, Cooperation and Asymmetric Contribution. Machine learning was used to induce a classifier that can assign a code for every episode based on the set of features. The results indicate that machine learned classifiers were reliable and can transfer.
Transfer learning using different representations was also studied with a goal of building collaboration detectors for one task can be used with a new task. Data for building such detectors were collected in the form of verbal interaction and user action logs from students’ tablets. Three qualitative levels of interactivity were distinguished: Collaboration, Cooperation and Asymmetric Contribution. Machine learning was used to induce a classifier that can assign a code for every episode based on the set of features. The results indicate that machine learned classifiers were reliable and can transfer.
ContributorsViswanathan, Sree Aurovindh (Author) / VanLehn, Kurt (Thesis advisor) / Hsiao, Ihan (Committee member) / Walker, Erin (Committee member) / D' Angelo, Cynthia (Committee member) / Arizona State University (Publisher)
Created2020
Description
To address national technology standards for PK-12 educators and accreditation requirements, Mary Lou Fulton Teachers College has developed an approach to preparing its teacher candidates by infusing technological learning experiences in its preparation programs. Faculty members have been expected to teach with technology, model various levels of technology integration, and provide their students with appropriate learning to develop their digital pedagogy skills. Part-time faculty members have been responsible for teaching courses with these requirements but often lacked access to professional development opportunities and support. The lead technology strategist in the college determined these part-time instructors needed improved strategies for knowledge development, support, and networking. Thus, an online community of practice was created as a potential solution to this problem of practice. This mixed methods study examined how part-time instructors participated in an online community of practice (OCoP) housed in two digital platforms, Canvas and Slack. Elements of the OCoP included learning sessions and resources based upon the Teacher Educator Technology Competencies (TETCs), the Technological Pedagogical Content (TPACK) framework, and elements integral to communities of practice. The investigation included measuring the influence of the OCoP on participants’ technology knowledge, technology skills, technology use, and technological self-efficacy. Participants were part-time faculty members responsible for teaching courses in various teacher preparation programs in the college. Data from the study included survey data, Canvas and Slack analytics describing use, lesson analyses and observational notes, and interviews. Results suggested the OCoP was an effective intervention for the purpose of providing digital connections for part-time faculty to develop professionally with respect to teaching with technology. Participants displayed an increase in TPACK, TETC, and self-efficacy construct scores and demonstrated development in technology knowledge, technology skills, technology use, and technological self-efficacy. The discussion focused on describing the complementarity of the quantitative and qualitative data, explaining the findings in relation to the literature, and presenting limitations, implications for practice and research, lessons learned, and conclusions.
ContributorsDonner, Jodie (Author) / Buss, Ray R (Thesis advisor) / Henriksen, Danah (Committee member) / Lindsey, LeeAnn (Committee member) / Arizona State University (Publisher)
Created2021
Description
Virtual Reality (hereafter VR) and Mixed Reality (hereafter MR) have opened a new line of applications and possibilities. Amidst a vast network of potential applications, little research has been done to provide real time collaboration capability between users of VR and MR. The idea of this thesis study is to develop and test a real time collaboration system between VR and MR. The system works similar to a Google document where two or more users can see what others are doing i.e. writing, modifying, viewing, etc. Similarly, the system developed during this study will enable users in VR and MR to collaborate in real time.
The study of developing a real-time cross-platform collaboration system between VR and MR takes into consideration a scenario in which multiple device users are connected to a multiplayer network where they are guided to perform various tasks concurrently.
Usability testing was conducted to evaluate participant perceptions of the system. Users were required to assemble a chair in alternating turns; thereafter users were required to fill a survey and give an audio interview. Results collected from the participants showed positive feedback towards using VR and MR for collaboration. However, there are several limitations with the current generation of devices that hinder mass adoption. Devices with better performance factors will lead to wider adoption.
The study of developing a real-time cross-platform collaboration system between VR and MR takes into consideration a scenario in which multiple device users are connected to a multiplayer network where they are guided to perform various tasks concurrently.
Usability testing was conducted to evaluate participant perceptions of the system. Users were required to assemble a chair in alternating turns; thereafter users were required to fill a survey and give an audio interview. Results collected from the participants showed positive feedback towards using VR and MR for collaboration. However, there are several limitations with the current generation of devices that hinder mass adoption. Devices with better performance factors will lead to wider adoption.
ContributorsSeth, Nayan Sateesh (Author) / Nelson, Brian (Thesis advisor) / Walker, Erin (Committee member) / Atkinson, Robert (Committee member) / Arizona State University (Publisher)
Created2017