Automatic Classification of Small Group Dynamics using Speech and Collaborative Writing

158831-Thumbnail Image.png
Description
Students seldom spontaneously collaborate with each other. A system that can measure collaboration in real time could be useful, for example, by helping the teacher locate a group requiring guidance. To address this challenge, the research presented here focuses on

Students seldom spontaneously collaborate with each other. A system that can measure collaboration in real time could be useful, for example, by helping the teacher locate a group requiring guidance. To address this challenge, the research presented here focuses on building and comparing collaboration detectors for different types of classroom problem solving activities, such as card sorting and handwriting.

Transfer learning using different representations was also studied with a goal of building collaboration detectors for one task can be used with a new task. Data for building such detectors were collected in the form of verbal interaction and user action logs from students’ tablets. Three qualitative levels of interactivity were distinguished: Collaboration, Cooperation and Asymmetric Contribution. Machine learning was used to induce a classifier that can assign a code for every episode based on the set of features. The results indicate that machine learned classifiers were reliable and can transfer.
Date Created
2020
Agent

Providing Intelligent and Adaptive Support in Concept Map-based Learning Environments

157884-Thumbnail Image.png
Description
Concept maps are commonly used knowledge visualization tools and have been shown to have a positive impact on learning. The main drawbacks of concept mapping are the requirement of training, and lack of feedback support. Thus, prior research has attempted

Concept maps are commonly used knowledge visualization tools and have been shown to have a positive impact on learning. The main drawbacks of concept mapping are the requirement of training, and lack of feedback support. Thus, prior research has attempted to provide support and feedback in concept mapping, such as by developing computer-based concept mapping tools, offering starting templates and navigational supports, as well as providing automated feedback. Although these approaches have achieved promising results, there are still challenges that remain to be solved. For example, there is a need to create a concept mapping system that reduces the extraneous effort of editing a concept map while encouraging more cognitively beneficial behaviors. Also, there is little understanding of the cognitive process during concept mapping. What’s more, current feedback mechanisms in concept mapping only focus on the outcome of the map, instead of the learning process.

This thesis work strives to solve the fundamental research question: How to leverage computer technologies to intelligently support concept mapping to promote meaningful learning? To approach this research question, I first present an intelligent concept mapping system, MindDot, that supports concept mapping via innovative integration of two features, hyperlink navigation, and expert template. The system reduces the effort of creating and modifying concept maps while encouraging beneficial activities such as comparing related concepts and establishing relationships among them. I then present the comparative strategy metric that modes student learning by evaluating behavioral patterns and learning strategies. Lastly, I develop an adaptive feedback system that provides immediate diagnostic feedback in response to both the key learning behaviors during concept mapping and the correctness and completeness of the created maps.

Empirical evaluations indicated that the integrated navigational and template support in MindDot fostered effective learning behaviors and facilitating learning achievements. The comparative strategy model was shown to be highly representative of learning characteristics such as motivation, engagement, misconceptions, and predicted learning results. The feedback tutor also demonstrated positive impacts on supporting learning and assisting the development of effective learning strategies that prepare learners for future learning. This dissertation contributes to the field of supporting concept mapping with designs of technological affordances, a process-based student model, an adaptive feedback tutor, empirical evaluations of these proposed innovations, and implications for future support in concept mapping.
Date Created
2019
Agent

Producing Acoustic-Prosodic Entrainment in a Robotic Learning Companion to Build Learner Rapport

156892-Thumbnail Image.png
Description
With advances in automatic speech recognition, spoken dialogue systems are assuming increasingly social roles. There is a growing need for these systems to be socially responsive, capable of building rapport with users. In human-human interactions, rapport is critical to patient-doctor

With advances in automatic speech recognition, spoken dialogue systems are assuming increasingly social roles. There is a growing need for these systems to be socially responsive, capable of building rapport with users. In human-human interactions, rapport is critical to patient-doctor communication, conflict resolution, educational interactions, and social engagement. Rapport between people promotes successful collaboration, motivation, and task success. Dialogue systems which can build rapport with their user may produce similar effects, personalizing interactions to create better outcomes.

This dissertation focuses on how dialogue systems can build rapport utilizing acoustic-prosodic entrainment. Acoustic-prosodic entrainment occurs when individuals adapt their acoustic-prosodic features of speech, such as tone of voice or loudness, to one another over the course of a conversation. Correlated with liking and task success, a dialogue system which entrains may enhance rapport. Entrainment, however, is very challenging to model. People entrain on different features in many ways and how to design entrainment to build rapport is unclear. The first goal of this dissertation is to explore how acoustic-prosodic entrainment can be modeled to build rapport.

Towards this goal, this work presents a series of studies comparing, evaluating, and iterating on the design of entrainment, motivated and informed by human-human dialogue. These models of entrainment are implemented in the dialogue system of a robotic learning companion. Learning companions are educational agents that engage students socially to increase motivation and facilitate learning. As a learning companion’s ability to be socially responsive increases, so do vital learning outcomes. A second goal of this dissertation is to explore the effects of entrainment on concrete outcomes such as learning in interactions with robotic learning companions.

This dissertation results in contributions both technical and theoretical. Technical contributions include a robust and modular dialogue system capable of producing prosodic entrainment and other socially-responsive behavior. One of the first systems of its kind, the results demonstrate that an entraining, social learning companion can positively build rapport and increase learning. This dissertation provides support for exploring phenomena like entrainment to enhance factors such as rapport and learning and provides a platform with which to explore these phenomena in future work.
Date Created
2018
Agent

Simplifying Self-Tracking through the Utilization of Wearable Technology

134105-Thumbnail Image.png
Description
The purpose of this project is to understand how wearable technology can improve a person's practice of self-tracking, or monitoring one's data. Self-tracking is regularly recording information about one's different life patterns (such as diet, activities, or sleep). Some technology

The purpose of this project is to understand how wearable technology can improve a person's practice of self-tracking, or monitoring one's data. Self-tracking is regularly recording information about one's different life patterns (such as diet, activities, or sleep). Some technology that helps users record personal data are seen today as devices (FitBit, Smart Watches) or as applications (MyFitnessPal). Data is collected for the user to observe certain habits that he/she would like to improve upon. Their personal data that is collected and this helps keep the person self-tracking. This data can be converted to show personal behavioral patterns which a person analyzes so that they can make changes that lead to a healthier lifestyle. People self-track in order to analyze their behavior patterns, so that they can make changes to those patterns that lead to a healthier lifestyle. However, some people are not motivated to continue self-tracking, or use their data to make positive behavioral changes. To better understand this problem, we are conducting four co-design sessions with four users who have shown varying levels of self-tracking. Sessions' activities included: storyboarding, reviewing existing user interfaces, generating feedback on prototypes and discussion into thoughts and feelings about the prototype and self-tracking in general. Current findings highlight the importance of customization and simplicity within the application. We are developing an Apple Watch prototype application for self-tracking that incorporates features tailored to those needs in order to better motivate users to track and improve their well-being. Our main goal is to gain a better understanding of our participants and their need and usage with self-tracking. More information can be found on our website at ani6gup.me/CareTrack.
Date Created
2017-12
Agent

Using Learner Profiles to Create Teachable Tutor Systems

135231-Thumbnail Image.png
Description
In the 2 Sigma Learning Lab we use Quinn as an embodied agent in the tangible activities for geometry (TAG) system. The TAG system is focused on teaching students basic geometry skills, mainly plotting points in a Cartesian Grid. The

In the 2 Sigma Learning Lab we use Quinn as an embodied agent in the tangible activities for geometry (TAG) system. The TAG system is focused on teaching students basic geometry skills, mainly plotting points in a Cartesian Grid. The TAG system's main tool is Quinn's reactive prompts which help students overcome various misconceptions and teach basic concepts about the Cartesian plane and points. By analyzing past studies using the TAG system my goal is to develop prototypical agent profiles based off of my findings in learner profiles that might facilitate focused tutoring that addresses important misconceptions. Furthermore, applied use of these prototypical agent profiles would allow for students to teach Quinn as an application of the Learning-by-Teaching paradigm.
Date Created
2016-05
Agent

Last Hymn

135081-Thumbnail Image.png
Description
Last Hymn was created by the team of Tyler Pinho, Jefferson Le, and Curtis Spence with the desire to create an eccentric Role Playing Game focused on the exploration of a strange, dying world. Battles in the game are based

Last Hymn was created by the team of Tyler Pinho, Jefferson Le, and Curtis Spence with the desire to create an eccentric Role Playing Game focused on the exploration of a strange, dying world. Battles in the game are based off of rhythm games like Dance Dance Revolution using a procedural generation algorithm that makes every encounter unique. This is then complemented with the path system where each enemy has unique rhythm patterns to give them different types of combat opportunities. In Last Hymn, the player arrives on a train at the World's End Train Station where they are greeted by a mysterious figure and guided to the Forest where they witness the end of the world and find themselves back at the train station before they left for the Forest. With only a limited amount of time per cycle of the world, the player must constantly weigh the opportunity cost of each decision, and only with careful thought, conviction, and tenacity will the player find a conclusion from the never ending cycle of rebirth. Blending both Shinto architecture and modern elements, Last Hymn used a "fantasy-chic" aesthetic in order to provide memorable locations and dissonant imagery. As the player explores they will struggle against puzzles and dynamic, rhythm based combat while trying to unravel the mystery of the world's looping time. Last Hymn was designed to develop innovative and dynamic new solutions for combat, exploration, and mapping. From this project all three team members were able to grow their software development and game design skills, achieving goals like improved level design, improved asset pipelines while simultaneously aiming to craft an experience that will be unforgettable for players everywhere.
Date Created
2016-12
Agent

STUDY GENIE: An Analysis of a Web-based Note-Sharing and Cheat Sheet Tool

134905-Thumbnail Image.png
Description
Research has shown that the cheat sheet preparation process helps students with performance in exams. However, results have been inconclusive in determining the most effective guiding principles in creating and using cheat sheets. The traditional method of collecting and annotating

Research has shown that the cheat sheet preparation process helps students with performance in exams. However, results have been inconclusive in determining the most effective guiding principles in creating and using cheat sheets. The traditional method of collecting and annotating cheat sheets is time consuming and exhaustive, and fails to capture students' preparation process. This thesis examines the development and usage of a new web-based cheat sheet creation tool, Study Genie, and its effects on student performance in an introductory computer science and programming course. Results suggest that actions associated with editing and organizing cheat sheets are positively correlated with exam performance, and that there is a significant difference between the activity of high-performing and low-performing students. Through these results, Study Genie presents itself as an opportunity for mass data collection and to provide insight into the assembly process rather than just the finished product in cheat sheet creation.
Date Created
2016-12
Agent

Home Automation's Influence on Life

137617-Thumbnail Image.png
Description
This honors thesis utilizes smart home components and concepts from Dr. Burleson's Game as Life, Life as Game (GaLLaG) systems. The thesis focuses on an automated lifestyle, where individuals utilize technology, such as door sensors, appliance and lamp modules, and

This honors thesis utilizes smart home components and concepts from Dr. Burleson's Game as Life, Life as Game (GaLLaG) systems. The thesis focuses on an automated lifestyle, where individuals utilize technology, such as door sensors, appliance and lamp modules, and system notifications, to assist in daily activities. The findings from our efforts to date indicate that after weeks of observations, there is no evidence that automated lifestyles create more productive and healthy lifestyles and lead to overall satisfaction in life; however, there are certain design principles that would assist future home automation applications.
Date Created
2013-05
Agent

INTERFACE DESIGN WITH MULTIPLE DEVICES IN MIND

137541-Thumbnail Image.png
Description
Over the course of computing history there have been many ways for humans to pass information to computers. These different input types, at first, tended to be used one or two at a time for the users interfacing with computers.

Over the course of computing history there have been many ways for humans to pass information to computers. These different input types, at first, tended to be used one or two at a time for the users interfacing with computers. As time has progressed towards the present, however, many devices are beginning to make use of multiple different input types, and will likely continue to do so. With this happening, users need to be able to interact with single applications through a variety of ways without having to change the design or suffer a loss of functionality. This is important because having only one user interface, UI, across all input types is makes it easier for the user to learn and keeps all interactions consistent across the application. Some of the main input types in use today are touch screens, mice, microphones, and keyboards; all seen in Figure 1 below. Current design methods tend to focus on how well the users are able to learn and use a computing system. It is good to focus on those aspects, but it is important to address the issues that come along with using different input types, or in this case, multiple input types. UI design for touch screens, mice, microphones, and keyboards each requires satisfying a different set of needs. Due to this trend in single devices being used in many different input configurations, a "fully functional" UI design will need to address the needs of multiple input configurations. In this work, clashing concerns are described for the primary input sources for computers and suggests methodologies and techniques for designing a single UI that is reasonable for all of the input configurations.
Date Created
2013-05
Agent

Integrating Online and Offline Learning Experiences: Determining Design Opportunities to enhance in-person experiences with academic resources on a college campus

137392-Thumbnail Image.png
Description
Despite the advancement of online tools for activities related to the core experience of taking classes on a college campus, there has been a relatively small amount of research into implementing online tools for ancillary academic resources (e.g. tutoring centers,

Despite the advancement of online tools for activities related to the core experience of taking classes on a college campus, there has been a relatively small amount of research into implementing online tools for ancillary academic resources (e.g. tutoring centers, review sessions, etc.). Previous work and a study conducted for this paper indicates that there is value in creating these online tools but that there is value in maintaining an in-person component to these services. Based on this, a system which provides personalized, easily-accessible, simple access to these services is proposed. Designs for user-centered online-tools that provides access to and interaction with tutoring centers and review sessions are described and prototypes are developed to demonstrate the application of design principles for online tools for academic services.
Date Created
2013-12
Agent