Matching Items (3)
Filtering by
- All Subjects: Embedded Assessment
- Creators: Walker, Erin
Description
Embedded assessment constantly updates a model of the student as the student works on instructional tasks. Accurate embedded assessment allows students, instructors and instructional systems to make informed decisions without requiring the student to stop instruction and take a test. This thesis describes the development and comparison of several student models for Dragoon, an intelligent tutoring system. All the models were instances of Bayesian Knowledge Tracing, a standard method. Several methods of parameterization and calibration were explored using two recently developed toolkits, FAST and BNT-SM that replaces constant-valued parameters with logistic regressions. The evaluation was done by calculating the fit of the models to data from human subjects and by assessing the accuracy of their assessment of simulated students. The student models created using node properties as subskills were superior to coarse-grained, skill-only models. Adding this extra level of representation to emission parameters was superior to adding it to transmission parameters. Adding difficulty parameters did not improve fit, contrary to standard practice in psychometrics.
ContributorsGrover, Sachin (Author) / VanLehn, Kurt (Thesis advisor) / Walker, Erin (Committee member) / Shiao, Ihan (Committee member) / Arizona State University (Publisher)
Created2015
Description
As people age, the desire to grow old independently and in place becomes larger and takes greater importance in their lives. Successful aging involves the physical, mental and social well-being of an individual. To enable successful aging of older adults, it is necessary for them to perform both activities of daily living (ADL) and instrumental activities of daily living (IADL). Embedded assessment has made it possible to assess an individual's functional ability in-place, however the success of any technology depends largely on the user than the technology itself. Previous researches in in-situ functional assessment systems have heavily focused on the technology rather than on the user. This dissertation takes a user-centric approach to this problem by trying to identify the design and technical challenges of deploying and using a functional assessment system in the real world.
To investigate this line of research, a case study was conducted with 4 older adults in their homes, interviews were conducted with 8 caregivers and a controlled lab experiment was conducted with 8 young healthy adults at ASU, to test the sensors. This methodology provides a significant opportunity to advance the scientific field by expanding the present focus on IADL task performance to an integrated assessment of ADL and IADL task performance. Doing so would not only be more effective in identifying functional decline but could also provide a more comprehensive assessment of individuals' functional abilities with independence and also providing the caregivers with much needed respite.
The controlled lab study tested the sensors embedded into daily objects and found them to be reliable, and efficient. Short term exploratory case studies with healthy older adults revealed the challenges associated with design and technical aspects of the current system, while inductive analysis performed on interviews with caregivers helped to generate central themes on which future functional assessment systems need to be designed and built. The key central themes were a) focus on design / user experience, b) consider user's characteristics, personality, behavior and functional ability, c) provide support for independence, and d) adapt to individual user's needs.
To investigate this line of research, a case study was conducted with 4 older adults in their homes, interviews were conducted with 8 caregivers and a controlled lab experiment was conducted with 8 young healthy adults at ASU, to test the sensors. This methodology provides a significant opportunity to advance the scientific field by expanding the present focus on IADL task performance to an integrated assessment of ADL and IADL task performance. Doing so would not only be more effective in identifying functional decline but could also provide a more comprehensive assessment of individuals' functional abilities with independence and also providing the caregivers with much needed respite.
The controlled lab study tested the sensors embedded into daily objects and found them to be reliable, and efficient. Short term exploratory case studies with healthy older adults revealed the challenges associated with design and technical aspects of the current system, while inductive analysis performed on interviews with caregivers helped to generate central themes on which future functional assessment systems need to be designed and built. The key central themes were a) focus on design / user experience, b) consider user's characteristics, personality, behavior and functional ability, c) provide support for independence, and d) adapt to individual user's needs.
ContributorsRavishankar, Vijay Kumar (Author) / Burleson, Winslow (Thesis advisor) / Coon, David (Committee member) / Mahoney, Diane (Committee member) / Walker, Erin (Committee member) / Li, Baoxin (Committee member) / Arizona State University (Publisher)
Created2015
Description
Concept maps are commonly used knowledge visualization tools and have been shown to have a positive impact on learning. The main drawbacks of concept mapping are the requirement of training, and lack of feedback support. Thus, prior research has attempted to provide support and feedback in concept mapping, such as by developing computer-based concept mapping tools, offering starting templates and navigational supports, as well as providing automated feedback. Although these approaches have achieved promising results, there are still challenges that remain to be solved. For example, there is a need to create a concept mapping system that reduces the extraneous effort of editing a concept map while encouraging more cognitively beneficial behaviors. Also, there is little understanding of the cognitive process during concept mapping. What’s more, current feedback mechanisms in concept mapping only focus on the outcome of the map, instead of the learning process.
This thesis work strives to solve the fundamental research question: How to leverage computer technologies to intelligently support concept mapping to promote meaningful learning? To approach this research question, I first present an intelligent concept mapping system, MindDot, that supports concept mapping via innovative integration of two features, hyperlink navigation, and expert template. The system reduces the effort of creating and modifying concept maps while encouraging beneficial activities such as comparing related concepts and establishing relationships among them. I then present the comparative strategy metric that modes student learning by evaluating behavioral patterns and learning strategies. Lastly, I develop an adaptive feedback system that provides immediate diagnostic feedback in response to both the key learning behaviors during concept mapping and the correctness and completeness of the created maps.
Empirical evaluations indicated that the integrated navigational and template support in MindDot fostered effective learning behaviors and facilitating learning achievements. The comparative strategy model was shown to be highly representative of learning characteristics such as motivation, engagement, misconceptions, and predicted learning results. The feedback tutor also demonstrated positive impacts on supporting learning and assisting the development of effective learning strategies that prepare learners for future learning. This dissertation contributes to the field of supporting concept mapping with designs of technological affordances, a process-based student model, an adaptive feedback tutor, empirical evaluations of these proposed innovations, and implications for future support in concept mapping.
This thesis work strives to solve the fundamental research question: How to leverage computer technologies to intelligently support concept mapping to promote meaningful learning? To approach this research question, I first present an intelligent concept mapping system, MindDot, that supports concept mapping via innovative integration of two features, hyperlink navigation, and expert template. The system reduces the effort of creating and modifying concept maps while encouraging beneficial activities such as comparing related concepts and establishing relationships among them. I then present the comparative strategy metric that modes student learning by evaluating behavioral patterns and learning strategies. Lastly, I develop an adaptive feedback system that provides immediate diagnostic feedback in response to both the key learning behaviors during concept mapping and the correctness and completeness of the created maps.
Empirical evaluations indicated that the integrated navigational and template support in MindDot fostered effective learning behaviors and facilitating learning achievements. The comparative strategy model was shown to be highly representative of learning characteristics such as motivation, engagement, misconceptions, and predicted learning results. The feedback tutor also demonstrated positive impacts on supporting learning and assisting the development of effective learning strategies that prepare learners for future learning. This dissertation contributes to the field of supporting concept mapping with designs of technological affordances, a process-based student model, an adaptive feedback tutor, empirical evaluations of these proposed innovations, and implications for future support in concept mapping.
ContributorsWang, Shang (Author) / Walker, Erin (Thesis advisor) / VanLehn, Kurt (Committee member) / Hsiao, Sharon (Committee member) / Long, Yanjin (Committee member) / Arizona State University (Publisher)
Created2019