Matching Items (14)
Filtering by

Clear all filters

151664-Thumbnail Image.png
Description
ABSTRACT A review of studies selected from the Educational Resource Information Center (ERIC) covering the years 1985 through 2011 revealed three key evaluation components to analyze within a comprehensive teacher evaluation program: (a) designing, planning, and implementing instruction; (b) learning environments; and (c) parent and peer surveys. In this dissertation,

ABSTRACT A review of studies selected from the Educational Resource Information Center (ERIC) covering the years 1985 through 2011 revealed three key evaluation components to analyze within a comprehensive teacher evaluation program: (a) designing, planning, and implementing instruction; (b) learning environments; and (c) parent and peer surveys. In this dissertation, these three components are investigated in the context of two research questions: 1. What is the relationship, if any, between comprehensive teacher evaluation scores and student standardized test scores? 2. How do teachers and administrators experience the comprehensive evaluation process and how do they use their experiences to inform instruction? The methodology for the study included a mixed-method case study at a charter school located in a middle-class neighborhood within a large metropolitan area of the southwestern United States, which included a comparison of teachers' average evaluation scores in the areas of instruction and environment, peer survey scores, parent survey scores, and students' standardized test (SST) benchmark scores over a two-year period as the quantitative data for the study. I also completed in-depth interviews with classroom teachers, mentor teachers, the master teacher, and the school principal; I used these interviews for the qualitative portion of my study. All three teachers had similar evaluation scores; however, when comparing student scores among the teachers, differences were evident. While no direct correlations between student achievement data and teacher evaluation scores are possible, the qualitative data suggest that there were variations among the teachers and administrators in how they experienced or "bought into" the comprehensive teacher evaluation, but they all used evaluation information to inform their instruction. This dissertation contributes to current research by suggesting that comprehensive teacher evaluation has the potential to change teachers' and principals' perceptions of teacher evaluation as inefficient and unproductive to a system that can enhance instruction and ultimately improve student achievement.  
ContributorsBullock, Donna (Author) / Mccarty, Teresa (Thesis advisor) / Powers, Jeanne (Thesis advisor) / Stafford, Catherine (Committee member) / Arizona State University (Publisher)
Created2013
151333-Thumbnail Image.png
Description
With changes in federal legislation and the proposed reauthorization of The Elementary and Secondary Education Act, school administrators are held to high standards in an attempt to improve achievement for all students. They no longer just manage their schools but must now be instructional leaders charged with observing and conferencing

With changes in federal legislation and the proposed reauthorization of The Elementary and Secondary Education Act, school administrators are held to high standards in an attempt to improve achievement for all students. They no longer just manage their schools but must now be instructional leaders charged with observing and conferencing with teachers, leading professional development aligned to data, and measuring results. Classroom walkthroughs have become a way of assisting with these tasks while supporting the mission of each school. The purpose of this research was to describe how walkthroughs operate in practice and how they were experienced by school administration, teacher leaders, and teachers at two schools within the same suburban district. Interviews illustrated that experiences were varied using the classroom walkthrough protocol. Continued professional development needed to occur with administrators and teachers. Participants shared their thoughts on implementation and usage, as well as made recommendations to schools and/or districts considering implementing classroom walkthroughs. Results also indicated a great deal of attention paid to the collection of data within the schools but there was less consensus on the analysis and use of the collected data. There was also confusion with teachers as to the vision, purpose, and goals of using classroom walkthroughs. Changes in leadership during the five years since implementation and young administrators, who were relatively new in their positions, helped shape school experiences. Recommendations to schools and/or districts considering implementation focused on support from the district office, a need for help with data collection and analysis, and a clear vision for the use of the protocol. Interviewees mentioned it would benefit districts and schools to develop a shared vocabulary for instructional engagement, alignment, and rigor, as well as a focus for professional development. They also shared the view that calibration conferences and conversations, centered on instruction, provided a focus for teaching and learning within a school and/or district.
ContributorsCunningham, Alexa Renee (Author) / Danzig, Arnold (Thesis advisor) / Harris, Connie (Committee member) / Hurley, Beverly (Committee member) / Arizona State University (Publisher)
Created2012
152171-Thumbnail Image.png
Description

Choropleth maps are a common form of online cartographic visualization. They reveal patterns in spatial distributions of a variable by associating colors with data values measured at areal units. Although this capability of pattern revelation has popularized the use of choropleth maps, existing methods for their online delivery are limited

Choropleth maps are a common form of online cartographic visualization. They reveal patterns in spatial distributions of a variable by associating colors with data values measured at areal units. Although this capability of pattern revelation has popularized the use of choropleth maps, existing methods for their online delivery are limited in supporting dynamic map generation from large areal data. This limitation has become increasingly problematic in online choropleth mapping as access to small area statistics, such as high-resolution census data and real-time aggregates of geospatial data streams, has never been easier due to advances in geospatial web technologies. The current literature shows that the challenge of large areal data can be mitigated through tiled maps where pre-processed map data are hierarchically partitioned into tiny rectangular images or map chunks for efficient data transmission. Various approaches have emerged lately to enable this tile-based choropleth mapping, yet little empirical evidence exists on their ability to handle spatial data with large numbers of areal units, thus complicating technical decision making in the development of online choropleth mapping applications. To fill this knowledge gap, this dissertation study conducts a scalability evaluation of three tile-based methods discussed in the literature: raster, scalable vector graphics (SVG), and HTML5 Canvas. For the evaluation, the study develops two test applications, generates map tiles from five different boundaries of the United States, and measures the response times of the applications under multiple test operations. While specific to the experimental setups of the study, the evaluation results show that the raster method scales better across various types of user interaction than the other methods. Empirical evidence also points to the superior scalability of Canvas to SVG in dynamic rendering of vector tiles, but not necessarily for partial updates of the tiles. These findings indicate that the raster method is better suited for dynamic choropleth rendering from large areal data, while Canvas would be more suitable than SVG when such rendering frequently involves complete updates of vector shapes.

ContributorsHwang, Myunghwa (Author) / Anselin, Luc (Thesis advisor) / Rey, Sergio J. (Committee member) / Wentz, Elizabeth (Committee member) / Arizona State University (Publisher)
Created2013
Description
ABSTRACT

This study examines validity evidence of a state policy-directed teacher evaluation system implemented in Arizona during school year 2012-2013. The purpose was to evaluate the warrant for making high stakes, consequential judgments of teacher competence based on value-added (VAM) estimates of instructional impact and observations of professional practice (PP).

ABSTRACT

This study examines validity evidence of a state policy-directed teacher evaluation system implemented in Arizona during school year 2012-2013. The purpose was to evaluate the warrant for making high stakes, consequential judgments of teacher competence based on value-added (VAM) estimates of instructional impact and observations of professional practice (PP). The research also explores educator influence (voice) in evaluation design and the role information brokers have in local decision making. Findings are situated in an evidentiary and policy context at both the LEA and state policy levels.

The study employs a single-phase, concurrent, mixed-methods research design triangulating multiple sources of qualitative and quantitative evidence onto a single (unified) validation construct: Teacher Instructional Quality. It focuses on assessing the characteristics of metrics used to construct quantitative ratings of instructional competence and the alignment of stakeholder perspectives to facets implicit in the evaluation framework. Validity examinations include assembly of criterion, content, reliability, consequential and construct articulation evidences. Perceptual perspectives were obtained from teachers, principals, district leadership, and state policy decision makers. Data for this study came from a large suburban public school district in metropolitan Phoenix, Arizona.

Study findings suggest that the evaluation framework is insufficient for supporting high stakes, consequential inferences of teacher instructional quality. This is based, in part on the following: (1) Weak associations between VAM and PP metrics; (2) Unstable VAM measures across time and between tested content areas; (3) Less than adequate scale reliabilities; (4) Lack of coherence between theorized and empirical PP factor structures; (5) Omission/underrepresentation of important instructional attributes/effects; (6) Stakeholder concerns over rater consistency, bias, and the inability of test scores to adequately represent instructional competence; (7) Negative sentiments regarding the system's ability to improve instructional competence and/or student learning; (8) Concerns regarding unintended consequences including increased stress, lower morale, harm to professional identity, and restricted learning opportunities; and (9) The general lack of empowerment and educator exclusion from the decision making process. Study findings also highlight the value of information brokers in policy decision making and the importance of having access to unbiased empirical information during the design and implementation phases of important change initiatives.
ContributorsSloat, Edward F. (Author) / Wetzel, Keith (Thesis advisor) / Amrein-Beardsley, Audrey (Thesis advisor) / Ewbank, Ann (Committee member) / Shough, Lori (Committee member) / Arizona State University (Publisher)
Created2015
150536-Thumbnail Image.png
Description
In the First Innovations Initiative at Arizona State University students are exposed to the culture of innovation and the entrepreneurial process through two courses situated intentionally within an American Indian sustainability context. In this action research dissertation, a summer field practicum was designed and implemented to complement the two in-classroom

In the First Innovations Initiative at Arizona State University students are exposed to the culture of innovation and the entrepreneurial process through two courses situated intentionally within an American Indian sustainability context. In this action research dissertation, a summer field practicum was designed and implemented to complement the two in-classroom course offerings. The first implementation of the new summer field practicum was documented for the two participating students. A survey and focus group were conducted to evaluate the spring 2011 classroom course and, separately, to evaluate the summer field practicum. Students in the spring 2011 course and summer field practicum reported that they were stimulated to think more innovatively, gained interest in the subject area and entrepreneurial/innovation processes, and improved their skills related to public speaking, networking, problem solving and research. The summer practicum participants reported larger increases in confidence in creating, planning and implementing a sustainable entrepreneurship venture, compared with the reports of the spring in-classroom participants. Additionally, differences favoring the summer practicum students were found in reported sense of community and individualism in support of entrepreneurship and innovation. The study results are being used to revamp both the in-classroom and field practicum experience for the benefit of future participants. Specifically, the American Indian perspective will be more fully embedded in each class session, contemporary timely articles and issues will be sought out and discussed in class, and the practicum experience will be further developed with additional student participants and site organizations sought. Additionally, the trans-disciplinary team approach will continue, with additional professional development opportunities provided for current team members and the addition of new instructional team members.
ContributorsWalters, Fonda (Author) / Clark, Christopher M. (Thesis advisor) / Jarratt-Snider, Karen (Committee member) / Kelley, Michael (Committee member) / Arizona State University (Publisher)
Created2012
156614-Thumbnail Image.png
Description
Academia is not what it used to be. In today’s fast-paced world, requirements

are constantly changing, and adapting to these changes in an academic curriculum

can be challenging. Given a specific aspect of a domain, there can be various levels of

proficiency that can be achieved by the students. Considering the wide array

Academia is not what it used to be. In today’s fast-paced world, requirements

are constantly changing, and adapting to these changes in an academic curriculum

can be challenging. Given a specific aspect of a domain, there can be various levels of

proficiency that can be achieved by the students. Considering the wide array of needs,

diverse groups need customized course curriculum. The need for having an archetype

to design a course focusing on the outcomes paved the way for Outcome-based

Education (OBE). OBE focuses on the outcomes as opposed to the traditional way of

following a process [23]. According to D. Clark, the major reason for the creation of

Bloom’s taxonomy was not only to stimulate and inspire a higher quality of thinking

in academia – incorporating not just the basic fact-learning and application, but also

to evaluate and analyze on the facts and its applications [7]. Instructional Module

Development System (IMODS) is the culmination of both these models – Bloom’s

Taxonomy and OBE. It is an open-source web-based software that has been

developed on the principles of OBE and Bloom’s Taxonomy. It guides an instructor,

step-by-step, through an outcomes-based process as they define the learning

objectives, the content to be covered and develop an instruction and assessment plan.

The tool also provides the user with a repository of techniques based on the choices

made by them regarding the level of learning while defining the objectives. This helps

in maintaining alignment among all the components of the course design. The tool

also generates documentation to support the course design and provide feedback

when the course is lacking in certain aspects.

It is not just enough to come up with a model that theoretically facilitates

effective result-oriented course design. There should be facts, experiments and proof

that any model succeeds in achieving what it aims to achieve. And thus, there are two

research objectives of this thesis: (i) design a feature for course design feedback and

evaluate its effectiveness; (ii) evaluate the usefulness of a tool like IMODS on various

aspects – (a) the effectiveness of the tool in educating instructors on OBE; (b) the

effectiveness of the tool in providing appropriate and efficient pedagogy and

assessment techniques; (c) the effectiveness of the tool in building the learning

objectives; (d) effectiveness of the tool in document generation; (e) Usability of the

tool; (f) the effectiveness of OBE on course design and expected student outcomes.

The thesis presents a detailed algorithm for course design feedback, its pseudocode, a

description and proof of the correctness of the feature, methods used for evaluation

of the tool, experiments for evaluation and analysis of the obtained results.
ContributorsRaj, Vaishnavi (Author) / Bansal, Srividya (Thesis advisor) / Bansal, Ajay (Committee member) / Mehlhase, Alexandra (Committee member) / Arizona State University (Publisher)
Created2018
136787-Thumbnail Image.png
Description
There is a serious need for early childhood intervention practices for children who are living at or below the poverty line. Since 1965 Head Start has provided a federally funded, free preschool program for children in this population. The City of Phoenix Head Start program consists of nine delegate agencies,

There is a serious need for early childhood intervention practices for children who are living at or below the poverty line. Since 1965 Head Start has provided a federally funded, free preschool program for children in this population. The City of Phoenix Head Start program consists of nine delegate agencies, seven of which reside in school districts. These agencies are currently not conducting local longitudinal evaluations of their preschool graduates. The purpose of this study was to recommend initial steps the City of Phoenix grantee and the delegate agencies can take to begin a longitudinal evaluation process of their Head Start programs. Seven City of Phoenix Head Start agency directors were interviewed. These interviews provided information about the attitudes of the directors when considering longitudinal evaluations and how Head Start already evaluates their programs through internal assessments. The researcher also took notes on the Third Grade Follow-Up to the Head Start Executive Summary in order to make recommendations to the City of Phoenix Head Start programs about the best practices for longitudinal student evaluations.
Created2014-05
154146-Thumbnail Image.png
Description
Science instructors need questions for use in exams, homework assignments, class discussions, reviews, and other instructional activities. Textbooks never have enough questions, so instructors must find them from other sources or generate their own questions. In order to supply instructors with biology questions, a semantic network approach was

Science instructors need questions for use in exams, homework assignments, class discussions, reviews, and other instructional activities. Textbooks never have enough questions, so instructors must find them from other sources or generate their own questions. In order to supply instructors with biology questions, a semantic network approach was developed for generating open response biology questions. The generated questions were compared to professional authorized questions.

To boost students’ learning experience, adaptive selection was built on the generated questions. Bayesian Knowledge Tracing was used as embedded assessment of the student’s current competence so that a suitable question could be selected based on the student’s previous performance. A between-subjects experiment with 42 participants was performed, where half of the participants studied with adaptive selected questions and the rest studied with mal-adaptive order of questions. Both groups significantly improved their test scores, and the participants in adaptive group registered larger learning gains than participants in the control group.

To explore the possibility of generating rich instructional feedback for machine-generated questions, a question-paragraph mapping task was identified. Given a set of questions and a list of paragraphs for a textbook, the goal of the task was to map the related paragraphs to each question. An algorithm was developed whose performance was comparable to human annotators.

A multiple-choice question with high quality distractors (incorrect answers) can be pedagogically valuable as well as being much easier to grade than open-response questions. Thus, an algorithm was developed to generate good distractors for multiple-choice questions. The machine-generated multiple-choice questions were compared to human-generated questions in terms of three measures: question difficulty, question discrimination and distractor usefulness. By recruiting 200 participants from Amazon Mechanical Turk, it turned out that the two types of questions performed very closely on all the three measures.
ContributorsZhang, Lishang (Author) / VanLehn, Kurt (Thesis advisor) / Baral, Chitta (Committee member) / Hsiao, Ihan (Committee member) / Wright, Christian (Committee member) / Arizona State University (Publisher)
Created2015
141447-Thumbnail Image.png
Description

Preventing heat-associated morbidity and mortality is a public health priority in Maricopa County, Arizona (United States). The objective of this project was to evaluate Maricopa County cooling centers and gain insight into their capacity to provide relief for the public during extreme heat events. During the summer of 2014, 53

Preventing heat-associated morbidity and mortality is a public health priority in Maricopa County, Arizona (United States). The objective of this project was to evaluate Maricopa County cooling centers and gain insight into their capacity to provide relief for the public during extreme heat events. During the summer of 2014, 53 cooling centers were evaluated to assess facility and visitor characteristics. Maricopa County staff collected data by directly observing daily operations and by surveying managers and visitors. The cooling centers in Maricopa County were often housed within community, senior, or religious centers, which offered various services for at least 1500 individuals daily. Many visitors were unemployed and/or homeless. Many learned about a cooling center by word of mouth or by having seen the cooling center’s location. The cooling centers provide a valuable service and reach some of the region’s most vulnerable populations. This project is among the first to systematically evaluate cooling centers from a public health perspective and provides helpful insight to community leaders who are implementing or improving their own network of cooling centers.

ContributorsBerisha, Vjollca (Author) / Hondula, David M. (Author) / Roach, Matthew (Author) / White, Jessica R. (Author) / McKinney, Benita (Author) / Bentz, Darcie (Author) / Mohamed, Ahmed (Author) / Uebelherr, Joshua (Author) / Goodin, Kate (Author)
Created2016-09-23
168309-Thumbnail Image.png
Description
The goal of the first study was to characterize the Miocene arkosic conglomerate in the Goldfield Mountains to determine the paleocurrent direction and source of the cobbles. This conglomerate is tilted to the northeast and unconformably overlies Proterozoic basement. Imbrication measurements are scattered but suggest the direction of paleoflow was

The goal of the first study was to characterize the Miocene arkosic conglomerate in the Goldfield Mountains to determine the paleocurrent direction and source of the cobbles. This conglomerate is tilted to the northeast and unconformably overlies Proterozoic basement. Imbrication measurements are scattered but suggest the direction of paleoflow was toward the northwest and northeast, which suggests the cobbles were sourced from the southeast and southwest. The abundance of Dripping Spring Quartzite and the presence of Barnes Conglomerate in the cobbles, suggests an Apache Group source. In addition, south-southeast of the map area, there are several rock units composed of the same material as cobbles within the arkosic conglomerate. The arkosic conglomerate was likely deposited during onset of mid-Cenozoic extension, where the resulting highlands could provide a nearby source for the cobbles. This nearby source is interpreted to be south-southeast of the study area. A second study examined the effectiveness of course reform conducted on an introductory undergraduate course sequence. Questions of this study included: (1) How does the curriculum cater to a student population with diverse goals? (2) How do reformed courses add educational value as perceived by the student? (3) How does the redesigned curriculum and the instructional strategies, as implemented, address the goals of the reform? The curriculum addressed the goals of the reform by (1) creating more opportunities for students to gain the skills relevant to their future goals, (2) having students utilize big data to make observations, interpretations, and predictions, (3) engaging students in scientific collaboration through group work and discussion, (4) giving students the opportunity to utilize computer programs that apply across various subjects and fields (i.e. Excel, MS Word, ArcGIS), and (5) requiring students to conduct original research to solve a problem and present their results orally and in written form. These redesign efforts were successful in meeting the objectives, and majority of the student participants reported one or more of the reformed experiences were valuable to their education and future goals. An understanding of teaching methods and educational values held by undergraduate students within the School of Earth and Space Exploration can be adapted and applied across subjects.
ContributorsAccetta, Danielle (Author) / Reynolds, Stephen J (Thesis advisor) / Johnson, Julia K (Committee member) / Semken, Steven (Committee member) / Arizona State University (Publisher)
Created2021