Faculty and Staff

We recommend using backward design to develop course-based undergraduate research experiences (CUREs). The defining hallmark of CUREs is that students in a formal lab course explore research questions with unknown answers that are broadly relevant outside the course. Because CUREs lead to novel research findings, they represent a unique course design challenge, as the dual nature of these courses requires course designers to consider two distinct, but complementary, sets of goals for the CURE: 1) scientific discovery milestones (i.e., research goals) and 2) student learning in cognitive, psychomotor, and affective domains (i.e., pedagogical goals). As more undergraduate laboratory courses are re-imagined as CUREs, how do we thoughtfully design these courses to effectively meet both sets of goals? In this Perspectives article, we explore this question and outline recommendations for using backward design in CURE development.

This paper presents a Bayesian framework for evaluative classification. Current education policy debates center on arguments about whether and how to use student test score data in school and personnel evaluation. Proponents of such use argue that refusing to use data violates both the public’s need to hold schools accountable when they use taxpayer dollars and students’ right to educational opportunities. Opponents of formulaic use of test-score data argue that most standardized test data is susceptible to fatal technical flaws, is a partial picture of student achievement, and leads to behavior that corrupts the measures.

A Bayesian perspective on summative ordinal classification is a possible framework for combining quantitative outcome data for students with the qualitative types of evaluation that critics of high-stakes testing advocate. This paper describes the key characteristics of a Bayesian perspective on classification, describes a method to translate a naïve Bayesian classifier into a point-based system for evaluation, and draws conclusions from the comparison on the construction of algorithmic (including point-based) systems that could capture the political and practical benefits of a Bayesian approach. The most important practical conclusion is that point-based systems with fixed components and weights cannot capture the dynamic and political benefits of a reciprocal relationship between professional judgment and quantitative student outcome data.

This is a brief text intended for use in undergraduate school-and-society classes. Your class may also be titled “Social foundations of education.” “Social foundations of education” is an interdisciplinary field that includes both humanities and social-science perspectives on schooling. It thus includes study of the philosophy and history of education as well as sociological, economic, anthropological, and political perspectives on schooling.

The core of most social foundations classes lies in the relationship between formal schooling and broader society. This emphasis means that while some parts of psychology may be related to the core issues of social foundations classes—primarily social psychology—the questions that are asked within a social-foundations class are different from the questions raised in child development, educational psychology, and most teaching-methods classes. For example, after finishing the first chapter of this text, you should be able to answer the question, “Why does the federal government pay public schools to feed poor students at breakfast and lunch?” Though there is some psychology research tying nutrition to behavior and learning, the policy is based on much broader expectations of schools. In this case, “Children learn better if they are well-fed” both is based on research and also is an incomplete answer.

The current debate over graduate rate calculations and results has glossed over the relationship between student migration and the accuracy of various graduation rates proposed over the past five years. Three general grade-based graduation rates have been proposed recently, and each has a parallel version that includes an adjustment for migration, whether international, internal to the U.S., or between different school sectors. All of the adjustment factors have a similar form, allowing simulation of estimates from real data, assuming different unmeasured net migration rates. In addition, a new age-based graduation rate, based on mathematical demography, allows the simulation of estimates on a parallel basis using data from Virginia's public schools.

Both the direct analysis and simulation demonstrate that graduation rates can only be useful with accurate information about student migration. A discussion of Florida's experiences with longitudinal cohort graduation rates highlights some of the difficulties with the current status of the oldest state databases and the need for both technical confidence and definitional clarity. Meeting the No Child Left Behind mandates for school-level graduation rates requires confirmation of transfers and an audit of any state system for accuracy, and basing graduation rates on age would be a significant improvement over rates calculated using grade-based data.

The spread of academic testing for accountability purposes in multiple countries has obscured at least two historical purposes of academic testing: community ritual and management of the social structure. Testing for accountability is very different from the purpose of academic challenges one can identify in community “examinations” in 19th century North America, or exams’ controlling access to the civil service in Imperial China. Rather than testing for ritual or access to mobility, the modern uses of testing are much closer to the state-building project of a tax census, such as the Domesday Book of medieval Britain after the Norman Invasion, the social engineering projects described in James Scott's Seeing like a State (1998), or the “mapping the world” project that David Nye described in America as Second Creation (2004). This paper will explore both the instrumental and cultural differences among testing as ritual, testing as mobility control, and testing as state-building.

One way to view ‘equitable pedagogy’ is through an opportunity to learn (OTL) lens, meaning that regardless of race, class, or culture, a student has access to rigorous and meaningful content, as well as appropriate resources and instruction necessary to learn and demonstrate understanding of that content. Assessment holds a unique position in the classroom in that it can both uncover whether inequitable conditions exist (i.e., performance gaps, denied OTL) and provide an OTL by mediating communication between teacher and students regarding learning progress and what is important to learn. Nevertheless, individuals entering teacher education programs often hold deficit views toward marginalized students, such as Language Minorities (LMs), believe that assessment strictly serves to evaluate learning, and do not do consider how language and culture influence student thinking–views supplanting assessment’s role at supporting an equitable pedagogy for LMs. Through surveys, interviews, program artifacts, and classroom observation, I report on a case study of one pre-service physics teacher, Dean, to depict how his expertise at assessing science did evolve throughout his yearlong teacher education program in terms of (a) becoming more knowledgeable of the role of language and (b) developing a belief in incorporating ‘discourse’ while assessing science. Within the case study, I analyze one particular episode from Dean’s teaching practicum to highlight remaining challenges for pre-service teachers to integrate science and language in classroom assessment—namely, interpreting students’ use of language along with their understanding of core science ideas. The findings underscore the need for connecting language and equity issues to content-area assessment in teacher preparation.

Integrating research experiences into undergraduate life sciences curricula in the form of course-based undergraduate research experiences (CUREs) can meet national calls for education reform by giving students the chance to “do science.” In this article, we provide a step-by-step practical guide to help instructors assess their CUREs using best practices in assessment. We recommend that instructors first identify their anticipated CURE learning outcomes, then work to identify an assessment instrument that aligns to those learning outcomes and critically evaluate the results from their course assessment. To aid instructors in becoming aware of what instruments have been developed, we have also synthesized a table of “off-the-shelf” assessment instruments that instructors could use to assess their own CUREs. However, we acknowledge that each CURE is unique and instructors may expect specific learning outcomes that cannot be assessed using existing assessment instruments, so we recommend that instructors consider developing their own assessments that are tightly aligned to the context of their CURE.

Women who start college in one of the natural or physical sciences leave in greater proportions than their male peers. The reasons for this difference are complex, and one possible contributing factor is the social environment women experience in the classroom. Using social network analysis, we explore how gender influences the confidence that college-level biology students have in each other’s mastery of biology. Results reveal that males are more likely than females to be named by peers as being knowledgeable about the course content. This effect increases as the term progresses, and persists even after controlling for class performance and outspokenness. The bias in nominations is specifically due to males over-nominating their male peers relative to their performance. The over-nomination of male peers is commensurate with an overestimation of male grades by 0.57 points on a 4 point grade scale, indicating a strong male bias among males when assessing their classmates. Females, in contrast, nominated equitably based on student performance rather than gender, suggesting they lacked gender biases in filling out these surveys. These trends persist across eleven surveys taken in three different iterations of the same Biology course. In every class, the most renowned students are always male. This favoring of males by peers could influence student self-confidence, and thus persistence in this STEM discipline.