No Arabic abstract
A recent paper by Salehi et al. claims that the differences found between major demographic groups on scores in introductory college physics tests are due to differences in pre-college preparation. No evidence is produced, however, to show that preparation differences are more causally important than any other differences. In one case, the male/female difference, the paper actually provides evidence that preparation gaps are unimportant.
We have studied the impact of incoming preparation and demographic variables on student performance on the final exam in physics 1, the standard introductory, calculus-based mechanics course This was done at three different institutions using multivariable regression analysis to determine the extent to which exam scores can be predicted by a variety of variables that are available to most faculty and departments. We have found that the results are surprisingly consistent across the institutions, with the only two variables that have predictive power being math SAT/ACT scores and concept inventory pre-scores. The importance of both variables is comparable and fairly similar across the institutions. They explain 20 - 30 percent of the variation in students performance on the final exam. Most notably, the demographic variables (gender, under-represented minority, first generation to attend college) are not significant. In all cases, although there appear to be gaps in exam performance if one considers only the demographic variable, once these two proxies of incoming preparation are included in the model, there is no longer a demographic gap. There is only a preparation gap that applies equally across the entire student population. This work shows that to properly understand differences in student performance across a diverse population, and hence to design more effective instruction, it is important to do statistical analyses that take multiple variables into account. It also illustrates the importance of having measures that are sensitive to both subject specific and more general preparation. The results suggest that better matching of the course design and teaching to the incoming student preparation will likely be the most effective way to eliminate observed performance gaps across demographic groups while also improving the success of all students.
Physics lab courses are an essential part of the physics undergraduate curriculum. Learning goals for these classes often include the ability to interpret measurements and uncertainties. The Physics Measurement Questionnaire (PMQ) is an established open-response survey that probes students understanding of measurement uncertainty along three dimensions: data collection, data analysis, and data comparison. It classifies students reasoning into point-like and set-like paradigms, with the set-like paradigm more aligned with expert reasoning. In the context of a course transformation effort at the University of Colorado Boulder, we examine over 500 student responses to the PMQ both before and after instruction in the pre-transformed course. We describe changes in students overall reasoning, measured by aggregating four probes of the PMQ. In particular, we observe large shifts towards set-like reasoning by the end of the course.
As part of a larger research project into massively open online courses (MOOCs), we have investigated student background, as well as student participation in a physics MOOC with a laboratory component. Students completed a demographic survey and the Force and Motion Conceptual Evaluation at the beginning of the course. While the course is still actively running, we have tracked student participation over the first five weeks of the eleven-week course.
Graduate Teaching Assistants (GTAs) are key partners in the education of undergraduates. Given the potentially large impact GTAs can have on undergraduate student learning, it is important to provide them with appropriate preparation for teaching. But GTAs are students themselves, and not all of them desire to pursue an academic career. Fully integrating GTA preparation into the professional development of graduate students lowers the barrier to engagement so that all graduate students may benefit from the opportunity to explore teaching and its applications to many potential career paths. In this paper we describe the design and implementation of a GTA Preparation course for first-year Ph.D. students at the Georgia Tech School of Physics. Through a yearly cycle of implementation and revision, guided by the 3P Framework we developed (Pedagogy, Physics, Professional Development), the course has evolved into a robust and comprehensive professional development program that is well-received by physics graduate students.
The lack of diversity and the under-performance of underrepresented students in STEM courses have been the focus of researchers in the last decade. In particular, many hypotheses have been put forth for the reasons for the under-representation and under-performance of women in physics. Here, we present a framework for helping all students learn in science courses that takes into account four factors: 1) characteristics of instruction and learning tools, 2) implementation of instruction and learning tools, 3) student characteristics, and 4) students environments. While there has been much research on factor 1 (characteristics of instruction and learning tools), there has been less focus on factor 2 (students characteristics, and in particular, motivational factors). Here, we focus on the baseline motivational characteristics of introductory physics students obtained from survey data to inform factor 2 of the framework. A longitudinal analysis of students motivational characteristics in two-semester introductory physics courses was performed by administering pre- and post-surveys that evaluated students self-efficacy, grit, fascination with physics, value associated with physics, intelligence mindset, and physics epistemology. Female students reported lower self-efficacy, fascination and value, and had a more fixed view of intelligence in the context of physics compared to male students. Grit was the only factor on which female students reported averages that were equal to or higher than male students throughout introductory physics courses. These gender differences can at least partly be attributed to the societal stereotypes and biases about who belongs in physics and can excel in it. The findings inform the framework and have implications for the development and implementation of effective pedagogies and learning tools to help all students learn.