Publications

During a professional development course for graduate student teaching assistants (TAs), a question was asked-would you use a context-rich problem (presented via a narrative set in a real-world context, not broken into parts and sometimes even without an explicit question) in an introductory physics class, and if so, how? One graduate TA’s sentiment appeared to resonate with most of the other TAs in the class, ‘I will not use this at all.’. Though more experienced in teaching, physics faculty often share this point of view-less than half of interviewed faculty members indicated they appreciated yet would not use such a problem. But if we want students to become proficient problem-solvers, should we not employ a comprehensive toolbox containing a wide variety of problem-types? Is there not a place for a context-rich problem in our teaching or are we overlooking the benefits and utility of problems such as these? Evidence continues to suggest that TAs and faculty alike both appear to be reluctant to adopt some types of physics problems in their teaching, while relying almost completely on just a couple types of problems. Based upon education research data, we believe it is time to broaden those horizons.

The instructional lab setting has been found to be dominated by prescribed tasks and pre-prepared lab kits. This was explained by teachers' need to guide students to simultaneously progress through a lab curriculum, which prompts them to standardize the lab experience. Nevertheless, prominent professional associations have persistently called to better represent experimental research practices in the lab, and to grant students more agency in the experimental process by orienting them towards more open-ended lab experiences. This paper reports a lab activity designed to advance students' agency in the practice of experimental design, in a setting governed by a high-stakes national matriculation exam. Three hundred teachers of advanced level high-school physics experienced the lab activity in a national network of professional learning communities (PLCs). The activity was anchored in an experiment to determine the relationship between the current through a battery and its terminal voltage. It was designed to problematize students' considerations underlying the choices of the location of the voltmeter and the measuring scale of the ammeter, and the possible implications for the validity of the experimental results; e.g. control of the variables, as well as the range and the accuracy of measurements. Teachers first performed the lab activity as learners, discussed it in the PLC meeting, and finally reflected on their experience. Individual responses to the lab worksheets and the reflections were analyzed. Initially, teachers' considerations did not portray key aspects related to the validity of the experimental results, such as how design choices related to the location of the voltmeter and the ammeter measuring scale impacted the accuracy and range of the measurements and the control of variables. The teachers were highly engaged in the peer discussion in the PLC and found the lab activity valuable in raising students' awareness of important considerations in experimental design.

This article describes the redesign of a project-based course on soft and biological materials to include computational modeling. Including the construction of computational models in the course is described as a shift from constructivism-a theory that characterizes the development of formal reasoning, to constructionism-a theory that focuses on learning while constructing artifacts. This shift ameliorated two drawbacks in the original course: the limited conceptualization of entropy resulting from an unproductive use of the disorder metaphor, and the dependence of most students on the teacher for writing theoretical explanations for their final papers. In the redesigned curriculum, computer simulations provide concrete dynamic representations that students can draw upon for developing nuanced, formal reasoning on entropy and the 2nd law of thermodynamics. In addition, core computational models act as a flexible web that can be extended and modified, and allow a significant proportion of the students to build theoretical models on their own. We conclude that while the new design reflects a shift towards constructionism, we did not adopt a fully constructionist approach, rather a blend of constructivist and constructionist approaches.

Physics problems can be posed in different ways. Given a physics scenario, different problem types presenting that scenario in various ways can emphasize different instructional goals. In this investigation, we examined the views of physics graduate teaching assistants (TAs) enrolled in a semester-long TA professional development course about the instructional benefits of different types of introductory problems based upon the same problem scenario to generate discussion and reflection on their use in different instructional situations. The TAs were asked to list the pros and cons of the problem types, rank them in terms of their instructional benefit and the level of challenge they might produce for their students, and describe when and how often they would use different types of problems in their own classes if they had complete control of teaching the class. Here we report on TAs' views about two of these problem types that were regarded by TAs as the least instructionally beneficial of all problem types - the context-rich and multiple-choice formats. Many TAs listed no pros at all for these problem types, despite being explicitly asked for at least one pro. They viewed multiple-choice questions nearly exclusively as tools for high stakes summative assessment rather than their possible use as formative assessment tools, e.g., as clicker questions even in large classes. Similarly, TAs viewed context-rich problems as overly challenging, unnecessarily wordy, and too time consuming to be instructionally beneficial to their students. It is possible that in the written responses, TAs could have focused on the example problems provided to illustrate each problem type. Therefore, discussion in the TA professional development class and in the follow-up interviews explicitly included a focus on the general instructional benefits of well-designed multiple-choice and context-rich problems in different instructional contexts based upon the goals. It appears that TAs' sentiments were general views about these types of problems, and not just their views about the specific examples that the TAs were given in order to illustrate a problem type. While TAs' concerns have obvious validity and value, the benefits of well-designed multiple-choice questions as a formative assessment tool was not readily identified by them, nor did the TAs recognize the learning benefits associated with solving context-rich problems. Given the powerful ways multiple-choice and context-rich problems can be used for active engagement and formative assessment in different instructional contexts to meet diverse instructional goals, the lack of enthusiasm for these types of problems has implications for future TA professional development programs.

Explication and reflection on expert vs. novice considerations within the problem-solving process characterize a cognitive apprenticeship approach for the development of expert-like problem solving practices. In the context of grading, a cognitive apprenticeship approach requires that instructors place the burden of proof on students, namely, that they require explanations of reasoning and explication of problem-solving processes. However, prior research on instructors' considerations when grading revealed their reluctance to use such a grading approach, motivated by a perception of teaching that places the burden of proof on the instructor. This study focuses on physics graduate teaching assistants (TAs) who play a central role in grading. A short professional development activity was designed that involved eliciting TAs' perceptions regarding grading, presenting a cognitive apprenticeship-inspired grading rubric, followed by a discussion of the dilemma between placing the burden of proof on the instructor vs. the student. In this context, we examined TAs' grading considerations and approaches towards grading and the effect of the short professional development grading activity on them.

Research shows that expert-like approaches to problem-solving can be promoted by encouraging students to explicate their thought processes and follow a prescribed problem-solving strategy. Since grading communicates instructors' expectations, teaching assistants' grading decisions play a crucial role in forming students' approaches to problem-solving in physics. We investigated the grading practices and considerations of 43 graduate teaching assistants (TAs). The TAs were asked to grade a set of specially designed student solutions and explain their grading decisions. We found that in a quiz context, a majority of TAs noticed but did not grade on solution features which promote expert-like approaches to problem-solving. In addition, TAs graded differently in quiz and homework contexts, partly because of how they considered time limitations in a quiz. Our findings can inform professional development programs for TAs.

We compared the materialization of knowledge integration processes in class discussions that followed troubleshooting (TS) and problem-solving (PS) tasks and examined the impact of these tasks on students’ conceptual understanding. The study was conducted in two sixth-grade classes taught by the same teacher, in six lessons that constituted a third of a unit on simple electric circuits. In these lessons, one class was assigned PS tasks where students were asked to solve conceptual problems. Later they were asked to share their work in a class discussion. The other class was assigned TS tasks where students were asked to identify, explain, and correct the mistakes in “teacher-made” erroneous solutions to these same problems. They were also engaged later in a class discussion. We found that students’ performance on subsequent transfer problems was significantly higher for the TS class, in particular for students with low prior knowledge. We account for the difference in learning outcomes by the differences in the learning process: the TS tasks elicited more naïve ideas both in students’ worksheets as well as in class discussions, and the TS discussions involved more episodes where students developed criteria to discern scientifically acceptable and naive ideas. We also found differences in the format of students’ participation, where lower-achieving students participated in the TS discussions. The implications of these findings for future research are discussed.

We analyze the development in students’ understanding of fundamental principles in the context of learning a current interdisciplinary research topic—soft matter—that was adapted to the level of high school students. The topic was introduced in a program for interested 11th grade high school students majoring in chemistry and/or physics, in an off-school setting. Soft matter was presented in a gradual increase in the degree of complexity of the phenomena as well as in the level of the quantitative analysis. We describe the evolution in students’ use of fundamental thermodynamics principles to reason about phase separation—a phenomenon that is ubiquitous in soft matter. In particular, we examine the impact of the use of free energy analysis, a common approach in soft matter, on the understanding of the fundamental principles of thermodynamics. The study used diagnostic questions and classroom observations to gauge the student’s learning. In order to gain insight on the aspects that shape the understanding of the basic principles, we focus on the responses and explanations of two case-study students who represent two trends of evolution in conceptual understanding in the group. We analyze changes in the two case studies’ management of conceptual resources used in their analysis of phase separation, and suggest how their prior knowledge and epistemological framing (a combination of their personal tendencies and their prior exposure to different learning styles) affect their conceptual evolution. Finally, we propose strategies to improve the instruction of these concepts.

"Self-diagnosis tasks" aim at fostering students' learning in an examination context by requiring students to present diagnoses of their solutions to quiz problems. We examined the relationship between students' learning from self-diagnosis and the typicality of the problem situation. Four recitation groups in an introductory physics class (∼200 students) were divided into a control group and three intervention groups in which different levels of guidance were provided to aid students in their performance of self-diagnosis activities. The self-diagnosis task was administered twice, first in an atypical problem situation and then in a typical one. In a companion paper we reported our findings in the context of an atypical problem situation. Here we report our findings in the context of a typical problem situation and discuss the effect of problem typicality on students' self-diagnosis performance and subsequent success in solving transfer problems. We show that the self-diagnosis score was correlated with subsequent problem-solving performance only in the context of a typical problem situation, and only when textbooks and notebooks were the sole means of guidance available to the students for assisting them with diagnosis.

What happens when students are required to engage in a self-diagnosis task; in other words get time and credit for identifying mistakes they made assisted by a sample solution? We examine this question using data collected on 180 high school students in the Arab sector in Israel. Students were able to find significant differences between their solutions and the sample solution. Yet many did not provide self-explanations indicating that they acknowledged a conflict between their mental models and the scientific model. Further, students also addressed non-significant differences. They apparently referred to the sample solution as an ultimate template and identified external deviations from it as flaws or weaknesses. Students reflected on their personal solution process, and the materials used in the task. The findings suggest allocating time for scaffolding 'self-diagnosis'.

"Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. We have been investigating the extent to which introductory physics students can diagnose their own mistakes when explicitly asked to do so with different levels of scaffolding support provided to them. In our study in an introductory physics class with more than 200 students, the recitation classes were split into three different experimental groups in which different levels of guidance were provided for performing the self-diagnosis activities. We present our findings that students' performance was far from perfect. However, differences in the scaffolding in the three experimental groups (i.e. providing a correct solution and a self-diagnosis rubric) noticeably affected the resulting diagnosis.

To identify and describe the basis upon which instructors make curricular and pedagogical decisions, we have developed an artifact-based interview and an analysis technique based on multilayered concept maps. The policy capturing technique used in the interview asks instructors to make judgments about concrete instructional arfifacts similar to those they likely encounter in their teaching environment. The analysis procedure alternatively employs both an a priori systems view analysis and an emergent categorization to construct a multilayered concept map, which is a hierarchically arranged set of concept maps where child maps include more details than parent maps. Although our goal was to develop a model of physics faculty beliefs about the teaching and learning of problem solving in the context of an introductory calculus-based physics course, the techniques described here are applicable to a variety of situations in which instructors make decisions that influence teaching and learning.

Reflection on practice (ROP) serves to support teachers that introduce innovative instruction into their classrooms. There is an inherent dilemma between competing goals in ROP workshops: developing teachers' skills as reflective practitioners (process), vs. developing specific favored practices (result). This dilemma affects the evaluation of such workshops, as evaluation methods should align with the goals. In this paper we will gain insight on how to resolve the dilemma from the perspective of teaching scientific problem solving, where a similar dilemma between process and result is sharply manifested and thoroughly explored. Assessment methods and tools derived from this perspective were applied in a formative evaluation of a workshop for high school physics teachers. We will show how these analysis tools enabled us to identify differences in outcomes between versions of yearlong workshops that used different approaches to guidance of ROP. Our research can contribute to the planning and evaluation of ROP workshops.

This paper, presented at the 2002 Physics Education Research Conference, shares an initial hypothesis of instructors' beliefs about their role in helping students learn to solve problems in an introductory calculus-based physics course. Instructors see their teaching role as primarily providing resources and making suggestions, with little mentioning of how they influence the students to use the resources or follow the suggestions.

This paper presents preliminary hypotheses about a common core of faculty beliefs about how their students learn to solve problems in their introductory courses. Using a process of structured interviews and a concept map based analysis, we find that faculty appear to believe that students learn problem solving primarily through a process of reflective introspection (educators call this process metacognition) while they practice solving problems and getting assistance from example problem solutions.