Investigating the Role of an Inquiry-Based Biology Lab Course on Student Attitudes and Views toward Science
Abstract
Students’ academic experiences can influence their conceptualization of science. In contrast experts hold particular beliefs, perceptions, opinions, and attitudes about science that are often absent in first-year undergraduate students. Shifts toward more expert-like attitudes and views have been linked to improved student engagement, critical-thinking ability, conceptual understanding, and academic performance. In this study, we investigate shifts in attitudes and views toward science by students in four biology classes with differences in student enrollment, academic support, and instruction. We observe significant, positive effects of enrollment in a guided-inquiry lab course and academic performance on the percentage of expert-like student attitudes and views at the end of term. We also identify variation in two aspects of student attitudes and views: 1) confidence and interest and 2) understanding and acceptance. In particular, enrollment in the lab course boosts student confidence and interest in scientific inquiry in the short term, even for students with low academic performance or little English-language experience. Our results suggest that low-performing students in particular may require additional opportunities for experiential learning or greater academic support to develop expert-like perceptions of biology as a science.
INTRODUCTION
Students begin their undergraduate studies with ideas about what science is and how it is studied that may be very different from those of experts (Edmondson and Novak, 1993; Gire et al., 2009; Desaulniers Miller et al., 2010; Semsar et al., 2011; Hansen and Birol, 2014). Although there is some debate about the nature of science (for discussion, see Lederman et al., 2002; Liang et al., 2008), there is general agreement that experts view scientific knowledge as tentative, changeable, and influenced by culture and experience. Experts also recognize that creativity is required when creating hypotheses, designing experiments, and analyzing data (Abd-El-Khalick and Lederman, 2000; Liang et al., 2008). In contrast, students often view science as a defined body of knowledge and experimental inquiry as following a predetermined, rigid protocol. This sort of non–expert-like thinking by students is common in many disciplines, including biology (Allen and Tanner, 2009). One of the goals of science education is to shift students toward a more expert-like conceptualization of the nature of science, assisting students in overcoming cultural and societal biases if necessary (National Research Council [NRC], 1996; Hiebert, 2007; American Association for the Advancement of Science [AAAS], 2011; Hoskins et al., 2011).
Undergraduate courses with associated laboratory components provide an opportunity for students to actively engage in the process of scientific inquiry. Through laboratory activities, students can practice the critical-thinking and problem-solving skills that are required to design, implement, and interpret the results of an experiment and develop practical skills such as the use of equipment or specific techniques. By participating in scientific inquiry, students experience what it is like to contribute to scientific knowledge and are exposed to the tentative nature of science. Instructors can explicitly address elements of the nature of science as they guide students toward thinking and acting more like expert scientists. Education research has shown participation in inquiry to be an effective way of increasing student understanding, efficacy, enjoyment, and interest in science (AAAS, 2011; Hanauer and Dolan, 2014). However, without explicit instruction and experience in scientific inquiry, students may retain non–expert-like interpretations of how scientific knowledge is obtained (Eastwell, 2010). Furthermore, they may continue to view the process of science as inaccessible and/or personally irrelevant (Prince, 2004; Ambrose et al., 2010).
Students’ attitudes and perceptions about science can influence their level of engagement and, ultimately, their conceptual learning and academic performance (Osborne et al., 2003; Hofer, 2004; Deslauriers et al., 2011). Students who appreciate how science impacts their lives are more motivated to engage in scientific thinking (Allen and Tanner, 2005; Smith et al., 2005). They may also be better able to generate research questions and to design valid experiments that address those questions (Campisi and Finn, 2011). Students who have greater confidence and familiarity with scientific inquiry may also be more rigorous in critiquing experimental designs and evaluating the validity of evidence. There is therefore increasing interest in investigating and documenting both shifts in student attitudes and associated learning (Osborne et al., 2003; Perkins et al., 2005; Partin et al., 2011; Partin and Haney, 2012; Beck et al., 2014), and many tools have been developed for assessing student attitudes and views toward various aspects of science (Lederman et al., 1998, 2002; Tsai and Liu, 2005; Adams et al., 2006; Liang et al., 2006; Chen et al., 2013).
In assessing shifts in student attitudes, researchers need to be cognizant of how the transition to undergraduate studies and their students’ cognitive development can impact students’ learning (Perry, 1981; Bandura, 1986; Briggs et al. 2012). Most first-year undergraduate biology students have been academically successful in high school and often arrive at university confident in their beliefs about biology as a science and their own ability to succeed. If those beliefs are challenged during their first year of university, students may initially experience confusion and undermining of their sense of self-efficacy, which can lead to lower motivation to apply themselves (Ambrose et al., 2010). After their first year as undergraduates, students may demonstrate a decrease in confidence and revert to non–expert-like attitudes regarding science (Adams et al., 2006; Barbera et al., 2008; Butler et al., 2008; Semsar et al., 2011; Ding and Mollohan, 2015). For high-performing biology students, an initial decrease in expert-like attitudes may be followed by recovery and a move to more expert-like attitudes by the time students are in their fourth year of studies (Hansen and Birol, 2014). Low-performing students, however, may continue to demonstrate poor affective, behavioral, and cognitive outcomes in the biological sciences without targeted instruction or academic support. Identification of the factors that influence students’ attitudes in first-year biology and beyond would help to inform science educators as they strive to guide students toward a more expert-like understanding of science.
In this study, we investigate the attitudes and views of first-year students regarding the nature of biology as a science and scientific inquiry in biology. We also ask whether—and how—these traits change over the course of one term, and whether enrollment in an inquiry-based lab is associated with student transitions toward more expert-like attitudes and views.
METHODS
Study Populations
This study investigated the attitudes and views of 452 students enrolled in first-year biology classes at a large Canadian research university (student body: ∼52,000 students total, ∼41,000 undergraduates). Total enrollment in the first-year biology program is more than 1800 students per year. These first-year students arrive with variable prior experiences in high school science and choose to enroll in one of three different options for the same first-year biology course. These three lecture-based course options focus on similar topics in first-year biology (genetics, evolution, and ecology), but they differ in terms of enrollment criteria, class size, and pedagogy (Table 1). Classes A (surveyed in term 1) and B (surveyed in term 2) are both standard program classes with relatively large enrollment (up to 225 students per section). These sections are open to both science majors and nonmajors, but the majority of students are declared science majors with average high school grades of ≥ 90%. Students in these classes have access to drop-in help at the course Learning Centre. In contrast, class C (surveyed in term 2) is restricted to first-year students who are enrolled in a coordinated first-year science program (enrollment in this program is limited to 170 students per year). Students self-select for this cohort-based program and are automatically enrolled in the same sections of first-year biology, chemistry, and physics lecture and lab courses and in a calculus course. In addition to the lecture portion of the course, students in this program also attend required tutorials once a week (Table 1). Class D (surveyed in term 1) is part of a cohort-based program restricted to 75 first-year science students who are selected via a competitive application process. These students receive integrated instruction in the four science disciplines (including both lectures and workshops) and are enrolled in the same sections of first-year biology, chemistry, and physics labs.
Student demographics | ||||||
---|---|---|---|---|---|---|
Course designation | Average high school GPA | Faculty of Science | First-year | First-year lab course enrollment | Class size | Pedagogy |
First-year lecture courses standard program | ≥90%a | 50–75% (varies by term) | 90% | 30–60% (varies by term) | ≤225 | Lecture and active-learning exercises |
• Open-enrollment | Drop-in basis learning centre | |||||
• No specialized application process | ||||||
Coordinated first-year science program | 92.8 ± 7.7%b | 100% | 100% | 100% | 168 | Lecture and active-learning exercises |
• Students coenrolled in biology, chemis–try, physics, and math | Required tutorials that reinforce concepts from all science courses | |||||
• No specialized application process | ||||||
Integrated first-year science program | 95.6 ± 2.6%b | 100% | 100% | 100% | 75 | Lecture, problem-solving, and active-learning exercises |
• Biology, chemistry, physics, math topics are integrated across disciplines | Required weekly workshops that integrate all science courses | |||||
• Specialized application process | ||||||
First-year lab course standard program | ≥90%b | 75% | 90% | — | ≤25 | Inquiry-based, active learning exercises |
• Open-enrollment | Group term project requires experimental design, data collection, and analysis, and written and oral presentation of results | |||||
• No specialized application process |
A number of students we surveyed were also enrolled in the first-year biology laboratory course offered at this institution. This course guides students through the process of scientific inquiry: developing hypotheses, designing and conducting an experiment, analyzing data, presenting an oral report, and submitting a journal-style article describing their work. For students in classes A and B, enrollment in this lab course is optional (students in either class may or may not be enrolled in one of the multiple sections of lab courses offered each term; see Table 2). For students in classes C and D, enrollment in the first-year lab course is mandatory; students in class C are enrolled in term 2, and students in class D are enrolled in term 1.
% Students enrolled in lab course each term (term surveyed)a | ||||
---|---|---|---|---|
Course designation | Class | Sample size (n) | Term 1 | Term 2 |
Standard program | A | 164 | 29 | NA |
B | 130 | 31 | 28 | |
Coordinated first-year science program | C | 102 | 0 | 100 |
Integrated first-year science program | D | 56 | 100 | NA |
Survey Development
Several quantitative survey tools have been developed to assess student attitudes and views regarding the nature of science (Lederman et al., 2002; Tsai and Liu, 2005; Adams et al., 2006; Liang et al., 2006; Chen et al., 2013; for a list of earlier instruments, see Lederman et al., 1998). We were specifically interested in student attitudes and views toward the nature of science and scientific inquiry that may have been influenced by the inquiry-based lab course in which some of the students were enrolled. This included student attitudes and views toward designing and conducting experiments—attitudes and views that, to our knowledge, are not addressed by any existing surveys. Some items from existing surveys were relevant, however. We therefore adapted items from two existing surveys: the Student Understanding of Science and Scientific Inquiry survey (SUSSI; Liang et al., 2006, 2008) and the Colorado Learning Attitudes about Science Survey (CLASS; Adams et al., 2006; adapted for biology by Semsar et al., 2011). These surveys have a closed-ended format (efficient for large-scale, in-class data collection) and demonstrated effectiveness at measuring shifts in attitudes with our targeted student demographic (Birol et al., 2014; Hansen and Birol, 2014). Following a similar methodology to that of Semsar et al. (2011) in adapting items, we examined the SUSSI and the CLASS for appropriate items relating to scientific inquiry and the nature of science, then selected five SUSSI items and two CLASS items for use in our survey. To these items we added one relevant item that had been included in the original version of the SUSSI (Liang et al., 2006). We also created six items that probed knowledge and confidence relating to scientific inquiry. All items were statements that prompted students to select one of five Likert-type responses (“strongly disagree,” “disagree,” “uncertain,” “agree,” and “strongly agree”). Where necessary, we altered the wording of pre-existing items so they referred specifically to biology and experimentation. The final survey contained 14 items, with an equal number of “agree” and “disagree” expert responses. Together, these 14 items addressed five relevant nature of science components based on those identified in the literature (Table 3; Lederman et al., 2002; Liang et al., 2008). To ensure that students would interpret items in the manner intended, we first used the items (in randomized order) in three one-on-one, think-aloud interviews with first-year biology students. After the wording of five of the items was improved, the content and clarity of the final version of the attitudinal survey was evaluated by eight student interviews (Supplemental Table S1). Student interviews all followed the same protocol: subjects were randomly selected from a pool of first-year biology student volunteers; after consent was obtained, students were interviewed for up to an hour; and all interviews were audio-recorded. We also collected data regarding the accuracy and relevance of survey items by surveying 22 experts from our institution. We deliberately included in this group of experts both teaching and research faculty from a variety of biological disciplines that incorporate experimentation: cell biology, physiology, genetics, and ecology. Experts were shown the same Likert-type items used in the final student survey. If an expert responded “uncertain” to any item, he or she was asked to elaborate on this response; that is, whether it was due to a lack of certainty regarding the meaning of those statements or due to lack of a formed opinion on those topics. Expert agreement for each survey item was calculated as the percentage of experts who agreed with the expected expert-like response.
Nature of science component | Attitudinal survey items | % Expert agreement |
---|---|---|
I. Tentativeness of scientific knowledge | Expected response: agree (+) or disagree (−) | |
1. Biology knowledge gained through accurate experimentation will NOT be changed.a (−) | 64b | |
2. Biologists can NEVER be certain that the answer to a biology research question is correct.c (+) | 36b | |
3. Biologists do NOT use their imagination because it can interfere with scientific reasoning.a (−) | 100 | |
II. Subjectivity, objectivity, and inferences in science | 4. If the same biology experiment is done more than once, the data that are collected should always be the same.c (−) | 77b |
5. Biologists may make different interpretations based on the same observations.a (+) | 95 | |
6. Biology research is influenced by the researcher’s culture and social background.a (+) | 73b | |
III. Scientific methods | 7. The more hypotheses an experiment attempts to test, the better.c (−) | 82 |
8. Biologists all follow the same step-by-step scientific method.a (−) | 73b | |
IV. Relevance and accessibility of scientific knowledge/inquiry | 9. Experiments that are done under lab conditions can provide information that applies to the real world.c (+) | 100 |
10. I am confident that I can design a valid biology experiment.c (+) | 100 | |
11. If I had the necessary materials, I could conduct a successful biology experiment.c (+) | 81 | |
12. I think about the biology I experience in everyday life.d (+) | 100 | |
V. Value and purpose of pure science | 13. The study of biology is only useful when it directly benefits human health or well-being.d (−) | 86 |
14. The primary purpose of doing a biology experiment is to establish facts.e (−) | 45b |
Survey Administration
Students completed the survey in class A and class D during term 1 (September – December 2012), and in class B and class C during term 2 (January – April 2013; see Table 2 for details regarding sampling design). Pretests were given during the second week of classes, and posttests were given during the last two weeks of classes. Survey items were presented to all students in the same randomized order we used for student interviews during the development of the survey. We also collected demographic data regarding students’ program of study, gender, and English-language experience (years of English as the primary language at home or at school). Data collection and all other aspects of this study complied with our Behavioural Research Ethics Board–approved protocol (BREB H09-03080).
Once the student data were collected, we surveyed the instructors of classes A–D in order to identify relevant differences in instruction regarding attitudinal survey topics. Topics that were mentioned only tangentially or discussed only with students during office hours were not considered to be part of explicit instruction.
Data Analysis
Only responses from consenting first-year students who had completed both the pre- and the posttest were included in our data analysis. Participation in each course was confirmed based on the presence or absence of a final grade for that course. We collapsed responses along the five-point Likert scale into three categories (“expert-like,” “non–expert-like,” and “uncertain”), based on recommendations in the literature (Adams et al., 2006; Semsar et al., 2011). Both non–expert-like and uncertain responses were considered incorrect when calculating individual student scores (i.e., percentage of the attitudinal survey items answered in an expert-like manner). Based on feedback from experts, six of the items (1, 2, 4, 6, 8, and 14) contained vague and/or ambiguous statements and showed low expert agreement (i.e., <80%). These six items were therefore excluded from the remainder of the analysis (Table 3; see Supplemental Table S2 for a list containing only those items included in the analysis).
In general, our survey score data violated the assumption of normally distributed differences (Shapiro-Wilk test) but did satisfy the assumption of homogeneity of variances (Levene’s test); we therefore used two-tailed Wilcoxon signed-rank tests for matched pairs to test for significant differences in students’ matched pre- and posttest attitudinal survey scores. Two-tailed Wilcoxon rank-sum tests were used to make pairwise comparisons of average test scores between groups of students, for both the pre- and posttest. Pearson’s chi-squared tests were used to make comparisons among lecture classes regarding the proportion of students belonging to various demographic groups (i.e., based on English-language experience, gender, and faculty of enrollment). Bonferroni-corrected α values were used to determine statistical significance, based on the number of comparisons made when testing each statistical hypothesis. In all figures, error bars indicate 95% confidence intervals; throughout the text, ± values indicate SEM. All reported confidence intervals are based on 2000 replicates obtained via nonparametric bootstrapping.
To investigate factors associated with variation in students’ posttest scores on the attitudinal survey, we treated pre- and posttest scores and lecture course and lab course final grades as continuous variables for the purposes of regression analysis. Class (i.e., A, B, C, or D) was initially included as a random variable in a linear mixed-model analysis of the data. After confirming that this random effect was not significant, we carried out the rest of our analysis using fixed-effects linear models (i.e., multiple regressions). We coded the following independent categorical variables as dummy variables: course designation (reference level = integrated first-year program vs. coordinated first-year program vs. standard program); faculty (student enrolled in faculty of science versus other faculty); English-language experience (≥10 years of English as a primary language at home or school vs. <10 years); gender (female vs. male); term (term 1 vs. term 2); and lab course enrollment (reference level = never enrolled vs. previously enrolled vs. currently enrolled). “Previously enrolled” indicated that the student had been enrolled in and received a final grade for the lab course in the term preceding the survey, whereas “never enrolled” indicated that the student had never been enrolled in the laboratory course. “Lab course enrollment” was later recoded as “current lab course enrollment” (currently enrolled vs. previously or never enrolled) after determining that differentiating “previously” from “never enrolled” had no significant effect. The statistical assumptions of homogeneity, independence, and normality of standardized residuals were confirmed for all linear models. All multiple regression analyses were performed with R, version 3.1.2 (R Core Team, 2014) using the nlme package (version 3.1-118), following a backward stepwise procedure for selecting variables; the preliminary linear mixed-model analyses testing for random effects were run using the lme4 package (version 1.1-7).
To examine relationships among the items and identify potential underlying factors in student responses to the attitudinal survey, we conducted an exploratory factor analysis of students’ posttest responses using JMP, version 9.0.1 (SAS Intitute, 2010). Because we were interested in general rather than class-specific patterns, responses from all four classes (N = 452) were pooled for this analysis. We used principal components to fit the factors, followed by varimax rotation. Factors were identified based on inspection of the scree plot to determine the point of inflection, as well as consideration of the interpretability of each factor. A rotated factor loading was considered to be statistically meaningful if it exceeded 0.32 (Yong and Pearce, 2013).
On the basis of the results of our factor analysis, we sorted the attitudinal survey items into groups and recalculated student pre- and posttest scores (% expert-like responses) for each factor grouping. We then repeated our Wilcoxon signed-rank tests and linear (mixed and fixed effects–only) model analyses as outlined above, using student posttest scores for each factor grouping as dependent continuous variables. Figures were produced using either the R package ggplot2 (version 1.0.0) or Microsoft Excel, version 14.4.9 (Microsoft Corporation, 2010).
RESULTS
Class Instruction
For all four lecture classes, students received 3 hours of biology lectures per week, and all instructors intentionally illustrated concepts in their lectures using empirical data. All instructors also used clicker (personal response system)-based questions and small-group activities to promote active learning and peer-to-peer discussion. However, the extent to which instructors discussed elements of the nature of science and scientific inquiry with their students varied. In general, topics that were addressed in the attitudinal survey were not explicitly included in lecture course instruction. In contrast, the lab course curriculum explicitly addressed five of the eight survey item topics (Table 4).
First-Year lecture courses | |||||
---|---|---|---|---|---|
Factor | Question | Classes A and B: standard program | Class C: Coordinated first-year science program | Class D: Integrated first-year science program | First-year lab course |
Factor 1: | 11 | No | No | No | Yes |
Confidence and interest | 10 | No | Yes | No | Yes |
12 | No | Yes | No | No | |
Factor 2: | 13 | No | No | Yes | No |
Understanding and acceptance | 5 | No | No | No | Yes |
3 | No | No | No | Yes | |
9 | No | No | No | Yes | |
7 | No | No | No | No | |
Items with <80% expert agreement | 1 | No | No | No | Yes |
2 | No | No | No | Yes | |
4 | No | No | No | Yes | |
6 | No | No | No | No | |
8 | No | Yes | No | Yes | |
14 | No | No | No | Yes |
Attitudinal Survey Results
Overall mean posttest scores were not significantly greater than mean pretest scores, except for students in class C (Figure 1). Students in class D scored higher on the pretest than students in any of the other classes (class D: mean pretest% expert-like responses = 78.8 ± 2.2%; vs. class A: 67.20 ± 1.4%, χ2 = 16.9, df = 1, p < 0.0001; class B: 68.8 ± 1.7%, χ2 = 9.9, df = 1, p = 0.0016; class C: 70.3 ± 1.6%, χ2 = 9.6, df = 1, p = 0.002). Student pretest scores were not significantly different between classes A, B, and C (α = 0.0083). At the posttest level, there was no longer a significant difference between students in classes C and D (class C: mean posttest% expert-like responses = 77.2 ± 2.0%; class D: 77.9 ± 2.6%; α = 0.0083). Students in classes A and B continued to score lower than students in class D (class A: 69.4 ± 1.5%, χ2 = 10.3, df = 1, p = 0.0014; class B: 70.2 ± 1.8%, χ2 = 7.0, df = 1, p = 0.0083) and class C (class A: χ2 = 10.9, df = 1, p = 0.001; class B: χ2 = 7.1, df = 1, p = 0.0077). Expert agreement across all survey items was 92.6 ± 2.0% (n = 22).
Our multiple regression analysis suggests that several factors influenced students’ attitudinal survey responses at the end of term (Table 5). The strongest predictor of a student’s posttest score was his/her pretest score. Other positive predictors of posttest score included current enrollment in the lab course and 10 or more years of English-language experience. The interaction terms for these variables were not significant. All other factors being equal, being currently enrolled in the lab course and having 10 or more years of English-language experience each increased students’ posttest scores by ∼5–7% (Table 5 and Figure 2). Enrollment in the Faculty of Science, course designation, term, and gender effects on posttest scores were all nonsignificant in light of the other effects.
Dependent variable = overall posttest score (% expert-like responses)a | |
---|---|
Independent variables | β [95% CI]; β |
Intercept | 30.09 [24.11, 36.13] |
Currently enrolled in lab course | 5.45 [2.27, 8.53]; 0.14 |
≥10 years English experience | 7.46 [3.55, 11.70]; 0.17 |
Overall pretest score | 0.49 [0.41, 0.57]; 0.46 |
Multiple R2 | 31.1% |
Adjusted R2 | 30.6% |
F (df1, df2) | 62.47 (3, 416) |
p | <2.2 × 10−16 |
n | 420b |
Our exploratory factor analysis suggested that the eight items could be grouped into two factors on the basis of students’ posttest responses. Inspection of the scree plot showed that eigenvalues began leveling off after the second component (Supplemental Figure S1). Only the first two factors had eigenvalues of ≥1. Furthermore, extracting two factors resulted in two distinct clusters of items, with no cross-loadings (i.e., all items had a loading of 0.32 or higher for one factor and only one factor; see Table 6 for details). Together, these factors account for 38.6% of the total shared variance in student responses; this magnitude of explained variance is comparable to that in other factor analyses of surveys regarding student attitudes toward science and research (Papanastasiou, 2005; Hilpert et al., 2008; Brookstein et al., 2011; Fujiwara et al., 2012). After carefully examining items in each factor grouping, we proposed general descriptions for each of the factors: factor 1: confidence and interest in scientific inquiry; factor 2: understanding and acceptance of scientific inquiry.
Nature of science componenta | Item | Factor 1 | Factor 2 |
---|---|---|---|
Factor 1: Confidence and interest in scientific inquiry (three items) | |||
IV | 11 | 0.787 | −0.041 |
IV | 10 | 0.775 | 0.016 |
IV | 12 | 0.509 | 0.179 |
Factor 2: Understanding and acceptance of scientific inquiry (five items) | |||
V | 13 | −0.061 | 0.596 |
II | 5 | −0.0364 | 0.570 |
II | 3 | 0.166 | 0.547 |
IV | 9 | 0.039 | 0.521 |
III | 7 | 0.190 | 0.500 |
Percentage of variance | 19.36 | 19.19 | |
Cumulative percentage | — | 38.55 |
Factor 1: Confidence and Interest in Scientific Inquiry
Three of the four items that had been assigned a priori to the same nature of science component (relevance and accessibility of scientific knowledge/inquiry; Table 3) fell into the first grouping. Two of these items directly assessed student confidence in designing and conducting biology experiments; the third assessed personal interest in biology outside course work. For these items, class C was the only class in which students scored significantly higher in the posttest than in the pretest (Figure 3A). Class D students had relatively high factor 1 pretest% expert-like responses compared with other classes; however, this difference was only significant for class A (class D: 61.9 ± 4.4%; class A: 43.9 ± 2.5%, χ2 = 12.4, df = 1, p = 0.0004; class B: 49.2 ± 3.0%; class C: 48.7 ± 3.4%; α = 0.0083). There were no significant differences in factor 1 pretest scores between students who were enrolled in the lab course and those who were not for either class A or B. On the posttest, both classes A and B had a significantly lower percentage of expert-like responses than class D (class D: 70.8 ± 4.5%; vs. class A: 47.8 ± 2.6%, χ2 = 19.0, df = 1, p < 0.0001; vs. class B: 51.5 ± 3.0%, χ2 = 13.9, df = 1, p = 0.0002; α = 0.0083). class A posttest% expert-like responses were also significantly lower than those of class C (class C: 62.7 ± 3.5%; χ2 = 11.5, df = 1, p = 0.0007). There were no significant differences between classes A and B, or class C and D, in either pre- or posttest scores on factor 1 items. In general, student scores were lower for factor 1 items than for factor 2 (understanding and acceptance of scientific inquiry). Lecture course final grades were not significantly associated with students’ posttest scores; instead, current enrollment in the lab course was a strong positive predictor (14.09% increase in expert-like responses), followed by English-language experience (8.14% increase in expert-like responses; see Table 7 and Figure 4A). No other variables were significant predictors of factor 1 posttest scores. Expert agreement was 92.4 ± 3.0% for these items (n = 22).
Dependent variable = posttest scores (% expert-like responses) | ||
---|---|---|
Factor 1: Confidence and interest | Factor 2: Understanding and acceptance | |
Independent variables | β [95% CI]; β | β [95% CI]; β |
Intercept | 18.33 [12.13, 24.60] | 29.14 [15.82, 42.59] |
Currently enrolled in lab course | 14.09 [8.83, 19.48]; 0.20 | — |
Lecture course final grade | — | 0.25 [0.08, 0.42]; 0.14 |
≥10 years English experience | 8.14 [2.03, 14.32]; 0.10 | 7.22 [2.37, 12.12]; 0.16 |
Pretest score | 0.49 [0.41, 0.57]; 0.48 | 0.36 [0.24, 0.47]; 0.32 |
Multiple R2 | 31.7% | 20.5% |
Adjusted R2 | 31.2% | 19.9% |
F (df1, df2) | 64.38 (3, 416) | 35.67 (3, 416) |
p | <2.2 × 10−16 | <2.2 × 10−16 |
n | 420a | 420a |
Factor 2: Understanding and Acceptance of Scientific Inquiry
The majority of attitudinal survey items (five out of eight) fell into the second factor grouping. There were no significant differences between students’ pre- and posttest scores for these items in any of the four classes (Figure 3B). Pretest% expert-like responses in class C (83.3 ± 1.6%) were not significantly different from those in class D (88.9 ± 2.0%; α = 0.0083). Although class D scored higher on factor 2 items in the pretest than classes A and B (class A: 81.2 ± 1.5%, χ2 = 7.1, df = 1, p = 0.0077; class B: 80.6 ± 1.7%, χ2 = 8.4, df = 1, p = 0.0038), posttest% expert-like responses were not significantly different between any of the classes (class A: 82.4 ± 1.6%; class B: 81.4 ± 1.9%; class C: 85.9 ± 1.9%; class D: 82.1 ± 3.0%; α = 0.0083). Compared with the items in the first factor grouping (confidence and interest in scientific inquiry), students scored relatively high on factor 2 items. In addition to pretest scores, students’ lecture course final grades and English experience were both positive predictors of factor 2 posttest scores; no other variables had significant effects (Table 7 and Figure 4B). Expert agreement was 92.7 ± 2.1% for these items (n = 22).
Student Demographics and Academic Performance
There were no significant differences among lecture classes in English-language experience (χ2 = 6.7, df = 3, N = 420, p = 0.083); on average, 26.2% students reported fewer than 10 years of English experience. The four classes also had equivalent proportions of male versus female students (61.0% female; χ2 = 5.8, df = 3, N = 438, p = 0.12). As expected, classes A and B had fewer Faculty of Science students (74.4 and 56.2%, respectively) than classes C and D (100%). Lecture course final grades were higher in class D (78.1 ± 1.7%) than in any of the other classes, although this difference was only significant for classes B and C (class A: 74.8 ± 0.9%; class B: 73.2 ± 0.9%, χ2 = 10.6, df = 1, p = 0.0011; class C: 73.2 ± 0.8%, χ2 = 13.4, df = 1, p = 0.0002; α = 0.0083).
DISCUSSION
Our investigation shows that it is possible for first-year students to acquire greater confidence and interest in the nature of science and the process of scientific inquiry over the course of one term. Students in our study who were enrolled in an inquiry-based lab course became significantly more expert-like in their attitudes and views toward scientific inquiry and in their confidence and self-efficacy as scientists. Although such shifts have been reported in comparisons of first-year and fourth-year biology students (Semsar et al., 2011; Hansen and Birol, 2014), it is unusual to see significant shifts toward more expert-like attitudes and views in the first year of studies (Brewe et al., 2009; Semsar et al., 2011; Ding and Mollohan, 2015) or consistently across diverse aspects of scientific inquiry (Desaulniers Miller et al., 2010; Birol et al., 2014).
We observed significant shifts toward more expert-like attitudes and views in one of the four classes we surveyed (Figure 1). The students in this class (class C) started with relatively non–expert-like attitudes regarding the nature of science, as did students in classes A and B. However, by the end of the term, class C students had made small but significant transitions toward more expert-like responses, comparable to those observed in class D. Class D students expressed relatively more expert-like attitudes and views than students in the other classes preinstruction, but showed no significant differences in attitudes and views postinstruction (Figure 1). Others have also found that certain groups of students (e.g., science majors, high-performing students) express more expert-like attitudes preinstruction, followed by a subsequent deterioration or lack of significant improvement in attitudes postinstruction (Hansen and Birol, 2014; Ding and Mollohan, 2015). Students in class D were expected to be high performing and science oriented for several reasons: these students were all science majors, had higher average high school grade point averages (GPAs) than students in other classes, and were required to take part in a specialized application process that likely precludes enrollment by students with low interest or aptitude in the sciences (Table 1; Dryden et al., 2012).
Our general observation that students begin their first-year of university with relatively novice-like attitudes and views regarding science is consistent with findings reported elsewhere for students in biology (Desaulniers Miller et al., 2010; Semsar et al., 2011; Birol et al., 2014; Hansen and Birol, 2014; Ding and Mollohan, 2015) and other science disciplines (Perkins et al., 2005; Adams et al., 2006; Barbera et al., 2008; Otero and Gray, 2008; Brewe et al., 2009). It is not uncommon for students to demonstrate a regression in expert-like attitudes and views or a decrease in self-confidence in the first year of their studies (Butler et al., 2008); in contrast, some of the students in our study appear to have improved or maintained their attitudes and views regarding science and scientific inquiry. Despite this, mean overall student survey scores at the end of term were still significantly below those of experts (Figure 1). This suggests that many students continued to hold relatively novice-like attitudes and views even at the end of the term, possibly due to particularly persistent non–expert-like attitudes and views or resistance to questioning and revising their beliefs (Perry, 1970; Magolda, 1992).
Looking across classes, our results indicate that current enrollment in the lab course may be an important predictor of student attitudes and views toward science (Figure 2 and Table 5). Using exploratory factor analysis, we extracted two important axes of variation in students’ posttest responses: confidence and interest in scientific inquiry; and understanding and acceptance of scientific inquiry. By considering each of these elements individually, we were able to gain additional insight into the various factors related to changes in student attitudes and views.
Factor 1: Confidence and Interest in Scientific Inquiry
Factor 1 was characterized by three items that fell into the predetermined nature of science component: relevance and accessibility of scientific knowledge/inquiry (Tables 2 and 6). These items directly addressed students’ ability to relate biological knowledge to their everyday experiences, and their confidence in designing and conducting experiments. Three of the classes did not shift significantly with regard to these items; classes A and B maintained a relatively low level of expert-like attitudes and views toward confidence and interest in scientific inquiry (<52%), whereas class D exhibited a nonsignificant shift from 61.9 to 70.8% between the beginning and end of the term. In contrast, class C made significant gains in terms of expert-like responses to factor 1 items, from 48.7 to 62.7% (Figure 3A). These gains may be due in part to the fact that all of the students in class C were enrolled in the lab course during the term in which they were surveyed (Table 2); the results of our multiple regression analysis indicate that current enrollment in the lab course did have a positive effect on students’ factor 1 posttest scores (Table 7). In addition, these students were also the only ones to receive explicit, lecture course instruction in two of the three topics related to factor 1 items (Table 4). Explicit instruction regarding the scientific process may have increased student familiarity and interest; the experience of an inquiry-based lab course would have provided these students with practice doing science.
Across classes, we found that students’ personal interest and confidence in scientific inquiry at the end of the term were independent of their academic success. All students, regardless of their academic ability, were equally receptive to gains in interest and confidence, whereas posttest scores for items relating to understanding and acceptance of scientific inquiry (factor 2) appeared to be limited by students’ academic ability (Table 7). This is in contrast with other reports of students’ perceived level of competence being correlated with their performance in undergraduate biology courses (Partin and Haney, 2012). Our findings suggest that experiential learning in the form of inquiry-based laboratories can contribute to increasing individuals’ confidence and/or self-efficacy in scientific investigation and can potentially increase students’ interest in science. Providing students with experience in scientific inquiry can increase their perception that they are able to do research (Handelsman et al., 2004; Adedokun et al., 2013; Robnett et al., 2015). Students who are confident in their abilities to complete a task are more likely to persist until it is completed, whereas individuals with low self-confidence often give up quickly when faced with difficulty (Bandura, 1986). If inquiry-based learning is able to increase confidence and interest even for low-performing students, it may also increase their motivation and time on task, thereby increasing their potential for learning gains in the long run. It is important to note, however, that students who had been enrolled in the lab course the previous term did not appear to have greater confidence or interest than students who had never taken the lab course, all other factors considered. A single course in the first year may therefore be insufficient in terms of improving student confidence and interest over the long term.
Factor 2: Understanding and Acceptance of Scientific Inquiry
Five of the final eight survey items fell into a cluster we identified broadly as understanding and acceptance of scientific inquiry (Table 6). These items address the value, relevance, and subjectivity of scientific inquiry and knowledge (Table 3). Students scored relatively high on factor 2 items at the start of the term (mean pretest% expert-like responses were ≥82% for all four classes; Figure 3B). Our results are generally consistent with those of related studies; Desaulniers Miller et al. (2010) found that students in both introductory and upper-level courses had relatively high pretest scores for the SUSSI items that are related to our factor 2 items. Although Birol et al. (2014) found no overall change in student responses to SUSSI items between the beginning and end of an introductory science seminar course, they also observed a relatively high proportion of expert-like attitudes in related items.
None of the classes in our study showed significant shifts toward more expert-like responses in the posttest for factor 2 items (Figure 3B). This may be partly due to the fact that, in almost all cases, topics relating to these questions were not explicitly discussed in any of the lecture classes (Table 4). Students who took the first-year lab course would have been exposed to many of these topics, but we found no evidence that enrollment in the lab course was related to student scores on questions related to understanding and acceptance of scientific inquiry (Table 7). We did find evidence, however, that high-performing students (based on lecture course final grades) exhibited marginal but significantly higher posttest scores on these items than low-performing students across classes. This suggests that students in our sample population who are interested in science and/or who are academically motivated will acquire expert-like attitudes regarding factor 2 items, regardless of the biology classes in which they are enrolled. It also suggests that low-performing students may continue to exhibit relatively non–expert-like understanding and acceptance of scientific inquiry, despite enrollment in inquiry-based courses.
Shifts in Student Attitudes and Views as a Result of Explicit Instruction in Scientific Inquiry
Our data clearly indicate that students who are enrolled in an inquiry-based lab course develop more expert-like attitudes toward biology as a science, especially in terms of their interest and confidence. This effect manifested itself across all four classes in our study, even when other sources of variation were accounted for (Tables 5 and 7). In the inquiry-based course, students are guided through carefully designed activities that help them think and act like scientists. This type of explicit instruction and engagement in the scientific process reinforces the nature of science concepts and facilitates shifts in student attitudes. Other researchers have found that, unless course curricula explicitly target attitudes and beliefs regarding science and scientific inquiry, student attitudes become less expert-like over the short term (Perkins et al., 2005; Adams et al., 2006; Barbera et al., 2008; Semsar et al., 2011; Birol et al., 2014; Ding and Mollohan, 2015). In contrast to these studies, biology courses with curricula designed to enhance development of student attitudes toward science have reported no regression or small gains in expert-like attitudes (Nomme and Birol, 2014). This link between course curricula and student attitudes has also been documented in physics (Perkins et al., 2005). In a revised physics class in which students were required to practice science through building, validating, and deploying models, Brewe et al. (2009) found that student attitudes toward physics became more expert-like. There is accumulating evidence that inquiry-based activities that emphasize the nature of scientific knowledge and the scientific method are important curricular elements to avoid regression and enhance the transition of student attitudes toward science.
Influence of English Experience and Attitudes toward Science
One of the concerns we had in the development and employment of the attitudinal survey was the high proportion of international students at our university. Approximately 25% of our sample population reported fewer than 10 years of English-language experience. We took great care during the survey development process to ensure that the attitudinal survey statements could be sufficiently understood by students, despite variation in English-language experience and abilities. Despite this, whether a student had more or fewer than 10 years of English experience was a significant predictor of his or her posttest score. Our results suggest that students in our study population with fewer than 10 years of English as a primary language should be expected to score 7.5–8% lower on the posttest, in terms of expert-like responses, than other students (Tables 5 and 7); this effect appears to be independent of other factors, including lab course enrollment. However, the effect of lab course enrollment on survey posttest scores was likewise independent of English-language experience. If participating in the inquiry-based lab course has some positive impact on confidence and interest in science, our results suggest that a lack of English-language experience does not impede that benefit. Possible relationships between English-language experience and understanding/confidence in scientific inquiry are worthy of further investigation.
Limitations
We acknowledge that there are several limitations to the conclusions we can make on the basis of our study. There is the potential for recruitment of biased samples in observational studies such as this one (Brownell et al., 2013), due to the fact that students self-select by way of enrolling in or applying for particular classes. Students’ motives for choosing particular classes may be influenced by their career goals and may be associated with certain attitudes and views toward science. At this institution, all students continuing in life sciences programs are required to enroll in the inquiry lab course. Whether students enroll in the inquiry lab course in the first or second term is usually determined by the schedule of other courses. We are confident, however, that our high rate of survey participation, large sample size, and analysis of pretest scores has helped to minimize concerns regarding sample bias. A second limiting factor is the method we used to characterize instruction regarding certain topics in the lecture and lab classes. Explicit classroom instruction in nature of science topics was inferred on the basis on qualitative, self-reported data (course materials and interviews with instructors); implementation of an appropriate classroom observations protocol would capture quantitative data on the occurrence of explicit instruction on these topics. Finally, we recognize that this study was conducted at a large research university and that the students are, by virtue of the high admission standards, those who have been relatively academically successful in high school. The results from our study may therefore not be directly applicable to some other postsecondary institutions; a wider survey of students in different institutions could address this concern. Despite these limitations, we are confident that our data effectively characterizes first-year biology students studying at this university.
CONCLUSIONS
First-year students begin their undergraduate studies holding a diversity of attitudes and views toward science, spanning the continuum from novice to expert. If one of the goals of a science undergraduate education is to engage first-year students in constructing scientific knowledge and shifting them toward expert-like attitudes and views, then providing students with inquiry-based experiences is a means to that end. Explicit and targeted instruction in the nature of science can be introduced to lecture courses, but our data suggest that experiential learning in the context of an inquiry-based lab may be required for students to gain confidence. Our findings indicate that enrollment in an inquiry-based lab course appears to benefit all students in terms of facilitating the development of more expert-like attitudes and views toward science. This is true even for students with fewer incoming expert-like attitudes and views or potential language barriers. However, our findings suggest that a onetime intervention in the first year may not be enough to shift students away from persistent non–expert-like attitudes and views. Concepts regarding the nature of science may need to be explicitly reinforced during subsequent years of study to achieve long-term shifts in these areas. Overall, our results support the hypothesis that the inclusion of explicit instruction related to the nature of science can positively influence student attitudes and views toward scientific inquiry—a finding that can be directly applied to the improvement of university science curricula.
ACKNOWLEDGMENTS
Thank you to all the students who participated in this study and, specifically, to the instructors, James Cooke, Brett Couch, and Pam Kalas, for allowing us to collect data in their classes and for providing information regarding their teaching practices. Also, thank you to the experts who donated their time to provide us with essential expert responses regarding our survey. Finally, thank you to the anonymous reviewers who provided constructive suggestions that greatly improved our manuscript. This research was financially supported through institutional funding for education research in the sciences (Teaching and Learning Enhancement Fund of the University of British Columbia and Science Centre for Learning and Teaching Development Fund).