Flipping the Classroom
|Cite this guide: Brame, C., (2013). Flipping the classroom. Vanderbilt University Center for Teaching. Retrieved [todaysdate] from http://cft.vanderbilt.edu/guides-sub-pages/flipping-the-classroom/.|
“Flipping the classroom” has become something of a buzzword in the last several years, driven in part by high profile publications in The New York Times (Fitzpatrick, 2012); The Chronicle of Higher Education (Berrett, 2012); and Science (Mazur, 2009); In essence, “flipping the classroom” means that students gain first exposure to new material outside of class, usually via reading or lecture videos, and then use class time to do the harder work of assimilating that knowledge, perhaps through problem-solving, discussion, or debates.
In terms of Bloom’s revised taxonomy (2001), this means that students are doing the lower levels of cognitive work (gaining knowledge and comprehension) outside of class, and focusing on the higher forms of cognitive work (application, analysis, synthesis, and/or evaluation) in class, where they have the support of their peers and instructor. This model contrasts from the traditional model in which “first exposure” occurs via lecture in class, with students assimilating knowledge through homework; thus the term “flipped classroom.”
What is it?| Does it work?|Theoretical basis| Key Elements| Where can I learn more? |References
What is it?
The flipped classroom approach has been used for years in some disciplines, notably within the humanities. Barbara Walvoord and Virginia Johnson Anderson promoted the use of this approach in their book Effective Grading (1998). They propose a model in which students gain first-exposure learning prior to class and focus on the processing part of learning (synthesizing, analyzing, problem-solving, etc.) in class.
To ensure that students do the preparation necessary for productive class time, Walvoord and Anderson propose an assignment-based model in which students produce work (writing, problems, etc.) prior to class. The students receive productive feedback through the processing activities that occur during class, reducing the need for the instructor to provide extensive written feedback on the students’ work. Walvoord and Anderson describe examples of how this approach has been implemented in history, physics, and biology classes, suggesting its broad applicability.
Maureen Lage, Glenn Platt, and Michael Treglia described a similar approach as the inverted classroom, and reported its application in an introductory economics course in 2000. Lage, Platt, and Treglia initiated their experiment in response to the observation that the traditional lecture format is incompatible with some learning styles.1 To make their course more compatible with their students’ varied learning styles, they designed an inverted classroom in which they provided students with a variety of tools to gain first exposure to material outside of class: textbook readings, lecture videos, Powerpoint presentations with voice-over, and printable Powerpoint slides.
To help ensure student preparation for class, students were expected to complete worksheets that were periodically but randomly collected and graded. Class time was then spent on activities that encouraged students to process and apply economics principles, ranging from mini-lectures in response to student questions to economic experiments to small group discussions of application problems. Both student and instructor response to the approach was positive, with instructors noting that students appeared more motivated than when the course was taught in a traditional format.
Eric Mazur and Catherine Crouch describe a modified form of the flipped classroom that they term peer instruction (2001). Like the approaches described by Walvoord and Anderson and Lage, Platt, and Treglia, the peer instruction (PI) model requires that students gain first exposure prior to class, and uses assignments (in this case, quizzes) to help ensure that students come to class prepared. Class time is structured around alternating mini-lectures and conceptual questions. Importantly, the conceptual questions are not posed informally and answered by student volunteers as in traditional lectures; instead, all students must answer the conceptual question, often via “clickers”, or handheld personal response systems, that allow students to answer anonymously and that allow the instructor to see (and display) the class data immediately. If a large fraction of the class (usually between 30 and 65%) answers incorrectly, then students reconsider the question in small groups while instructors circulate to promote productive discussions. After discussion, students answer the conceptual question again. The instructor provides feedback, explaining the correct answer and following up with related questions if appropriate. The cycle is then repeated with another topic, with each cycle typically taking 13-15 minutes.
Does it work?
Mazur and colleagues have published results suggesting that the PI method results in significant learning gains when compared to traditional instruction (2001). In 1998, Richard Hake gathered data on 2084 students in 14 introductory physics courses taught by traditional methods (defined by the instructor as relying primarily on passive student lectures and algorithmic problem exams), allowing him to define an average gain for students in such courses using pre/post-test data. Hake then compared these results to those seen with interactive engagement methods, defined as “heads-on (always) and hands-on (usually) activities which yield immediate feedback through discussion with peers and/or instructors” (Hake p. 65) for 4458 students in 48 courses. He found that students taught with interactive engagement methods exhibited learning gains almost two standard deviations higher than those observed in the traditional courses (0.48 +/- 0.14 vs. 0.23 +/- 0.04). Assessment of classes taught by the PI method provides evidence of even greater learning gains, with students in PI courses exhibiting learning gains ranging from 0.49 to 0.74 over eight years of assessment at Harvard University (Crouch and Mazur, 2001). Interestingly, two introductory physics classes taught by traditional methods during the assessment period at Harvard show much lower learning gains (0.25 in a calculus-based course in 1990 and 0.40 in an algebra-based course in 1999).
Carl Wieman and colleagues have also published evidence that flipping the classroom can produce significant learning gains (Deslauriers et al., 2011). Wieman and colleagues compared two sections of a large-enrollment physics class. The classes were both taught via interactive lecture methods for the majority of the semester and showed no significant differences prior to the experiment. During the twelfth week of the semester, one section was “flipped,” with first exposure to new material occurring prior to class via reading assignments and quizzes, and class time devoted to small group discussion of clicker questions and questions that required written responses. Although class discussion was supported by targeted instructor feedback, no formal lecture was included in the experimental group. The control section was encouraged to read the same assignments prior to class and answered most of the same clicker questions for summative assessment but were not intentionally engaged in active learning exercises during class. During the experiment, student engagement increased in the experimental section (from 45 +/- 5% to 85 +/- 5% as assessed by four trained observers) but did not change in the control section. At the end of the experimental week, students completed a multiple choice test, resulting in an average score of 41 +/- 1% in the control classroom and 74 +/- 1% in the “flipped” classroom, with an effect size of 2.5 standard deviations. Although the authors did not address retention of the gains over time, this dramatic increase in student learning supports the use of the flipped classroom model.
How People Learn, the seminal work from John Bransford, Ann Brown, and Rodney Cocking, reports three key findings about the science of learning, two of which help explain the success of the flipped classroom. Bransford and colleagues assert that
“To develop competence in an area of inquiry, students must: a) have a deep foundation of factual knowledge, b) understand facts and ideas in the context of a conceptual framework, and c) organize knowledge in ways that facilitate retrieval and application” (p. 16).
By providing an opportunity for students to use their new factual knowledge while they have access to immediate feedback from peers and the instructor, the flipped classroom helps students learn to correct misconceptions and organize their new knowledge such that it is more accessible for future use. Furthermore, the immediate feedback that occurs in the flipped classroom also helps students recognize and think about their own growing understanding, thereby supporting Bransford and colleagues’ third major conclusion:
“A ‘metacognitive’ approach to instruction can help students learn to take control of their own learning by defining learning goals and monitoring their progress in achieving them” (p. 18).
Although students’ thinking about their own learning is not an inherent part of the flipped classroom, the higher cognitive functions associated with class activities, accompanied by the ongoing peer/instructor interaction that typically accompanies them, can readily lead to the metacognition associated with deep learning.
What are the key elements of the flipped classroom?
1. Provide an opportunity for students to gain first exposure prior to class.
The mechanism used for first exposure can vary, from simple textbook readings to lecture videos to podcasts or screencasts. For example, Grand Valley State University math professor Robert Talbert provides screencasts on class topics on his YouTube channel, while Vanderbilt computer science professor Doug Fisher provides his students video lectures prior to class (see examples here and here. These videos can be created by the instructor or found online from YouTube, the Khan Academy, MIT’s OpenCourseWare, Coursera, or other similar sources. The pre-class exposure doesn’t have to be high-tech, however; in the Deslauriers, Schelew, and Wieman study described above, students simply completed pre-class reading assignments.
2. Provide an incentive for students to prepare for class.
In all the examples cited above, students completed a task associated with their preparation….and that task was associated with points. The assignment can vary; the examples above used tasks that ranged from online quizzes to worksheets to short writing assignments, but in each case the task provided an incentive for students to come to class prepared by speaking the common language of undergraduates: points. In many cases, grading for completion rather than effort can be sufficient, particularly if class activities will provide students with the kind of feedback that grading for accuracy usually provides. See a blog post by CFT Director Derek Bruff about how he gets his students to prepare for class.
3. Provide a mechanism to assess student understanding.
The pre-class assignments that students complete as evidence of their preparation can also help both the instructor and the student assess understanding. Pre-class online quizzes can allow the instructor to practice Just-in-Time Teaching (JiTT; Novak et al., 1999), which basically means that the instructor tailors class activities to focus on the elements with which students are struggling. If automatically graded, the quizzes can also help students pinpoint areas where they need help. Pre-class worksheets can also help focus student attention on areas with which they’re struggling, and can be a departure point for class activities, while pre-class writing assignments help students clarify their thinking about a subject, thereby producing richer in-class discussions. Importantly, much of the feedback students need is provided in class, reducing the need for instructors to provide extensive commentary outside of class (Walvoord and Anderson, 1998). In addition, many of the activities used during class time (e.g., clicker questions or debates) can serve as informal checks of student understanding.
4. Provide in-class activities that focus on higher level cognitive activities.
If the students gained basic knowledge outside of class, then they need to spend class time to promote deeper learning. Again, the activity will depend on the learning goals of the class and the culture of the discipline. For example, Lage, Platt, and Treglia described experiments students did in class to illustrate economic principles (2000), while Mazur and colleagues focused on student discussion of conceptual “clicker” questions and quantitative problems focused on physical principles (2001). In other contexts, students may spend time in class engaged in debates, data analysis, or synthesis activities. The key is that students are using class time to deepen their understanding and increase their skills at using their new knowledge.
Where can I learn more?
CFT Director Derek Bruff has a couple of good blog posts on flipping the classroom with some great embedded references. Find them here: http://www.cirtl.net/node/7788 and http://derekbruff.org/?p=901.
The flipped learning network is a professional learning community focused particularly on the use of screencasting in education.
Berrett D (2012). How ‘flipping’ the classroom can improve the traditional lecture. The Chronicle of Higher Education, Feb. 19, 2012.
Anderson LW and Krathwohl D (2001). A taxonomy for learning, teaching, and assessing: a revision of Bloom’s taxonomy of educational objectives. New York: Longman.
Bransford JD, Brown AL, and Cocking RR (2000). How people learn: Brain, mind, experience, and school. Washington, D.C.: National Academy Press.
Crouch CH and Mazur E (2001). Peer instruction: Ten years of experience and results. American Journal of Physics 69: 970-977.
DesLauriers L, Schelew E, and Wieman C (2011). Improved learning in a large-enrollment physics class. Science 332: 862-864.
Fitzpatrick M (2012). Classroom lectures go digital. The New York Times, June 24, 2012.
Hake R (1998). Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics 66: 64-74.
Lage MJ, Platt GJ, and Treglia M (2000). Inverting the classroom: A gateway to creating an inclusive learning environment. The Journal of Economic Education 31: 30-43.
Mazur E (2009). Farewell, Lecture? Science 323: 50-51.
Novak G, Patterson ET, Gavrin AD, and Christian W (1999). Just-in-Time Teaching: Blending Active Learning with Web Technology. Upper Saddle River, NJ: Prentice Hall.
Pashler H, McDaniel M, Rohrer D, and Bjork R (2008). Learning styles: Concepts and evidence. Psychological Science in the Public Interest 9: 103-119.
Walvoord BE, and Anderson VJ (1998). Effective grading: A tool for learning and assessment. San Francisco: Jossey-Bass.
1Although there is widespread belief that matching students’ preferred “learning styles” to instructional formats promotes learning, a 2008 review by Pashler and colleagues finds no evidence that this strategy promotes learning.
Cite this guide:
Brame, C., (2013). Flipping the classroom. Retrieved [todaysdate] from http://cft.vanderbilt.edu/guides-sub-pages/flipping-the-classroom/.
Brame, C., (2013). Flipping the classroom. Vanderbilt University Center for Teaching. Retrieved [todaysdate] from http://cft.vanderbilt.edu/guides-sub-pages/flipping-the-classroom/.
Photo Credit: Night Owl City via Compfightcc
Flipped learning—also referred to as inverted learning—extends the typical three-hour learning beyond the confines of classroom time through the use of online platforms. In flipped learning, part or all of direct instruction is delivered through videos and other media; and the class time is used for engaging students in collaborative, hands-on activities (Flipped Learning Network, 2014). Many colleges and universities have embraced flipped learning model as it provides opportunities for increased peer interaction and deeper engagement with the material (Johnson, Adams Becker, Estrada & Freeman, 2015). This pedagogical approach has gained such popularity in higher education that 2015 NMC Horizon Report listed flipped learning to be adopted in a large scale in 1 year or less (Johnson et al., 2015). According to a survey conducted by Center for Digital Education and Sonic Foundry, 29% of the higher education faculty in the US reported to be currently implementing flipped learning, and 27% reported to be planning to implement it in near future (Bart, 2013).
Flipped learning appears to be particularly well suited to engineering education because of its potential to “combine learning theories once thought to be incompatible—active, problem-based learning activities founded upon a constructivist ideology and instructional lectures derived from direct instruction methods founded upon behaviorist principles” (Bishop & Verleger, 2013, p. 1). Although engineering educators agree that students learn better when they engage in complex problems and projects (Lombardi & Oblinger, 2007), they are reluctant to forgo lecturing on theoretical and background information necessary for solving engineering problems (Bishop & Verleger, 2013). Flipped learning provides the midway between these two opposite viewpoints and is probably one of the few pedagogical innovations that have received considerable attention and interest (Mitchell, 2014). Despite this increasing interest, there does not seem to be an agreement on what flipped learning is and how effective it is in improving student learning (Sharples et al., 2014). Therefore, it is timely to analyze and synthesize research findings to describe the current state of knowledge and inform future research and development efforts.
Few articles reviewing flipped learning have been published to date (Estes, Ingram, & Liu, 2014; Hamdan, McKnight, McKnight, & Arfstrom, 2013) and only one of them focused specifically on engineering (Bishop & Verleger, 2013). Bishop and Verleger (2013) reviewed 24 studies related to the flipped classroom and concluded that studies mostly focused on student perceptions, which were generally positive and single-group designs. Highlighting the scarcity of studies objectively measuring the impact of flipped approach on student learning, these authors recommended conducting experimental or quasi-experimental studies to investigate objective learning outcomes. Although Bishop and Verleger's (2013) review has provided important considerations for engineering educators, their review is not categorized as a systematic review since their article selection process was not described, and it included studies that were published through the first half of 2012. However, our analyses indicated that approximately 90% of the empirical research on flipped learning was published in 2013 and 2014. Including more recent studies provides a more accurate and up-to-date picture of the current state of flipped learning in engineering education. The following research questions were addressed in this article by following the systematic review steps recommended by Borrego, Foster, and Froyd (2014).
- What are the trends in flipped classroom in engineering education research?
- What kinds of theoretical frameworks and evaluation methods have been adopted in engineering education investigating flipped learning?
- Is flipped learning effective in teaching engineering according to existing engineering education research?
- What are benefits and challenges of flipped learning as reported in engineering education research?
Article selection process
To ensure that relevant studies were located, a wide variety of databases were searched. The keywords searched in all the databases included “flipped” and “engineering” or “flipped” and “engineering education” or “inverted classroom” and “engineering” or “flipped classroom” and “engineering.” Figure 1 displays the complete article selection process based on the inclusion criteria.
As of May 2015, this search yielded 164 results after the duplicates were removed. The articles were organized and tabulated according to context (ie, engineering subdiscipline), and type (eg, empirical, practical, and editorial). The following inclusion criteria were applied: (a) empirical research on the flipped approach in engineering higher education contexts; (b) description of the flipped course design; (c) engineering students and faculty as participants; (d) publication in peer-reviewed journals or conference proceedings. As can be seen in Figure 1, final total of 62 studies were included in the final synthesis. Detailed information about each article is provided as Supporting Information (Table S1).
Several findings emerged as a result of this systematic review of 62 studies on flipped learning in engineering education.
Trends in the flipped learning and engineering education literature
Figure 2 displays the publication trend of proceedings, journal articles and the combined total from 2000 to 2014. Studies published in the first half of 2015—when data collection ended—are included in this review but not reported in Figure 2 since it does not represent an accurate picture of the whole year of 2015. The first article on flipped learning (using the term “inverted learning”) was published in 2003. From then on, research in this area was very limited, with zero to two or three publications a year until 2013. From 2013, flipped learning started sparking more interest amongst engineering education researchers, and 53% of the articles included in this synthesis were published in 2014. In addition, six studies included in this review were published in the first half of 2015 and they were all journal articles. Although conference proceedings outnumber the journal articles, the increasing trend seems to be similar for both of the publication venues. This trend indicates an increase in the number of engineering courses being converted into a flipped format after 2012.
The vast majority of the studies, 66%, were published in conference proceedings, and 34% were published in archival journals (Figure 3). The American Society of Engineering Education (ASEE) is the most common publication venue.
Theoretical frameworks and evaluation methods
This synthesis revealed a paucity of published studies that included a theoretical framework guiding the research and teaching practices. Out of the 62 studies, only 13 referred to a theoretical or conceptual framework. One of the most commonly cited rationales behind converting a course from the traditional to a flipped format was the use of in-class time for active learning exercises rather than for lecturing (Cavalli, Neubert, Mcnally, & Jacklitch-Kuikan, 2014; Velegol, Zappe, & Mahoney, 2015). The other frameworks are listed in Table 1. A detailed description of these theoretical frameworks can be found as Supporting Information (Supporting Material 2).
|Transactional theory||Chen, Wang, Kinshuk, and Chen (2014)|
|The Thayer system||Chetcuti, Hans, and Brent (2014)|
|Problem-based learning & collaborative learning||Chiang and Wang (2015)|
|Cooperative education||Choi (2013)|
|Combination of traditional and constructivist approaches||Davies, Dean, and Ball (2013)|
|Team-based learning||Ghadiri, Qayoumi, Junn, and Hsu (2014)|
|Technology acceptance model||Ivala, Thiart, and Gachago (2013)|
|Revised community of inquiry||Kim, Patrick, Srivastava, and Law (2014)|
|Socio-constructivist theory||Redekopp and Ragusa (2013)|
|Self-directed learning||Rutkowski (2014)|
|Inquiry-based learning||Schmidt (2014)|
Researchers adopted a range of data collection methods to evaluate flipped learning. Quantitative methods involved comparison of exam scores, surveys, course evaluations, institutional data (eg, retention rates) and system log data (eg, time spent on certain activities on a course management system). Use of qualitative data, such as interviews, classroom recordings and observations, was rather limited. A detailed discussion of the evaluation methods adopted in the studies can be found as Supporting Information (Supporting Material 2).
Effectiveness of flipped learning in teaching engineering
Researchers in 30 studies compared student learning in traditional classrooms to learning in flipped classrooms (Table 2). Thirteen studies exclusively reported that students in the flipped classroom outperformed their counterparts in the traditional classrooms. Of these, seven studies reported the statistical significance of their findings. In others, the authors reported an increase in average scores, but did not report a statistical analysis investigating the significance of the observed difference.
|Flipped is more effective||Amresh, Carberry, & Femiani (2013); Chao, Chen, and Chuang (2015); Chiang and Wang (2015)*; Fowler (2014); Kalavally, Chan, and Khoo (2014); Lemley et al. (2013); Mason, Shuman, and Cook (2013b)*; McGivney-Burelle and Xue (2013); Ossman and Warren (2014)*; Papadopoulos and Roman (2010)*; Redekopp and Ragusa (2013); Schmidt (2014)*; Swithenbank and DeNucci (2014); Thomas and Philpot (2012); Yelamarthi, Member, and Drake (2015)*|
|Flipped is more effective and/or no difference||Baepler, Walker, and Driessen (2014); Cavalli et al. (2014); Chetcuti, Hans, & Brent (2014); Choi (2013)|
|No difference||Buechler, Sealy, and Goomey (2014); Davies et al. (2013); Love, Hodge, Grandgenett, and Swift (2014); Mason, Shuman, and Cook (2013b); Olson (2014); Swift and Wilkins (2014); Talbert (2014); Velegol et al. (2015)|
|Flipped is less effective||Hagen and Fratta (2014); McClelland (2013)|
|Flipped is less effective and/or no difference||Lavelle, Stimpson, and Brill (2013)|
Four studies concluded mixed results in terms of learning gain. For example, Baepler et al. (2014) found that students in the flipped section performed significantly higher than the ones in the traditional section during the first year that the flipped approach was implemented, but this difference was not statistically significant in the second year. In nine other studies, researchers did not find any statistically significant difference between flipped and traditional formats in terms of student learning.
Two articles reported that students in the flipped classroom did not perform as well as their counterparts learning in a traditional environment. Hagen and Fratta (2014) observed that even intrinsically motivated students underperformed in the flipped environment. Students had negative perceptions toward the course and felt unprepared for the exams because they had to manage their own learning. Similarly, McClelland (2013) indicated that the average final score for students in the traditional format was significantly higher than the students in the flipped sections. Other researchers, on the other hand, did not find any statistically significant difference between the two formats in terms of exam scores; however, more students failed the course in the flipped section when compared to the average of nonpass in previous years' traditional offerings, and this difference was statistically significant (Lavelle et al., 2013).
To see if there was any difference between student performance in flipped and traditional formats, an analysis of variance was performed based on the mean scores reported in 25 studies. The results indicated that the mean score for flipped was higher than traditional format but this difference was not statistically significant. However, when we controlled for the author as a clustering effect, the difference was statistically significant at the p < .05 level F (1,102) = 4.26, p = .042.
Benefits and challenges of flipped learning
The results of this synthesis indicated that flipped learning provided various benefits and challenges for students and instructors. The benefits can be listed as flexibility, improvement in interaction, professional skills, and student engagement. Challenges included increased workload for faculty, student resistance, lack of opportunities for just-in-time questions, technical issues, decreased interest and neglected material.
One of the most commonly cited benefits of flipped learning was flexibility (Buechler et al., 2014; Kiat & Kwot, 2014; Mok, 2014; Simpson, Evans, Eley, & Stiles, 2003; Velegol et al., 2015). An added value of the flipped approach was being able to rewatch the lecture videos. Students could pause and rewind the videos, take notes and solve example problems while watching the lecture videos. Having access to course materials for 24/7 provided flexibility for students with different learning preferences and personal commitments. This flexible teaching and learning environment also created time for complex problem solving (Ankeny & Krause, 2014; Mok, 2014) and opportunities to cover more materials (Mason, Shuman, & Cook, 2013a, 2013b).
The rationale behind flipped learning is to use face-to-face class time for complex exercises where students can interact with each other and with the instructor. This synthesis concluded that students enjoyed working with their peers (Bailey & Smith, 2013; Ghadiri et al., 2014; Love et al., 2014; Talbert & Valley, 2012) and having the instructor available for help (Clark, Norman, & Besterfield-Sacre, 2014; Lemley et al., 2013; McGivney-Burelle & Xue, 2013; Mok, 2014; Swithenbank & DeNucci, 2014).
Student-centered instructional approaches, like flipped learning, not only help students learn the content but also provide opportunities to improve professional skills that “today's competitive global market and changing work environment demand engineers to possess” (Kumar & Hsiao, 2007, p. 18). Several authors argued that flipped learning contributed to students' professional skills such as life-long learning (Luster-Teasley, Hargrove-Leak, & Waters, 2014), learner autonomy (Kim, Kim, Khera, & Getman, 2014; Mok, 2014), critical thinking (Chetcuti et al., 2014) and interpersonal skills (Yelamarthi et al., 2015).
Another benefit that this synthesis revealed was student engagement (Lavelle et al., 2013). Several researchers found that students came to class better prepared (Chetcuti et al., 2014; Jungic, Kaur, Mulholland, & Xin, 2015; Mok, 2014; Papadopoulos & Roman, 2010), and they devoted more time and formed better study habits compared to traditional classroom approaches (Papadopoulos & Roman, 2010).
Although the findings in terms of class attendance varied, some researchers found that the flipped format increased attendance (Chen et al., 2014; Rutkowski, 2014) and retention rate (Kim, Patrick, et al., 2014; Love et al., 2014). For example, Rutkowski (2014) found that regular lecture attendance increased from 55% to 70% when the course was converted to the flipped format. Similarly, Chen et al. (2014) found out that students logged into the course platform more frequently to access course materials compared to the prior versions of the course.
Challenges of flipped learning
As with any new approach, flipped learning brings some challenges for instructors and students. The biggest challenge for instructors was the heavy workload prior to and during class. Converting a course from a traditional teaching approach to a flipped format required a reasonable amount of front-end investment from faculty members (Ghadiri et al., 2014; Kalavally et al., 2014). During class, on the other hand, one instructor had to serve many students requesting assistance (Clark et al., 2014).
Challenges for students included uninteresting online material, technical issues and insufficient knowledge about the new approach. For example, students in Amresh, Carberry, and Femiani's (2013) study found the online videos boring. Similarly, the length of the videos contributed to lack of interest in the material (Olson, 2014). Other researchers found that students could easily skip some of the materials in the flipped classrooms. For example, Ossman and Warren indicated that rather than watching the videos, students read the slides (2014). Velegol and her colleagues made the lecture attendance optional, so students who were able to finish their homework on their own chose not to attend the class (2015).
Although it is generally accepted that today's net generation students ubiquitously use various technological tools and applications in their daily lives, this synthesis implied that technical issues frustrated students (Clemens et al., 2013; Tague & Baker, 2014). Students complained about the connectivity speed which is assumed to have been resolved at least on higher education campuses (Everett, Morgan, Stanzione, & Mallouk, 2014).
Student resistance was another challenge that flipped learning instructors faced. Having gone through a traditional approach throughout their educational career, students felt overwhelmed when faced with a new approach that required them to actively participate in the learning process (Amresh et al., 2013; Bland, 2006; Gannod, Burge, & Helmick, 2008). Students who lacked metacognitive and organizational skills struggled in flipped classrooms (Margoniner, 2014) as they opined that they were not being taught; rather, they taught themselves (Talbert & Valley, 2012)
Trends in the flipped learning and engineering education literature
The publication trend indicates that there is a proliferating interest in flipped learning in engineering education. Benefits such as learning gain, flexibility, opportunities for interaction and student engagement seem to have encouraged several engineering educators to convert their traditional classrooms to a flipped format. However, the scarcity of archived journal publications indicates that research on flipped learning in engineering education is still in its infancy. The conference proceedings usually adopted a practice-oriented approach; and focused on documenting the design and development process and sharing some preliminary findings and student feedback. Further systematic research investigating different components and claims of flipped learning using various research methods is needed to establish flipped learning as an effective pedagogical approach in the field.
Theoretical frameworks and evaluation methods
As a critical component of disciplined research, theoretical frameworks help researchers to organize and create a strong argument to justify the significance of a given research problem and guide selection of appropriate data collection and analysis methods (Antonenko, 2015). More than 50% of the studies included in this review lacked a theoretical framework for implementing flipped learning in engineering education. If flipped learning has the potential to combine learning theories once thought to be incompatible, as Bishop and Verleger (2013) argued, then the research on flipped learning needs to detail how this combination can be successfully implemented with the aid of varied instructional technology tools. These models need to present strategies for engineering educators for designing, developing and evaluating instruction.
The most commonly cited motivation behind converting a course from the traditional to a flipped format was the use of in-class time for active learning exercises rather than for lecturing. However, active learning itself is an ambiguous term that has been used and interpreted differently by various researchers and practitioners (Prince, 2004). A multitude of activities ranging from pausing the lecture for a few minutes and asking students to compare notes with each other to simulations and games would fall under the category of active learning. Some of these activities do not necessarily require flipping the instruction. Therefore, specific pedagogical models that may fall under the umbrella of the term “active learning” such as case-based reasoning, problem-based learning and project-based learning could provide a clearer direction for researchers and practitioners.
Evaluation methods were limited to grade comparisons to measure learning gain and surveys to get student feedback. These methods provide valuable information about the role of flipped approach in student learning; however, they may fall short in analyzing the overall impact. Bishop and Verleger (2013) called for more experimental studies to investigate the effectiveness of the flipped approach, but this review indicated that more systematic qualitative and mixed-method approaches are needed to understand what flipped learning entails and how it supports student learning in various ways.
Effectiveness of the flipped learning
The results of this systematic review indicated that flipped learning was more effective than traditional lecture method in many cases. It would have been ideal to conduct a meta-analysis to make a definitive conclusion about the superiority of flipped approach over traditional approach; however, majority of the studies included in this study failed to report mean scores, standard deviations and number of observations required for a meta-analysis. The studies also used different measurements (eg, final course grades, exam scores, quiz scores) which made such a comparison difficult. However, one-way ANOVA test results based on the studies that reported a mean score indicated that students in the flipped approach learned the content as much as their counterparts in the traditional approach if not better.
Benefits and challenges of flipped learning
Flipped learning approach seemed to be promising in regards to the benefits it provides for students and instructors. Yet, the research focused on measuring the effectiveness of the new approach through comparisons to traditional approaches, and the conclusions about benefits were reported as additional findings. Therefore, further research is needed to investigate the transferability of these findings to different contexts. Specifically, the claims about the professional skills and increased interaction need to be investigated thoroughly. For example, only one study included in this review analyzed how students interacted with each other during face-to-face problem sessions and learned how their conversations shifted from simply recalling facts to conceptual discussions (Lin et al., 2014). Further research investigating the student engagement and interaction in the face-to-face sessions would help instructors who have hesitations about individual contributions in collaborative group assignments. This line of research can also produce a list of guidelines for successfully flipping an engineering course and help practitioners to identify areas of problems and develop interventions as needed.
Some of the challenges cited in these studies, such as heavy workload and technical issues, can be addressed effectively. Instructors might be advised to gradually convert their courses rather than doing it all at once because material development might be overwhelming. Although it may not be plausible to foresee every technical issue, making students aware of possible issues might reduce frustration. Some other challenges, on the other hand, raise some crucial concerns about the design of a flipped classroom. Studies that found a lack of engagement in the flipped format seemed not to make full use of the format (eg, Ossman & Warren, 2014; Velegol et al., 2015). Online materials need to be carefully designed and complex problems, where students are required to collaborate and interact with each other and the instructor, should be assigned for in-class sessions. This would increase lecture attendance and engagement as concluded in studies by Chen et al. (2014) and Rutkowski (2014).
Recommendations for future research and practice
The findings of this systematic review serves as the basis for recommendations for engineering educators who plan to investigate the role of flipped learning in engineering education.
Reforming engineering education through theoretically sound frameworks
Engineering education research needs to focus more on what specific aspects of active learning might be complemented in a flipped format and how that could help form engineers for today's competitive global market and changing work environment. Researchers need to make informed decisions about which theoretical framework would provide a structure to systematically study the role and impact of the flipped approach in engineering education.
Using qualitative and longitudinal data to provide deeper understanding
This synthesis reveals that there is a paucity of literature employing qualitative methodologies that would provide more in-depth understanding of learning in a flipped environment. Additionally, there is a lack of longitudinal studies investigating the student experiences over a long period of time. Rather, studies were mostly conducted over a semester when the new approach is implemented for the first time. It is very likely that an innovation will be successful because of its novelty, or will fail because of insufficient experience. Therefore, this synthesis calls for longitudinal studies investigating student experience over a longer period of time which may even involve postgraduation.
Investigating systematic adoption of flipped learning in engineering education
A vast majority of the studies included in this review examined flipped learning in specific courses rather than at the program or discipline level. Although the decision on how to teach is at the discretion of individual instructors, higher education institutions encourage and sometimes require, faculty members to adopt innovative pedagogical approaches like flipped and blended learning (Sheppard, 2013). Studying the phenomena of flipped learning at broader levels (ie, program, discipline) may help engineering educators understand the overall impact of the pedagogy and how it might influence student readiness for a new teaching approach. It would also help practitioners to adopt strategies to address student resistance when they implement a new teaching technique.
Shifting the focus from academic skills to professional skills
This synthesis reveals that researchers generally focus on students' academic gains when they adopt a new pedagogical approach. Although it is an important component of learning, report of academic achievement or failure only provides partial information about the role of innovative pedagogies in teaching engineering skills. Very few researchers argued that flipped learning improved students' professional skills such as life-long learning, self-regulation, inter-personal communication. Further research is needed to systematically investigate whether or not flipped learning enhances these skills. Developing measures and alternative assessments, of which the development process is clearly described, and the reliability and validity analyses reported, will considerably contribute to the research in the field.
This systematic review of research on flipped learning in engineering education is timely as the flipped approach has gained popularity amongst engineering educators. It is imperative to understand the current practices in order to shed light on future implementations. The review of 62 articles included in this synthesis was framed around four major research questions. First, the findings indicated a widespread adoption of flipped learning in various sub-fields of engineering. Second, there is a paucity of the report of theoretical frameworks guiding the development and evaluation of the flipped approach. Evaluation methods have mostly been limited to quantitative data drawn from course assessments and surveys, and there is a scarcity in qualitative research to understand phenomena in depth and within specific contexts. Third, many researchers found that students in the flipped classroom had learned as much as their counterparts in the traditional lecture-style format if not more. Fourth, flipped learning provides several benefits and brings some challenges for instructors and students. Synthesizing the existing research on flipped learning, this study provides recommendations for researchers, practitioners and policy-makers to develop research-based action plans in how to develop and evaluate flipped classrooms.
Statements on open data, ethics and conflict of interest
We declare that the data will be available by individual application directly to the first author. We declare that no human participants used in this study. We declare that we do not have any conflicts of interest regarding the reported study.
Aliye Karabulut-Ilgu is a lecturer in the Department of Civil, Construction and Environmental Engineering at Iowa State University.
Nadia Jaramillo Cherrez is a doctoral student in School of Education at Iowa State University.
Charles T. Jahren is the W. A. Klinger Teaching Professor in the Department of Civil, Construction and Environmental Engineering at Iowa State University.
What is already known about this topic
- Flipped learning has gained popularity in higher education.
- Flipped learning has been used in a wide range of engineering subdisciplines.
- Flipped learning creates opportunities for complex problem solving in engineering education.
What this paper adds
- There is a paucity of reporting regarding theoretical or conceptual frameworks guiding the development and evaluation of the flipped approach.
- Evaluation methods have mostly been limited to quantitative data drawn from course assessments and surveys, and there is a scarcity in qualitative research.
- Students involved in the flipped approach have learned as much as their counterparts in the traditional lecture-style format if not more.
Implications for practice and/or policy
- Flipped learning course design and research need to be based on a theoretical framework.
- Flipped learning research needs to employ quantitative and qualitative methods to understand the phenomena in depth.
- Further systematic research addressing validity and reliability concerns is needed to consolidate the role of flipped learning in enhancing student learning.