Ashlee M. C. Foster, MSEd | Instructional Design Specialist | Oregon State University Ecampus


Whether a pedagogical approach is affirmed by research and/or practical evidence intentional design and effective deployment of pedagogical strategies are essential. We will begin with an exploration of evidence-based design components, which build upon the characteristics of Project-based Learning (PjBL), as discussed in Project-based Learning (Part 1) – Architecture for Authenticity.

Getting Started

Begin with the end in mind. Take a moment to establish the outcomes, goals, and real-world connections that will underpin the project. Consider using the following elements as your guide.  

  • Identify the Course Learning Outcomes (CLO) students should be able to demonstrate upon successful completion of the course
  • Identify the intended project outcomes and the alignment to the course learning outcomes
  • Identify skills students will practice and master while engaging with the project 
  • Articulate the purpose of the project within the contexts of the course, academic program, field of study, and profession
  • Articulate authentic connections between the project, across academic disciplines, and professional practice
  • Connect the project to an authentic purpose that extends beyond the confines of the course

Course Design Elements

Next, reflect on how you can design your project to incorporate most of the following PjBL core design elements.  

Project-based learning process

Image credit: Gold Standard Project Based Learning by PBLWorks is licensed under CC BY-NC-ND 4.0.

Authentic Challenge

Initially, consider creating an opportunity for students to self-select a challenge. This can be anything from finding a solution to existing problems, a remedy for historical barriers, answers for disciplinary relevant questions, or asking new questions. Whatever the challenge may be, a best practice is to contextualize it within a real-world context. Affirm student voice and choice by explicitly sharing how the project connects to the academic discipline, professional field of practice, and real issues by providing feedback. Lastly, help students to see how they can connect the challenge to themselves.

Authentic Product

Development of an artifact that is relevant, timely, impactful, and piques personal interest help to bridge the concepts to the real world. To effectively create an artifact that produces a public good, students should engage in an iterative process that includes: planning, prototyping, seeking and applying feedback from diverse stakeholders (i.e., public, target audience, instructor, peers, Subject Matter Expert), personal reflection, and revisions. To determine whether your project is authentic, consider whether the product(s) create a lasting and meaningful impact beyond the classroom. Examples of authentic products could include a business plan to innovate an existing accessibility tool, a podcast to share about (DEI) Diversity Equity and Inclusion practices or to generate oral histories (i.e., audio interviews) of underrepresented populations. 

Sustained Inquiry

Incorporation of formal and informal opportunities for students to question, research, gather information, conduct analysis, apply new knowledge, generate additional inquiries, and highlight evidence is key to the design. These opportunities should be integrated into the architecture of the project, but the actions should be student-driven. This strategy will help promote knowledge construction.

Student Autonomy

Create varied opportunities for students to make their own choices, both collectively and individually. Student-driven choice can extend to such elements as question development, selection of public a product, identification of target audiences, establishment of collaboration protocols, application of knowledge and feedback, and prototype revision methods. Doing so situates students as the diver of their own learning process and creates space for students to hone their metacognitive skills (i.e., self-regulation, monitoring, and self-directed learning).

Reflection

Due to its roots in constructivism, reflection is commonly used in PjBL. Reflection is used as a strategy to foster deep learning, personal ownership of learning, assimilation of new knowledge, integration of lived experiences, effective inquiry, assessment of quality, and the navigation of challenges. While serving as a guide on the side, consider integrating activities to foster ongoing reflection of critical questions. Such questions may include:

  • What is known?
  • What needs to be known?
  • What evidence exists?
  • Will the product have an impact on the world outside of the course? How?
  • Do I/we bring any personal biases to the project which impacts the design of the product?
  • Does the design of the product represent the diversity of the target audiences?  
  • What works or does not work? Why?
  • How can the product be improved? What is the rationale behind the recommended changes?
  • How can the quality and efficacy of the product be tested?
  • Does the project extend on what the academic domain and professional field have established? If not, how can the project be modified to contribute additional knowledge or insights?
  • How does the project connect to my life, my lived experiences, and that of others?
  • How will the project help me to develop my professional skills?

An example of a PjBL reflective activity is a design journal. Design journals can include text, visualization, and media elements. Each entry can be structured to cover the following: knowledge gained, ideas, sustained inquiry (i.e., questions, additional research needed), the rationale for product changes, and next steps.

Critique & Revision

Integrating activities, such as a design journal, provides students the opportunity to actively critique, revise, and obtain feedback throughout the duration of the project. There is a multitude of scenarios that may call for critique. Students may find their initial idea to be too broad or specific. The original line of inquiry may have been faulty. One may find the product does not generate the intended public good or service. Therefore, revising the goal and creating a new product may be necessary. Alternatively, situations can arise where students learn of a product’s unintended harm, so a new prototype may need to be created. The goal is to create a course climate that is psychologically safe enough to encourage iteration.

Success Tips

Please note that these best practices and design elements offer a framework. Your course is unique. There is an unending list of potential factors that can impact the design of your course and project (e.g., accreditation, professional competencies, academic rigor, program outcomes, administrative expectations, etc.).

  • Keep in mind that you do not have to incorporate everything and the kitchen sink. Take what you can from existing literature, practitioner testimonials, industry needs, professional practices, real-world examples, and lessons learned from your own lived experiences.
  • Begin with small additions to your course, assess the impact of those changes, and revise as you deem appropriate.
  • Remember that nothing will be perfect, and there are always opportunities to improve. Design with the best fit in mind!

Looking Ahead!

You are cordially invited to revisit the Ecampus Course Development and Training Blog for Project-based Learning (Part 3) – Practical Preparation. In the final installment of this series, we will explore additional project-based learning activities, identify opportunities to integrate technology and examine actual project samples.

References

Project

By: Ashlee M. C. Foster MSEd, Instructional Design Specialist | Oregon State University Ecampus

Did you know a pedagogical approach exists that positively impacts student academic achievement and engages them as active participants in learning? Great news…there is! Let me introduce you to the world of Project Based Learning (PBL). 

What is PBL?

PBL is a student-centered pedagogical approach where students, both individually and within small groups, engage with meaningful, relevant, and authentic projects which result in a product. Oftentimes, PBL is commonly associated and/or thought to be interchangeable with Problem Based Learning. However, there is a distinction between the two. The principal focus of PBL is on the active construction of knowledge. Additionally, student autonomy, beliefs, values, and motivations are situated as a fundamental driving force of the instructional approach.

What are the characteristics of PBL?

The essence of PBL is anchored in attributes, which foster high-quality learning experiences. Direct instruction is no longer the principal mechanism for delivery. Negotiation of knowledge between the educator and the students occurs through an exchange of ideas, questioning, inquiry, considerations, and perspectives. PBL often engages students in an ongoing process consisting of investigation, collection, analysis, prototyping, testing, peer/instructor feedback, revisions, and reflection. Learner autonomy is key in that students make their own decisions about various aspects of the projects (i.e., line of inquiry, collaborative processes, application of feedback, types of revisions, solutions).

Is it effective? Prove it!

As reported by Chen and Yang (2019), a positive impact on student achievement has been observed across 20 years (i.e. 1998-2017) of PBL peer-reviewed literature. The researcher’s principal investigation was to compare traditional instruction with that of PBL. Traditional instructional delivery was found to prompt students to apply low-level cognitive processes (e.g., understand, remember). Whereas, PBL can encourage the development of (HOTS) Higher Order Thinking Skills (i.e., analysis synthesis) and metacognitive skills (i.e., regulation, monitoring, self-directed learning, evaluation, assessment). According to the meta-analysis, the aforementioned benefits were found not to be impacted by academic discipline, educational stage (undergraduate, post-baccalaureate, graduate), or geographic location. This is great news for our distance and hybrid learners!

How do I get started?

When considering PBL there are a few questions to reflect on before implementing this practice. First, ask yourself, is this a best-fit approach? Consider the academic discipline, subject content, course learning outcomes, your instructional style, student attributes, and the intended goals to answer this foundational question. A word of caution is to use PBL in a way that is relevant, authentic, and collaborative in nature. Steel clear of using projects as a shiny solution. Lastly, contextualize the project. Doing so will help students connect the project to their academic career, professional development, and personal growth. Remember to share the ‘why’!

Project Examples

Here are a few project examples to spark some ideas: 

  • solve a problem (e.g., uninformed voting) 
  • generate a plan (e.g., foster sustainability)
  • create a product (e.g., computer/mobile application, oral history interviews)
  • seek valid answers and recommend solutions (e.g., electing national officials) 
  • engage with a persistent issue in a tangible way (e.g., advocating, protesting, public speech) 

Do you have an example to share?

Respond in the comments if you currently use, have used, or intend to incorporate PBL in your course. Do you have any tried and true strategies for effective projects? Have you experienced any wins or challenges? Share with the community and join the discussion. Make sure to return to read Project-Based Learning (Part 2) – Mindful Design for practical implementation tips! 

References

I pledge that I have acted honorably in completing this assessment.

There are two sides to the story of security of online assessments. On the one side, cheating does exist in online assessments. Examity’s president Michael London summarized five common ways students cheat on online exams:

  1. The old-school try of notes;
  2. The screenshot;
  3. The water break;
  4. The cover-up; and
  5. The big listen through devices such as Bluetooth headset (London, 2017).

Newton (2015) even reported the disturbing fact that “cheating in online classes is now big business”. On the other side, academic dishonesty is a problem of long history, both on college campuses and in online courses. The rate of students who admit to cheating at least once in their college careers has held steady at somewhere around 75 percent since the first major survey on cheating in higher education in 1963 (Lang, 2013). Around 2000, Many faculty and students believed it was easier to cheat in online classes (Kennedy, 2000), and about a third of academic leaders perceived online outcomes to be inferior to traditional classes (Allen & Seaman, 2011). However, according to Watson and Sottile (2010) and other comparative studies (Pilgrim & Scanlon, 2018), there is no conclusive evidence that online students are more likely to cheat than face-to-face students. “Online learning is, itself, not necessarily a contributing factor to an increase in academic misconduct (Pilgrim & Scanlon, 2018)”.

Since there are so many ways for students to cheat in online assessments, how can we make online assessments more effective in evaluating students’ learning? Online proctoring is a solution that is easy for instructors but adds a burden of cost to students. Common online proctoring service providers include ProctorU, Examity, Proctorio, Honorlock, to name just a few (Bentley, 2017).

Fortunately, there are other ways to assess online learning without overly concerned with academic dishonesty. Vicky Phillips (n.d.) suggested that authentic assessment makes it extremely difficult to fake or copy one’s homework. The University of Maryland University College has consciously moving away from proctored exams and use scenario-based projects as assessments instead (Lieberman, 2018). James Lang (2013) suggested smaller class sizes will allow instructor to have more instructor-to-students interaction one-on-one and limit cheating to the minimum therefore; Pilgrim and Scanlon (2018) suggest changing assessments to reduce the likelihood of cheating (such as demonstrating problem solving in person or via video, using plagiarism detection software programs like TurnItIn, etc.) , promote and establish a culture of academic integrity (such as honor’s code, integrity pledge), and supporting academic integrity through appropriate policies and processes. Kohnheim-Kalkstein (2006) reports that the use of a classroom honor code has been shown to reduce cheating. Kohnheim-Kalkstein, Stellmack, and Shilkey (2008) report that use of classroom honor code improves rapport between faculty and students, and increases feelings of trust and respect among students. Gurung, Wilhelm and Fitz (2012) suggest that an honor pledge should include formal language, state the specific consequences for cheating, and require a signature. For the honor pledge to be most effective, Shu, Mazar, Gino, Ariely, and Bazerman (2012) suggests including the honor pledge on the first page of an online assessment or online assignment, before students take the assessment or work on the assignment.

Rochester Institute of Technology (2014) ’s Teaching Elements: Assessing Online Students offer a variety of ways to assess students, including discussions, low-stake quizzes, writing assignments (such as muddiest point paper), and individual activities (such as staged assignments for students to receive ongoing feedback), and many other activities.

In summary, there are plenty of ways to design effective formative or summative assessments online that encourage academic honesty, if instructors and course designers are willing to spend the time to try out suggested strategies from literature.

References

Bentley, Kevin. (2017). What to consider when selecting an online exam proctoring service. Inside HigherEd. (June 21, 2017). Retrieved from https://www.insidehighered.com/digital-learning/views/2017/06/21/selecting-online-exam-proctoring-service on February 22, 2019.

Gurung, R. A. R., Wilhelm, T. M., & Filz, T. (2012). Optimizing honor codes for online exam administration. Ethics & Behavior, 22, 158–162.

Konheim-Kalkstein, Y. L. (2006). Use of a classroom honor code in higher education. Journal of Credibility Assessment and Witness Psychology, 7, 169–179.

Konheim-Kalkstein,Y. L., Stellmack, M. A., & Shilkey, M. L. (2008). Comparison of honor code and non-honor code classrooms at a non-honor code university. Journal of College & Character, 9, 1–13.

J.M. Lang. (2013). How college classes encourage cheating. Boston Globe. Retrieved from https://www.bostonglobe.com/ideas/2013/08/03/how-college-classes-encourage-cheating/3Q34x5ysYcplWNA3yO2eLK/story.html on February 21, 2019.

Lieberman, Mark. (2018). Exam proctoring for online students hasn’t yet transformed. Inside Higher Ed (October 10, 2018). Retrieved from https://www.insidehighered.com/digital-learning/article/2018/10/10/online-students-experience-wide-range-proctoring-situations-tech, on February 22, 2019.

Michael London. (2017). 5 Ways to Cheat on Online Exams. Inside Higher Ed (09/20/2017). Retrieved from https://www.insidehighered.com/digital-learning/views/2017/09/20/creative-ways-students-try-cheat-online-exams on February 21, 2019.

Derek Newton. (2015). Cheating in Online Classes is now big business. The Atlantic. Retrieved from https://www.theatlantic.com/education/archive/2015/11/cheating-through-online-courses/413770/ on February 21, 2019.

Vicky Phillips. (n.d.). Big Fat Online Education Myths – students cheat like weasels in Online Classes. GetEducated. Retrieved from https://www.geteducated.com/elearning-education-blog/big-fat-online-education-myths-students-cheat-like-weasels-in-online-classes/ on February 21, 2019.

Chris Pilgrim and Christopher Scanlon. (2018). Don’t assume online students are more likely to cheat. The evidence is murky. Retrieved from https://phys.org/news/2018-07-dont-assume-online-students-evidence.html on February 21, 2019.

Rochester Institute of Technology. (2014). Teaching Elements: Assessing Online Students. Retrieved from https://www.rit.edu/academicaffairs/tls/sites/rit.edu.academicaffairs.tls/files/docs/TE_Online%20Assessmt.pdf on February 21, 2019.

Shu, L. L., Mazar, N., Gino, F., Ariely, D., & Bazerman, M. H. (2012). Signing at the beginning makes ethics salient and decreases dishonest self-reports in comparison to signing at the end. PNAS, 109, 15197–15200.

George Watson. And James Sottile. (2010). Cheating in digital age: Do students cheat more in online courses? Online Journal of Distance Learning Administration 13(1). Retrieved from https://www.westga.edu/~distance/ojdla/spring131/watson131.html on February 21, 2019

If you’re searching for an engaging, authentic, and personalized way to assess your students’ learning, consider developing an ePortfolio assignment for your online course. The benefit of ePortfolios, or digital collections of student learning artifacts, is twofold: you can formatively assess your students’ learning over time, and you can help your students craft a personalized, customizable end product that serves as both a networking tool and a professional presentation of their skills and abilities to showcase to future employers in a more humanized way than a standard resume.

There are multiple approaches to structuring an ePortfolio assignment. One method is to ask your students to gradually add to their ePortfolios each week. This allows you to assess your students’ work over the course of the term, and it allows your students to make meaningful connections between all of the learning artifacts they collect.

With any ePortfolio assignment, consider building in a reflection requirement to help encourage students to connect their learning. Reflection helps students make connections between what they learned, what they still hope to learn, how these things connect to the next course in a series, and how these things apply to experiences beyond their online class. Reflection is also an opportunity for you to encourage your students to connect the dots between their academic, professional and personal lives.

As a starting point, OSU’s College of Liberal Arts has some great reflection tips and questions for you to provide to your students.

Two Tools: Canvas ePortfolios and Google Sites

You will need to select a tool for your students to build their ePortfolios. If you are looking for an integrated tool in your LMS, consider Canvas ePortfolios. This tool is useful because it is not specific to your course, but rather specific to each Canvas user. This means each student can create as many ePortfolio sites as they wish, and they can continue to access these even after your course is over.

Canvas ePortfolios also eliminate the submit it and forget it experience with digital assignments; with a few simple clicks, students can quickly add assignment submissions they are proud of to build structured digital archive of their achievements throughout their online college experience. They can also export their ePortfolio at any time, meaning they could save a copy to take with them after they leave OSU.

Another option is a Google App called Google Sites, which is a free platform to build a website. All students and faculty have access to Google Sites with your ONID login. The benefit to using this tool is the flexibility of platform; students can apply a previously created template or build a custom site of their own.

When considering any ePortfolio platform, it is important to remember to play with the tool as an instructor to understand how the tool works and what the student experience will be like. Consider setting up a model ePortfolio to familiarize students with what you generally expect, but encourage them to go above and beyond to personalize their ePortfolios. This will empower students to engage with the process of customizing their collection.

ePortfolio Tool Resources

References

Miller, R., & Morgaine, W. (2009). The Benefits of E-portfolios for Students and Faculty in Their Own Words. Peer Review, 11(1), 8-12. Retrieved from https://www.aacu.org/publications-research/periodicals/benefits-e-portfolios-students-and-faculty-their-own-words

Barrett, H. (2011) Balancing the two faces of eportfolios. Retrieved from: http://electronicportfolios.org/balance/balancingarticle2.pdf