Author Archives: shitia

Belonging, Fun and Scaffolding in Introductory College Math Course

Posted on by | Leave a reply
animations for MTH 112Z

MTH 112Z at Oregon State University is designed to prepare students for calculus and related disciplines. This course explores trigonometric functions and their applications as well as the language and measurement of angles, triangles, circles, and vectors. These topics are explored symbolically, numerically, and graphically in real-life applications. MTH 112Z is designated as a Common Course Numbering (CCN) in the state of Oregon, ending with “Z” in the course number. When transferring to an Oregon public college or university, “CCN courses will be accepted as if they were taken at the institution students transfer to (that is, the receiving institution)” (State of Oregon, 2023).

An instructor from the math department and Tianhong Shi from Ecampus collaborated in designing a brand-new version of MTH 112 to meet the new Core Ed requirements for Oregon State University and Z course requirement for the state of Oregon. At the beginning of this project, the design team identified major challenges of this course as follows:
1. Content challenges
2. Low motivation for some students to continue studying math at this level after initial frustration in this course.
3. Low interest in participation in class discussions.

The instructor and Tianhong met regularly to discuss the challenges, brainstorm strategies for solutions, and delineate a plan to implement practical solutions for MTH 112Z. The solutions that were implemented in the course include:

1. Creating a safe and inclusive learning environment that students will feel they belong here.
2. Creating short animated stories of how math operates in people’s real life, each video is about or less than 30 seconds long. The purpose of these animations is to build a bridge between math learning and real life and to motivate students to learn the topics of each unit.
3. Helping students to identify the steps in solving a math problem to scaffold learning and build learning success step by step.
4. Creating “Make Learning Fun” discussion topics: Research (Purinton and Burke, 2019; Tews, et.al., 2014) tells us that when students feel emotionally relaxed and happy, learning is more effective. Therefore, one “Make Learning Fun” discussion forum is created for each unit.

Building an Inclusive and Trusting Learning Community where Students Belong
College belonging is defined as “students’ perceived social support on campus, a feeling or sensation of connectedness, the experience of mattering or feeling cared about, accepted, respected, valued by, and important to the group”, according to Strayhorn (2018, p.4). The strategies used to build an inclusive and trusting learning community in MTH 112Z included the following:
1. In Start Here Module, the instructor made a video covering Artificial Intelligence (AI), academic integrity, honesty, and diversity, to explicitly explain the expectations for this course regarding academic integrity and why it is so.
2. Also in Start Here Module, the instructor built a “Name Tents 112Z” discussion board for students to introduce themselves, setting an example by introducing the instructor himself first.
3. There is a Diversity Forum where students can post comments that they would want the instructor to know about themselves to make learning more inclusive.

Making Content Relevant
In addressing the challenging content, the instructor identified concepts that would be better explained through a set of short animated videos, recorded the audio narratives, and the media team helped creating the short animations. For example, at the beginning of unit 4 is an animation about finding the length of a tall tree on campus. And here is the transcript of the video: “The Trees on the O S U campus, are wonderful . how tall are the cedar trees by the memorial union? if you measure the angle from the ground to the top of the tree and know the distance you’re standing away from the tree, you can compute it. Make a triangle and set up an equation to get the height. Which function would you use?” And here is the transcript of unit 5 animation video: “You can get swept away in a river. Oregon has many great rivers for boating. When you were kayaking, you need to account for how much the current will push you off course, this can be done with vector. One vector represents the river’s flow with direction and strength, another vector is the direction which you kayak. The results of these two added together is the direction you end up going. If you want to reach a certain point on the other side, where should you aim?” We can see from these two examples that they are relevant to student lives (trees and kayaking) and relevant to the topics of the units. And these animations tell short stories, hoping to motivate students for learning.

Scaffolding Toward Learning Success
Scaffolded learning activities provide students a supportive learning environment (Dennen, 2004). In each unit’s content discussion forum and homework assignment, students explore problem solving step by step and discuss with each other to help them build confidence and fluency in problem solving. By such a design, the design team hoped students would get the support they needed and would be able to easily identify where they did wrong and how to improve or correct based on the feedback they receive from the online homework system and from the instructor and Teaching Assistants.

Making Learning Fun
Emotional health is important for students’ learning success. Research suggests there is a significant positive relation between fun delivery of content and the forms of engagement (Tews, et al., 2014). Schwartz et al. (2016) also recommend building fun elements in learning for effective teaching and learning. So the design team strived to build elements of fun into the course. The short animations are meant for fun. In addition, each unit has a “Just For Fun” discussion forum to bring students’ attention to learning and promote motivation. Below are examples of these discussions:

Unit 1 Just for Fun: Please read through this survey and describe how you would answer the questions. (The survey was about having students imagine themselves navigating through the forest on foot and trying to find their way to their cabin.)

Unit 2 Just for Fun: What do you think of the animation?

Unit 3: Just for Fun: Please take a picture of something you can model with a sine function as you have been studying in this module. It could be a windmill if you live near a windmill, or an ocean if you live near an ocean. Make sure it is a picture that you have taken and then explain briefly what it is and how you would model its movement.

Unit 4 Just for Fun: Describe a time when you could feel the effect of the wind or water current as you were moving. For example, winters in Oregon are blustery and you can get blown around when you are biking.
Or you can describe a way that you would use vectors in your own life.

Unit 5 Just for Fun: This is it! you’re almost done–
What was a topic in the course that was interesting to you? or what was a topic that didn’t seem to be useful?

That is what we did to make introductory college math fun, inclusive and learnable. If you have ideas for math or STEM course design, feel free to share with us (Tianhong.shi@oregonstate.edu). The more, the better!

References
Dennen, V. P. (2004). Cognitive apprenticeship in educational practice: Research on scaffolding, modeling, mentoring, and coaching as instructional strategies. In D. H. Jonassen (Ed.), Handbook of Research on Educational Communications and Technology (2nd ed.), (p. 815). Mahwah, NJ: Lawrence Erlbaum Associates.

Hogan, K., and Pressley, M. (1997). Scaffolding student learning: Instructional approaches and issues.Cambridge, MA: Brookline Books.

Huck, C and Zhang, J., Efects of the COVID-19 Pandemic on K-12 Education: A Systemic Literature Review. Educational Research and Development Journal. Summer 2021, Vol. 24.

State of Oregon. (2023). The Oregon Transfer Compass. Retrieved at https://www.oregon.gov/highered/about/transfer/pages/transfer-compass.aspx


Purinton, E. and Burke, M. (2019). Student Engagement and Fun: Evidence from the Field. Business Education Innovation Journal, Volume 11 Number 2, P133-P140.


Schwartz, D. L., Tsang, J. M., & Blair, K. P. (2016). The ABCs of how we learn : 26 scientifically proven approaches, how they work, and when to use them (First edition.). W.W. Norton & Company, Inc.

Strayhorn, T. L. (2018). College students’ sense of belonging. Routledge. https://doi-org.oregonstate.idm.oclc.org/10.4324/9781315297293

Tews, M. J., Jackson, K., Ramsay, C., & Michel, J. W. (2014). Fun in the college classroom: Examining its nature and relationship with student engagement. College Teaching, 63(1), 16-26.

Engaged Learning Design for Motivation, Comprehension and Application

Posted on by | Leave a reply
Neuron image from Adobe Stock

Engaged learning design helps students comprehend the learning materials and apply the newly learned knowledge and skills to new contexts. Jessie Moore proposed six key principles for engaged learning, namely:
* “Acknowledging and building on students’ prior knowledge and experiences;
* Facilitating relationships, including substantive interactions with faculty/staff mentors and peers, and development of diverse networks;
* Offering feedback on both students’ work-in-progress and final products;
* Framing connections to broader contexts, including practice in real-world applications of students’ developing knowledge and skills;
* Fostering reflection on learning and self; and
* Promoting integration and transfer of knowledge” (Moore 2021; Moore, 2023).

This blog will showcase three course design projects using engaged learning principles to overcome design challenges, including challenging content, lack of student motivation, and/or difficulty transferring knowledge.

Design Case #1
Engaged learning Principle: Acknowledging and building on students’ prior knowledge and experiences
Design Challenge: Students are non-accounting majors and need more motivation to study accounting.
Design Solution: College students have all bought textbooks and paid bills for college education, even though they may not have any accounting training before. Building on students’ prior knowledge of bill paying and textbook purchases, the instructor created a mock-up student-run company and assigned students to work with accounting related to students’ activities, such as buying and selling textbooks and offering tutoring services, in order to make learning materials of “BA 315 Accounting for Decision Making” relevant and meaningful to students. The instructor also collaborated with Ecampus media team to create an online monopoly simulation game modified with Oregon State University themes to further engage students in accounting practices.

Design Case #2
Engaged Learning principle: Facilitating relationships, including substantive interactions with faculty/staff members and peers and developing diverse networks.
Engaged Learning principle: Offering feedback on students’ work-in-progress and final products.
Engaged learning principle: Fostering reflection on learning and self.
Engaged learning principle: promoting integration and transfer of knowledge.
Design Challenge: trauma-informed helping skills are challenging to teach in HDFS 462 online.
Design Solution:
Building on students’ prior knowledge and experiences (Discussion board activities)

The course developer used case study and group case discussion on developing a plan to help a client; Students individually practice attending and listening with single-word responses. Instructor provides feedback on both group work and individual work.
Also, instructor Modeling the empowerment process with recorded videos, students practicing helping skills, and the instructor offering feedback on students’ helping skills practices with peer partners in the classmates.
Connections to Broader contexts and promoting integration and transfer of knowledge: students practice helping skills with non-classmate clients; and instructor provides feedback.



Design Case #3
Engaged Learning Principle: Framing connections to broader contexts, including practice in real-world applications of students’ developing knowledge and skills.
Design Challenge: There is a lack of full access to construction sites especially for students in CE 427 Online Course to get hands-on experience and understand construction site structure fundamentals.
Design Solution: the instructor and instructional designer collaborated with the media team to design an interactive simulation called Clickable Structure to help students understand the most difficult concepts in the course: elements of structures and how various pieces relate to each other. The Clickable Structure simulation enables students to see each group of structures layer by layer according to their functions and the corresponding equations needed for calculations of weight bearing, etc.

What we see versus what students in CE 427 needs to learn


As a Reflection Tool
Another way to use the six principles of engaged learning is to change the statements in the principles to a list of questions for students to reflect:
1. What prior knowledge do I bring to this topic?
2. What new knowledge and skills I learned about this topic? How are these new concepts and skills and principles and relationships related to each other? How does individual pieces of information connect to make sense?
3. What feedback did I receive from instructor and classmates that gives me insights to this topic?
4. How is this topic related to broader contexts of main learning outcomes of this course or real-world applications?
5. How could I use what I learned about this topic into real-world application?
6. What new understandings did I gain from this reflection activity?

If you find these six principles of engaged learning meaningful and have adopted or adapted them in your teaching and learning, I encourage you to share with us (email tianhong.shi@oreognstate.edu) so we can build a collection of engaged learning cases and examples.

References

Moore, Jessie L. Key Practices for Fostering Engaged Learning: A Guide for Faculty and Staff. Sterling, VA: Stylus Publishing, 2023.

Moore, Jessie L. 2021. “Key Practices for Fostering Engaged Learning.” Change: The Magazine of Higher Learning, 53(6): 12-18. https://doi.org/10.1080/00091383.2021.1987787

Passion: Find It or Build It?

Posted on by | Leave a reply
courage
courage

Are you passionate for what you do? I do. I enjoy, treasure, relish what I do as an instructional designer. But I also realize that not everyone is able to work on something they are passionate about. As an educator, I believe we ought to stir up passion and values in the learners we serve. So, I started searching for ways to motivate, to stir up and help people find their passion. And I found these resources: books and podcast by Todd Henry on passion, and book and podcast by Liz Forkin Bohannon.


Todd Henry shared his recipe for finding the power to keep your passion firing for a lifetime by starting with a few simple questions.

  • What is something that you are willing to suffer on behalf of it?
  • What makes you angry?
  • What moves you emotionally?
  • What gives you hope?


Quotes from Todd Henry, author and experts on creativity, productivity, and passion for work.
Goal of life is not comfort, but conquest!
The love of comfort is often the enemy of greatness.
The seeds of tomorrow’s greatness is planted in today’s activities.
If you are intentional, and if you live by design, not by default, someday, in the distant future, when you lay your head down for the last time you can point to a delta, a body of work and you can say “yes, that represents me.”


Beginner’s Pluck is a 2019 book by Liz Forkin Bohannon (Podcast host, and co-founder of Sseko Designs). In this book, Liz teaches us that passion is not discovered, as we were told for so long, but rather passion is built step by step! And the first step is to find an interesting problem. And to have a posture of curiosity over criticism. The good news is the world is full of interesting problems!

This is a totally new perspective to me: passion is built and the first step to build passion is to find interesting problems. And this new perspective leads me to think how I could and should plan my instructional design work to provide room and opportunities in any course for asking questions that guide learners to build their passion. It could be in the syllabus, in each module’s content page, before or after learners work on the readings and lecture videos, or at the end of the module as a self-assessment. There are many different ways and places we can incorporate the building of passion into course design!


Conclusion: Build your Passion starting with questions and interesting problems. My questions for you, dear educator, “is there room in your teaching to ask an inspiring question that points your learners towards building their passion for life?” Or if you are reading this for your own benefit, consider what problems are interesting to you and start working on solving the problems, little by little. If you need to someone to brainstorm design ideas for infusing questions into your teaching, feel free to contact me at tianhong.shi@oregonstate.edu

References:

Bohannon, L.F. (2019). Beginner’s Pluck. Baker books.

Henry, T. (2013). Die Empty. Penguin Publishing Group

Asking Good Questions

Posted on by | Leave a reply

In Dr. Freeman Hrabowski’s TED Talk “4 Pillars of College Success in Science”, he told the story of Nobel laureate Isidor Isaac Rabi’s mother’s famous question: Did you ask a good question today? Let’s pause for a minute and reflect: What is a good question? What questions do you ask most frequently? What questions do your students or children ask most?

Question
Question

Types of Questions

Teachers usually encourage students to ask questions. Dr. Peter Liljedahl, author of “Building Thinking Classrooms in Mathematics” and professor of Mathematics Education at Simon Fraser University in Canada, however, points out that not all questions need and should be answered directly. According to Liljedahl, there are three types of questions and only one type of questions requires direct answers. Liljedahl categorizes questions in K-12 mathematics classrooms into the following three types:

  1. Proximity Questions
  2. Stop Thinking Questions
  3. Keep Thinking Questions (Liljedahl, 2020)
Building Thinking Classrooms Book Cover

Proximity questions refer to questions students ask when the teacher is close by, as the name suggests. Liljedahl’s research showed that the information gained from such proximity questions was not being used at all. Stop-Thinking Questions are questions students ask just to get the teacher to do the thinking for them, with the hope that the teacher will answer it and they can stop thinking, such as “Is this right?”, “Do we have to learn this?”, or “Is this going to be on the test?” Unlike the first two types of questions, keep-thinking questions are often clarification questions or about extensions the students want to pursue. According to to Liljedahl, if you have an authentic and level-appropriate task for students to work on, 90% of the questions being asked are proximity questions or stop-thinking questions and only 10% of questions students ask are keep-thinking questions. Liljedahl pointed out that answering proximity questions and stop-thinking questions are harmful to learning because it stops students from thinking.

Next, how could teachers differentiate the types of questions being asked? Liljedahl offers a simple solution to separate keep-thinking questions from the other two types of questions: Are they asking for more activity or less, more work or less, more thinking or less?

After differentiating the types of questions, what should teachers do with these proximity questions and stop-thinking question? Ignore them? No, not at all! Liljedahl emphasizes that there is a big difference between having students’ questions heard and not answered, and having their questions not heard. How should teachers answers these proximity questions and stop-thinking questions then?

Ten Things to Say to Proximity And Stop-Thinking Questions

Liljedahl provides the following list of ten responses to a proximity or stop-thinking question so that you are not giving away the answer and taking the thinking opportunity away from students. Basically, you turn the questions back to your students!

  1. Isn’t that interesting?
  2. Can you find something else?
  3. Can you show me how you did that?
  4. Is that always true?
  5. Why do you think that is?
  6. Are you sure?
  7. Does that make sense?
  8. Why don’t you try something else?
  9. Why don’t you try another one?
  10. Are you asking me or telling me? (Liljedahl, 2021, p. 90)

Cross-Discipline Nature of Good Questions

“Building Thinking Classrooms“  is recommended to me by some college biology  teachers in the US. Biology teachers recommending math teaching book, isn’t that interesting? The reasoning behind this recommendation is that the techniques being taught in this book could be easily applied to any other teaching context to get your students engaged in thinking, whether it is K12 education or college education, math teaching or teaching of another subject.

If this brief introduction got you interested in reading the rest of the book and find out the rest of what the author has to share, it is available at Oregon State University library as an ebook or you can purchase it online.

Asking Good Questions for Management and Education Administration

If you are not directly involved in teaching and learning, but in administrative or management role in an organization, Dr. Amy Edmondson has some practical suggestions for asking good questions to keep organization growing healthily. Dr. Amy Edmondson, author of  “The Fearless Organization”, Novartis professor of Leadership and Management at the Harvard Business School, states that good questions focus on what matters, invite careful thought, and give people room to respond. Edmondson also suggests three strategies for framing good questions:

  1. To broaden the discussion. For example: What do others think?
  2. What are we missing? For example: What other options could we consider?
  3. How would XXX (such as our role model, our mentor, or our competitor) approach this? For example: Who has a different perspective?

With the above tips for asking questions, are you ready to ask a good question today?

References

Edmondson, A. (2018). The Fearless Organization: Creating Psychological Safety in the Workplace for Learning, Innovation and Growth. Hoboken, NJ: John Wiley & Sons, Inc.

Hrabowski, F. (2013). 4 Pillars of College Success in Science. TED Talk. https://www.ted.com/talks/freeman_hrabowski_4_pillars_of_college_success_in_science?language=en

Liljedahl, P. (2020). Building Thinking Classrooms in Mathematics, Grades K-12 : 14 Teaching Practices for Enhancing Learning. Thousand Oaks: Corwin, 2020

The Seven “Cs” of Successful Team Collaboration

Posted on by | Leave a reply
team collaboration

According to the 2020 Brandon Hall Group Team Development Pulse Survey findings (Werder, 2021), at least half of work is currently done in teams in over seventy percent of companies. Global Human Capital Trends (2016) confirmed that this trend is continuing, with over 7000 organizations moving towards more team-based designs. However, the success of team collaboration is not a guarantee and requires diligent planning and hard work. Tannenbaum and Salas (2020) suggest that there are seven “Cs” (or drivers) of teamwork, namely: capability, cooperation, coordination, communication, cognition, coaching, and conditions.

To contextualize and apply each of these 7 “Cs”, I’ll use a recent team collaboration I participated in as an example. A team of four staff from Oregon State University Ecampus gave a virtual presentation on the role of instructional designers in research. Speaking of the first C – capacity, thanks to the selection of team members, this team had the perfect mix: the facilitator was in charge of setting up the stage and engaging the audience with an opening poll and scenario. A second team member was assigned to cover the institutional level, a third team member was assigned to cover the team level and the last team member was assigned to cover at the individual level. Capability: checked ✅!

Cooperation: During the preparation for the presentation, each of the four team members worked individually on our own parts. When we met again, we reviewed each other’s parts, felt comfortable voicing any concern or areas that could use improvement. We each revised our individual parts and met again to review. At this point, we felt we had the content nailed down. Laurie, Tianhong and Heather already know each other very well since we all work in the same instructional design team at Ecampus. Naomi opened herself up and welcomed us to give her feedback and ideas for improvement up front, which is very helpful for Laurie, Tianhong and Heather to connect with her, and built trust for working together on this project. Viola, Cooperation: checked ✅!

Coordination: During the two rounds of peer review sessions, we made many changes, based on feedback from team members. Naomi opened up with a poll of attendee roles and a scenario to illustrate why instructional designers need to be involved in research. Laurie demonstrated diligence and surveyed the entire instructional design team at Ecampus and was able to present some solid data on our team composition in terms of degree/education, and years of career in instructional design. Laurie also provided Tianhong with two prepared slides on areas to be covered as a suggestion. Tianhong conducted comprehensive research and her findings demonstrated that over 50% of instructional designers at Ecampus have participated in research activities with support from Ecampus. Heather’s storytelling of her research involvement was rich and fascinating. So she had the pleasant struggle of cutting down her content to fit within a nine minutes time frame. And we all put scripts of what we plan to say in the notes area of the google slide we were collaborating on, which help us to stay within the limited time and allow us to have discussion time with all participants. Since each of us diligently completed our individual work as planned, the whole presentation is full of data and stories. Coordination: accomplished✅!

Communication within the team of four presenters was relatively easy since we use slack as a communication tool internally and we used calendar invites and emails for scheduling purposes. Our slack messages were quite active throughout the preparation and on the day of the presentation and after the presentation with many suggestions, encouragement, and compliments! Communication: accomplished✅!

Cognition or shared understanding among the team members is vital. In my opinion, this should be the first C on the list! For our team project, Naomi hand-picked the three panelists to join her on this collaboration because she sensed that all three of us share a common understanding on the value of instructional designers being involved with educational research. This common understanding and vision is visible the entire time while we worked on this project. Cognition: checked✅!

Coaching: Does leader and/or team members demonstrate leadership behaviors? Yes, Naomi is a great leader in this project. It was a pleasure to work under her leadership since the role of each panelist is very clear, and we started the collaboration early enough so that we have plenty of time to review, revise, practice and practice again before the actual presentation. Laurie also demonstrated leadership by offering help to cohesively formatting and beautifying each of our slide decks into one presentation file. Coaching: accomplished✅!

Conditions: Does the team have favorable conditions such as resources and culture? Yes, each team member brought with them expertise in their own roles, we were also able to use existing tools such as slack and google slides, and ecampus presentation template for this collaborative presentation. Naomi could have done it all by herself. But she invited a panel of three instructional designers to collaborate with her on this presentation. Our combined effort makes our story stronger, richer and more impressive because we work as instructional designers and we have experience doing research as instructional designers. Conditions: checked✅!

On the day of the virtual presentation, Laurie and Tianhong were presenting from campus offices housed inside the campus library while Heather and Naomi were presenting from their remote offices. In the middle of the presentation, there was a 🔥fire alarm in the library which required everyone to evacuate from the library. Laurie and Tianhong moved to a nearby building and logged back online and re-joined the presentation within 10 minutes. We are so thankful that the four of us are presenting from different locations so that the fire alarm did not stop us from presenting. This is how virtual team collaboration saved our work during a fire alarm emergency. And this is how the 7 Cs led us to a great team collaboration. The next time you sit down to plan a team project or initiative, you might benefit from reflecting on these following questions:

  1. Does the team have the right people with the right mix? (Capability)
  2. Does each team member have constructive attitudes about their team? (Cooperation)
  3. Does each team member demonstrate necessary teamwork behaviors? (Coordination)
  4. Does each team member exchange information effectively with each other and outside? (Communication)
  5. Does each team member possess a shared understanding? (Cognition)
  6. Does leader and/or team members demonstrate leadership behaviors? (Coaching)
  7. Does the team have favorable conditions such as resources and culture? (Conditions)

I hope I have encouraged and convinced you a tiny bit in your next decision for teamwork and have fun collaborating and doing effective teamwork!😊

References:
Werder, C. (2021). How to develop a winning team. Brandon Hall Group. Retrieved from https://www.brandonhall.com/blogs/how-to-develop-a-winning-team/

Global Human Capital Trends. (2016). The new organization: Different by design. Deloitte University Press. Retrieved from https://www2.deloitte.com/content/dam/Deloitte/global/Documents/HumanCapital/gx-dup-global-human-capital-trends-2016.pdf

Tannenbaum,S.I. & Salas, E. (2020). Teams that work : the seven drivers of team effectiveness. Oxford University Press.

Assessment Design: Ideas from Ungrading Book

Posted on by | Leave a reply

A group of instructional designers at Ecampus participated in a book club reading “Ungrading” (Kohn & Blum, 2020). We learned many creative ways of designing assessments through participation in this book club. If you happen to be searching for ideas on designing or re-designing assessments in your teaching, we would highly recommend this book!

The idea of “Ungrading” may sound radical to many of us. Yet instructors at all types of educational institutions have tried ungrading in many different courses, ranging from humanity courses, to STEM courses, and from primary education to higher education. Starr Sackstein (author of Chapter 4 “Shifting the Grading Mindset” of the book) encourages educators to consider “ways to adjust small things in the classroom that will lead to important growth for students”. And this suggestion of starting small is coherent with what James Lang proposes in his book “Small Teaching” (Lang, 2016) and Thomas Tobin’s +1 strategy for implementing new teaching and learning strategies (Tobin & Behling, 2018). Sackstein provides a table comparing the grades vocabulary that focuses on judgement or criticism, with the non-grade vocabulary focusing on assessing and opportunity for improvement.

In chapter 5, Arthur Chiaravalli proposed a way for teaching without grades: Descriptive Grading Criteria, such as A for outstanding, B for Good, C for Satisfactory and I for Incomplete. Do you remember elementary school report cards that use E for Excellent, S for Satisfactory, and NI for Need Improvement type of categories? I think that is exactly what descriptive grading criteria represent. 

In chapter 7, Christina Katopodis and Cathy Davidson offer a new approach to start a new term/semester by asking students:” What is Success in this class for you? And How can I help you achieve it?” (p. 107) Katopodis and Davidson also remind us the importance of explaining why when you challenge your students to take their own learning seriously and give students opportunities for metacognitive reflections about the learning activities themselves. Katopodis and Davidson also offer a model of contract grading for Twenty-First Century Literacies and a model of collaborative peer evaluation. Students’ grades in the course come from self-and-peer evaluations using detailed evaluation forms. 

In chapter 8, Christopher Riesbeck described his critique-driven learning and assessment design of do-review-redo submission process for his intermediate-level programming course. I have used similar approach in my own teaching before and it works very well for any course with manageable number of students. The advantage for this approach is every one of your students can improve their first submissions based on feedback they receive from the instructor. The disadvantage for this approach is the potentially extended time instructors may spend on providing the feedback and reviewing the submissions and re-submissions. The key to this assessment method is making sure that the workload of providing feedback and reviewing revisions is manageable. In chapter 9, Clarissa Sorensen-Unruh provided her experience of using ungrading in her organic chemistry II course, giving students opportunities to practice evaluating their own work.

And that is only snippets of what I took away from a few chapters from this book. Many resources about ungrading outside the book were shared during our book club meetings, such as two-stage exams, group exams  and public exams. To answer a common question that ungrading practices may fit humanity courses more easily, Cyndie McCarley shared “Grading for Growth” blog written and maintained by two math instructors Robert Talbert and David Clark. To learn about all the creative assessment design methods introduced in this book, read it yourself either through library ebook or get a hard copy and enjoy reading, designing and experimenting! 

References

Kohn, A. and Blum, S. (2020). Ungrading. West Virginia University Press. 

Lang, J. (2016). Small Teaching. Jossey-Bass. 

Tobin, T.J. and Behling, K.T. (2018). Reach Everyone, Teach Everyone. West Virginia University Press. 

Reflection Assignments in Math Courses

Posted on by | Leave a reply

reflection of hot air balloon over water(image from pxfuel.com)

Reflection assignments as an active learning strategy are commonly seen in humanities courses. The purpose of this writing is to share an example of how simple reflection activities can make a huge impact in two math courses.

MTH 251 Differential Calculus covers five units, with one exam for each unit, counting 14% of the final grade. Before students attempt to take the unit exam, they are assigned to read textbook readings, watch instructor-created lecture videos, work on Canvas-based homework assignment and Adaptive Learning based practice assignments in Knewton Lab online platform. After assignment due date expires, students are assigned to complete a weekly written homework reflection. The weekly homework and the weekly homework reflection together count for 14% of final grade in this course, weighing the same as each of the unit exams.

MTH 341 Linear Algebra I has ten weekly modules. Each week, students  read textbook assigned readings, watch lecture videos created by the instructor (Dr.   ), complete post-reading questions in quiz format, work on graded group discussion questions to solve math problems in small groups, complete written homework individually, and in the following week, complete a written homework response activity individually in discussion format.   

The written homework reflection in MATH 251 and the written homework response in MATH 341 are both reflection activities designed to optimize student learning success, through comparing their own homework solutions with answer keys and evaluate whether they did it correctly or incorrectly and analyze where they did it wrong and how to get it right. The purpose of such weekly reflection is to help students develop meta-cognitive skills related to their learning. By looking back at students’ own work and learning from their mistakes, they develop an understanding of what is the proper way to solve a problem and what is not the proper way for solving a particular math problem. It also prompts students to plan for proper action in the future and exercises students’ executive functioning skills (CAST, 2018). 

Here is what the instructions for the weekly reflection look like:
1. First answer the weekly prompt: Reflecting on the Unit 1 module, which topics did you struggle with the most?
2. Download the written homework solutions PDF: (Solution for each written homework in pdf format is attached here.)
3. Look over the solutions and compare to your submitted homework. Look for any problems where your solution differs from the posted solution.

    • If your solutions had one or more incorrect problems then in the discussion board please discuss the following:
      • why you struggled with certain problems
      • why each solution makes sense now
      • what your misunderstanding was
      • what will you do in the future when solving problems similar to these?
      • what strategies will help you?
      • what did you learn by making a mistake?
      • what did you learn from looking at the solutions?
    • If you are still confused about a problem, ask a question. DO NOT simply list which problems you got wrong.
    • If your solutions are all correct then in the discussion board please discuss the problem that you found the most challenging. Describe what specific tasks helped you to complete that problem. Be as detailed as you can about your solution process.

Students not only posted their own reflections, but they also comment on or answer other students’ reflections as well. Additionally, the instructor and the four TAs in the course responded actively to students’ reflections, which makes the reflection more valuable since students get encouragement, praises, or corrections from the instructor and teaching assistants. Again, feedback from experts is critical in the success of a reflection activity (Vandenbussche, 2018)

What Reflection Usually looks like and what reflection should look like

Image 1: How reflection usually looks like and How reflection should look like (Image Source)

Many students were reflecting on what they did wrong and asked for help. Some were reflecting on their time management in completing the homework assignments. And we were glad to see students completing homework, evaluating their own work, analyzing where they did wrong, and planning for future improvement. Overall, the purpose of this assignment is accomplished!

goal 1 complete

(Image by Dave_Here)

A great benefit that comes from these weekly reflection activities is increased or sustained homework completion rate. For MTH 251 winter 2021 week 1 to week 7, over 85% of students completed the weekly homework and the reflection activity on average. For MTH 341 Fall 20 week 1 to week 7, over 90% of students on average completed the weekly homework and the reflection assignments. All math teachers love to see their students practice with homework assignments before they attempt to take the quizzes or exams! And evidence-based research tells us that deliberate practice with targeted feedback promotes mastery learning (Ambrose et al., 2010).

So, if it works in math courses, it will work in Chemistry, Biology, Physics, Engineering and other STEM courses too! If you’re interested in implementing this technique in your teaching and have questions about setting it up, feel free to contact us. We’d love to help you figure out the easiest way to set it up in your course.

References

Ambrose, S.A., Bridges, M.W., DiPietro, M., Lovettt, M.C. , Norman, M.K., & The Eberly Center for Teaching Excellence at Carnegie Mellon University. (2010). How learning works: Seven research-based principles for smart teaching. San Francisco, CA: Jossey-Bass

CAST. (2018). UDL Guidelines. Retrieved from https://udlguidelines.cast.org/ 

Vandenbussche, B. (2018). Reflecting for learning. Retrieved from https://educationaltoolsportal.eu/en/tools-for-learning/reflecting-learning 

Academic Success During Turbulent Time (Part 2): Teach Students How To Learn

Posted on by | Leave a reply

In part one of Academic Success, we reviewed why it is important to help students develop time management skills and how to design courses that help students manage time. In this post, we will discuss the why, what and how about teaching students how to learn.

By this time, most public schools and higher education institutions are coming to a close for Spring 2020 teaching. Congratulations on overcoming so many challenges and finishing teaching during COVID-19! As we prepare for summer and/or fall teaching, I would like to invite instructors to consider teaching students how to learn in your next teaching adventure, in order to help students achieve academic success.

WhyWhy Teach Students How to Learn?

For teachers, teaching students how to learn enables them to facilitate dramatic improvements in student learning and success (McGuire & McGuire, 2015).

For students, metacognition helps them to become self-aware problem solvers and take control of their own learning, through taking stock of what they already know, what they need to work on, and how best to approach learning new material (The Learning Center at UNC Chapel Hill, n.d.).

Teaching students how to learn also aligns tightly with the neuroscience of how humans learn. Dr. Daniela Kaufer pointed out four key learning principles based on the neuroscience of how people learn: (1). Learning involves changing the brain; (2). Moderate stress is beneficial for learning, while mild and extreme stress are detrimental to learning; (3). Adequate sleep, nutrition, and exercise encourage robust learning; and (4). Active learning takes advantage of processes that stimulate multiple connections in the brain and promote memory (Kaufer, 2011).

WhatWhat to Include in “Teach Students How to Learn”?

Now we have seen why it is important to teach students how to learn from the perspectives of teachers, students and neuroscience, it is time to look into the content of a “Teaching Students How to Learn” training module. Dr. Saundra McGuire suggests getting students’ buy-in as a first step, through early diagnostic assessment which can be used to find out what students already know and what they did not know.  Past examples of dramatic increase in assessment performance after receiving “Teaching Students How to Learn” training can also be an effective way to gain students’ buy-in. Secondly, Dr. McGuire suggests teaching students Bloom’s Taxonomy and study cycle to help students self-evaluate what they are learning and where to focus their learning at (the higher levels of learning, such as the applying, analyzing, evaluating and creating). The Study Cycle includes preview, attend, review, study and assess (Cook, Kennedy & McGuire, 2013). Thirdly, Dr. McGuire suggests sharing metacognitive learning strategies with students. The Learning Center at University of North Carolina at Chapel Hill lists eleven specific strategies that students can use to enhance their learning: (1) use your syllabus as a roadmap; (2) summon your prior knowledge; (3)  think aloud; (4) ask yourself questions; (5) use writing; (6) organize your thoughts using concept maps or graphic organizers; (7) take notes from memory; (8) review your exams using test analyzer tool; (9) pause and ask yourself why you are doing what you are doing and how what you’re doing relates to the course as a whole and to the learning objectives that your professor has set; (10) test yourself; and (11) figure out how you learn and what learning strategies work best for you.

HowHow: Implementing “Teach Students How to Learn” in Online Course Design

There are many ways teachers and instructional designers can build activities and structures in course design to teach students how to learn. The following list is a starting point:

  • Provide specific, measurable, attainable, result-focused and time-focused objectives at both course level and module level, and ask students how these objectives connect to their own learning interests and objectives, for example, using an ungraded survey/poll/private check in at the start of the term.
  • Provide opportunities for students to reflect on prior knowledge they bring to the target topic/course
  • Provide a list of questions to guide students for targeted reading and better reading comprehension as an active reading strategy, when assigning required readings materials.
  • Provide questions in video lectures to help students check their understanding and keep students engaged;
  • Release answer sheet to homework assignments after submission expires and provide opportunity for students to compare what they did right or wrong and how to get it right if they did it wrong initially, to achieve mastery learning;
  • Provide opportunities for peer review and instructor feedback and make it possible for students to resubmit edited versions based on feedback received for mastery learning;
  • Allow multiple attempts for assignments and assessments for mastery learning;
  • Provide opportunities for students to reflect around midterm what learning strategies they use, whether they are effective or not, and how to adjust for better results in the reminding time of the course.
  • Provide opportunities for students to reflect near the end of the term on what they learned and how they have learned, and how they might use the learning in their lives. For example, using discussion forum, google form survey, quiz or assignment to collect students’ reflective feedback.

The list can go endless. The point is there are many opportunities for teachers and instructional designers to build elements in course design to teach students how to learn! Feel free to share your ideas or experience of teaching students how to learn with us.

References

Cook, E., Kennedy, E., and McGuire, S.Y. (2013). Effect of Teaching metacognitive learning strategies on performance in General Chemistry Courses. Journal of Chemical Education, 2013, 90, 961-967.

Kaufer, D. (2011). Neuroscience and how students learn. University of California Berkeley Graduate Student Instructor Teaching & Resource Center. Retrieved from https://gsi.berkeley.edu/gsi-guide-contents/learning-theory-research/neuroscience/

McGuire, S. Y., and McGuire, S. (2015). Teach Students How to Learn : Strategies You Can Incorporate into Any Course to Improve Student Metacognition, Study Skills, and Motivation. First ed. Sterling, Virginia: Stylus, LLC.

The Learning Center, University of North Carolina at Chapel Hill. (n.d.). Metacognitive Study Strategies. Retrieved from https://learningcenter.unc.edu/tips-and-tools/metacognitive-study-strategies/

Resources on Neuroeducation

  • Adolphs, R. (2009). The social brain: neural basis of social knowledge. Annual Review Psychology. 2009; 60: 693-716.
  • Bransford, John., and National Research Council . Committee on Developments in the Science of Learning. How People Learn : Brain, Mind, Experience, and School. Expanded ed. Washington, D.C.: National Academy, 2000. Print.
  • CAST (2018). UDL and the learning brain. Wakefield, MA: Author. Retrieved from http://www.cast.org/our-work/publications/2018/udl-learning-brain-neuroscience.html
  • Doyle, Terry, and Zakrajsek, Todd. The New Science of Learning How to Learn in Harmony with Your Brain. Second ed. Sterling, Virginia: Stylus, LLC, 2019. Web.
  • Eyler, J. (2018). How humans learn : The science and stories behind effective college teaching(First ed.), Teaching and learning in higher education (West Virginia University Press)). Morgantown: West Virginia University Press.
  • Kaufer, D. (2011). Neuroscience and How Students Learn. Berkeley Graduate Student Instructor Center’s How Students Learn Series talk in Spring 2011. Retrieved from https://gsi.berkeley.edu/gsi-guide-contents/learning-theory-research/neuroscience/
  • McLagan, Pat. “Unleashing the Unstoppable Learner.” Talent Development7 (2017): 44-49. Web. https://www.td.org/newsletters/atd-links/being-a-lifelong-learner
  • Perkins, D. N.,  Goodrich, H. , Tishman, S. & Owen, J. M.(1994). Thinking Connections : Learning to Think and Thinking to Learn. Menlo Park, Calif.: Addison Wesley, 1994. Print.
  • Schwartz, Daniel L., Tsang, Jessica M., and Blair, Kristen P. The ABCs of How We Learn : 26 Scientifically Proven Approaches, How They Work, and When to Use Them. First ed. New York, NY: W.W. Norton &, 2016. Print. Norton Books in Education.
  • Südhof, T.C. (2013). Neurotransmitter release: the last millisecond in the life of a synaptic vesicle. Neuron. 2013 Oct 30;80(3):675-90. doi: 10.1016/j.neuron.2013.10.022.
  • Tokuhama-Espinosa, Tracey (2011). Mind, Brain, and Education Science: A Comprehensive Guide to the New Brain-Based Teaching.New York: W. W. Norton.
  • Ware, D. (2013). Neurons that fire together wire together. Retrieved from https://www.dailyshoring.com/neurons-that-fire-together-wire-together/

Academic Success in College: Time Management (part 1)

Posted on by | Leave a reply

(Estimated 6-minute reading )

Every college student registers for classes, hoping for academic success. However, college study can be challenging, even for those students who often get As and Bs in elementary and secondary schools (Macalester University, n.d.). Research tells us that lack of time management skills, life challenges that are out of students’ control, content challenges, and not knowing how to learn are among top factors contributing to academic failure in college. (Fetzner, 2013; Texas A&M Today, 2017, Perez, 2019) In this blog, we will examine the importance of teaching college students time management skills, and how we should teach them those skills.

Why should we teach college students time management skills? 

Fetzner (2013) reported top 10 ranked reasons students drop courses in college, after surveying over 400 students who dropped at least one online course:

  1. 19.7% – I got behind and it was too hard to catch up.
  2. 14.2% – I had personal problems (health, job, child care).
  3. 13.7% – I couldn’t handle combined study plus work or family responsibilities.
  4. 7.3% – I didn’t like the online format.
  5. 7.3% – I didn’t like the instructor’s teaching style.
  6. 6.8% – I experienced too many technical difficulties.
  7. 6.2% – The course was taking too much time.
  8. 5.0% – I lacked motivation.
  9. 4.3% – I signed up for too many courses and had to cut down on my course load.
  10. 3.0% – The course was too difficult.

Student services staff at Oregon State University Ecampus also confirm, based on their daily interactions with online students, that many college students lack time management skills (Perez, 2019). Now that we have realized that many college students lack sufficient time management skills, do we leave it for students to struggle and learn it on their own? Or is there anything we can do to help students develop time management skills so they thrive throughout their college courses? And who can help?

Who can help?

Many higher education professionals, including instructors, instructional designers, advisors, student success coaches, and administrators can help students develop time management skills. For example, at New Student Orientation, there could be a module on time management. Perez (2019) raised a good point that usually New Student Orientation already has too much information to cover, there will be very little room for thorough/sufficient time management training, even though we know it is an area that many of our students need improvement. Advisors can help students with time management skills. Unfortunately, with the current advisor/college students ratio and 15 minutes per student consultation time, that is very unlikely to happen either. Last but not least, instructors can help students with time management skills in every course they teach. If instructors are busy, instructional designers can help with templates or pre-made assignments to give students opportunity to practice time management skills.

How can instructors teach students time management skills?

How could instructors and instructional designers help students from falling behind? A couple crucial solutions are teaching students time management skills and giving students opportunities to plan time for readings, quizzes, writing original discussion posts, responding in discussion forums, working on assignments, homework problems, papers, and projects. Regarding self-hep materials for time-management skill, there are abundant resources on how students could improve time-management skills on their own. Apps and computer programs can help us manage time better. Sabrina Collier (2018) recommended over ten time management apps, including myHomework Student Planner, Trello, Evernote, Pomodoro apps, StayFocused, Remember the Milk, and more.

I personally use outlook calendar, google calendar, and word document to create my personalized study at the beginning of a new term. Rice University’s Center for Teaching Excellence provides an online tool for course workload estimation that is worth checking out. Read-O-Meter by Niram.org will estimate reading time for you if you copy and paste the text into text input window.  In Canvas Learning Management System, to help students plan their total study time needed, instructors could help students visually and visibly notice time needed for study, by stating estimated time for each and all learning activities, such as estimated reading time, video length, estimated homework time, etc. The following is an example Dr. Meta Landys used in her BI 319 online course.

Task list for students with the estimated time to complete each item

Image 1: Task Time Estimate and Visual Calendar of the Week in BI 319 “Critical Thinking and Communication In the Life Sciences” online with Instructor Dr. Meta Landys.

At program and institutional levels, keeping important dates visible to students will also help students stay on top of their schedule and not miss important timeline. At Oregon State University, a user-friendly calendar is created for parent and family of our student population, which includes important dates regarding academic success and fun campus events. For example, on the page for October 2019, the calendar shows October 6th as the last day to drop a fall term course with a 100% tuition refund, and the last day to add a fall term course online without departmental approval. These important dates could also be added to Canvas course modules or announcements, just as friendly reminders to students to make relevant decisions in time.

Parent & Family Calendar 2019-2020

Image 2: Oregon State University Parent & Family Calendar with important dates such as last drop to drop a course with 100% tuition refund; first date to register for a course for the coming term, etc.

It is true that there are plenty of resources on time management for students to learn by themselves. However, not all students know how to manage their time, even with the aid of digital tools. The problem is that when students are not required to make a detailed schedule for themselves, most of them will choose not to do it.  The other side of the problem is that there is very few activities which students are required to show instructors that they have planned/scheduled time for readings and all other study activities for the courses they are taking.  In Canvas, to train students in time management skills, instructors could give an assignment in week 1 to have students plan their weekly learning tasks for each of the 11 weeks. Students can use a word document, excel spreadsheet, apps, or google calendar to plan their time. Charlotte Kent (2018) suggests asking students to include sleep time, eat time, commute time, worry time, and free time and four to eight hours of study time per week per course. Yes, scheduling worry time and free time is part of the time management success trick!

Image 3: A color-coded google calendar example of scheduling study time for a student taking two courses online while working full time and raising children.

To sum it up, there are many ways instructors can help students to develop time management skills, instead of assuming it is individual students’ responsibility to learn how to manage time. Instructors could make estimated study time for each learning activity in a module/week. Instructors could require students to plan study time for the entire term at the beginning of the course. And instructors could recommend students to use apps and tools to help them manage time as well! If you have other ways to help students manage time well, feel free to contact me and share them with us: Tianhong.shi@oregonstate.edu.

 

References

Collier, Sabrina. (2018). Best Time-Management Apps for Students. Top Universities Blog.

https://www.topuniversities.com/blog/best-time-management-apps-students

Fetzner, Marie. (2013). What Do Unsuccessful Online Students Want Us to

Know? Journal of Asynchronous Learning Networks, 17(1), 13-27.

Kent, Charlotte. (2018). Teaching students to manage their time. Inside Higher Ed. September

18, 2018. Retrieved from https://www.insidehighered.com/advice/2018/09/18/how-teach-students-time-management-skills-opinion

Perez, M. (2019). September 2019 Oregon State University Ecampus Un-All-Staff meeting.

Oregon State University. (2019). Parent & Family Calendar 2019-2020. Retrieved from

https://families.oregonstate.edu/sites/families.oregonstate.edu/files/web_2019_nspfo_calendar.pdf

 

What can we learn from the success of CANVAS LMS?

Posted on by | Leave a reply

Oregon State University’s Learning Management System (LMS) migrated to Canvas in 2014-2015. The Canvas migration was based not only on the company’s feature alignment with our learning platform needs but also on the outstanding customer service Canvas Instructure has provided to our LMS user community including students, faculty, instructional designers, and administrators. How Canvas provides customer service offers an example we can model to continue to exceed student expectations.

According to Michael Feldstein’s July 8, 2018 report, major players in US LMS market include Blackboard, Canvas, Moodle, Bright Space, Sakai, Schoology, and others (Feldstein, 2018).

LMS Market share in North America

Figure 1: US Primary LMS Systems, July 6th, 2018 (Feldstein, 2018)

 

Of these major players in the LMS field, Canvas is most noticeable with fastest growth in market share among U.S. and Canadian higher education institutions.

LMS history and Market Share

Figure 2. LMS Market Share for US and Canadian Higher Ed Institutions (Feldstein, 2018)

 

Different people suggest different criteria when comparing LMSs. Udutu.com provided a list of 7 things to think about before purchasing a LMS:

  1. Be clear on your learning and training objectives;
  2. Don’t be fooled by the high costs of an LMS;
  3. Know the limitations of your internal team and users;
  4. Pay for the features you need, not for what you might need;
  5. The latest new technology is not necessarily the best one;
  6. Customer support is everything; and
  7. Trust demos and trials over reviews, ratings and “industry experts”

(Udutu, 2016).  Noud (2016) suggested the following ten factors to consider when selecting a LMS:

  1. Unwanted Features;
  2. Mobile Support;
  3. Integrations (APIs, SSO);
  4. Customer Support;
  5. Content Support;
  6. Approach to pricing;
  7. Product roadma;
  8. Scalability, Reliability and Security;
  9. Implementation Timeframe; and
  10. Hidden costs.

Christopher Pappas (2017) suggested 9 factors to consider when calculating your LMS budget:

  1. Upfront costs;
  2. LMS training;
  3. Monthly Or Annual Licensing Fees;
  4. Compatible eLearning Authoring Tools;
  5. Pay-per-User/Learner Fee;
  6. Upgrades and Add-Ons;
  7. Learning and Development Team Payroll;
  8. Online Training Development Costs; and
  9. Ongoing Maintenance.

Of all of the above lists, I like Udutu’s list the best because it matches with my personal experiences with LMS migrations.

I first used WebCT between 2005 and 2007, participated in migrating from WebCT Vista to Blackboard in 2008, and Angel to Blackboard migration in 2013-2014.  During my seven years of using Blackboard as instructional designer and faculty support staff, my biggest complaint with Blackboard was its unexpected server outages during peak times such as beginning of the term and final’s weeks. In 2014, I moved to Oregon State University (OSU). The OSU community was looking for a new LMS in 2013 and started piloting Canvas in 2014. At the end of the pilot, instructor and student feedback was mostly positive. Not subject to local server outages, the cloud-based system was stable and had remained available to users throughout the pilot. Of course no LMS is perfect. But after careful comparison and feedback collection, we migrated from Blackboard to Canvas in 2015. So far in my four years of using Canvas, there has not been a single server outage. Canvas has the basic functionality of a LMS.

Canvas wanted to expand their market share by building up positive customer experiences. They were eager to please OSU and they provided us with 24/7 on-call customer service during our first two years of using Canvas, at a relatively reasonable price. The pilot users were all super satisfied with their customer service. Several instructors reported that they contacted Canvas hotline on Thanksgiving or Christmas, and their calls were answered immediately, and their issues were resolved.

Michael Feldstein (2018) summarized that Canvas’ “cloud-based offering, updated user interface, reputation for outstanding customer service and brash, in-you-face branding” have helped its steady rise in the LMS market share. As instructors and instructional designers, we can learn a lot from the CANVAS INSTRUCTURE’s success story and focus on improving the service we provide to our students, such as student success coaching, online recourses, online learning communities, etc. Would you agree with me on this? If you have specific suggestions on how to improve the way we serve our students, feel free to let us know (Tianhong.shi@oregonstate.edu ; @tianhongshi) !

 

References:

Goldberg, M., Salari, S. & Swoboda, P. (1996) ‘World Wide Web – Course Tool: An Environment for Building WWW-Based Courses’ Computer Networks and ISDN Systems, 28:7-11 pp1219-1231

Feldstein, Michael. (2018). Canvas surpasses Blackboard Learn in US Market Share. E-Literate, July 8, 2018. Retrieved from https://mfeldstein.com/canvas-surpasses-blackboard-learn-in-us-market-share/ on February 2, 2019.

McKenzie, Lindsay. (2018). Canvas catches, and maybe passes, Blackboard. InsideHigherEd. July 10, 2018. Retrieved from https://www.insidehighered.com/digital-learning/article/2018/07/10/canvas-catches-and-maybe-passes-blackboard-top-learning on February 2, 2019.

Moran, Gwen (October 2010). “The Rise of the Virtual Classroom”. Entrepreneur Magazine. Irvine, California. Retrieved July 15, 2011.

Noud, Brendan. (February 9, 2016). 10 Things to consider when selecting an LMS. Retrieved from https://www.learnupon.com/blog/top-10-considerations-when-selecting-a-top-lms/ on February 2, 2019.

Pappas, Christopher. (June 13, 2017). Top 9 Factors to consider when calculating Your LMS Budget. Retrieved from https://blog.lambdasolutions.net/top-9-factors-to-consider-when-calculating-your-lms-budget on February 2, 2019.

Udutu. (May 30, 2016). How to choose the best Learning Management System. Retrieved from https://www.udutu.com/blog/lms/ on February 2, 2019.

Wikipedia. (n.d.). WebCT. Retrieved from https://en.wikipedia.org/wiki/WebCT on February 2, 2019.