This post is a continuation of an earlier one, Boost Your Student Engagement with Qualtrics: Part 1. This post will describe the setup and use of a specific Qualtrics Survey used in a recent OSU Ecampus Course, Communications Security and Social Movements (Borradaile, 2021).

In the survey example, I am going to share, an instructor had an assignment in which each student was to select from a list of social movement groups they wished to research and prepare a recorded lightning talk. The instructor didn’t want any two students to be able to select the same group to research.

What the survey needed to do was eliminate each choice once it had been selected by a student. As the students take the survey, one by one, and select their group, the next students taking the survey should not see the choices previously selected.

Qualtrics lets you add “Quotas” to a survey. Using quotas you can specify a number of actions that modify your survey’s behavior once a condition has been met. That is how this design challenge was solved. Each option in the survey was given a quota of 1. Once that quota had been reached, because a student selected that social movement group, and then submitted their survey, the item would disappear from the list.

This survey uses a combination of a Simple Logic Quota and Display logic. This is a bit more complex than setting up a normal survey, so let’s walk through the steps.

Design Your Survey

Do the following steps outside of Qualtrics.

1. Identify a list of topics students can choose from.
2. Determine how many students should be able to select an individual answer (this number would not have to be the same for each option).
3. If the list is long, you will want to write out the list of choices in a text file. It will make the question creation a little faster, and if anything goes wrong, you can easily start over.

Implement Your Survey in Qualtrics

The following steps assume basic familiarity with creating surveys in Qualtrics. Where applicable, links to the Qualtrics documentation will be provided to go into more detail as needed.

Setup Your Survey and Survey Question

1. Create a new survey project in Qualtrics
2. Create a multiple-choice question to hold your list of choices.
   • Answer type: Allow one answer
3. Add your answer choices to the multiple-choice question for your students to pick from.

Add a Quota to Each Answer Choice

During this step, you will be defining how many students (survey respondents) you would like to be able to select each choice.

1. Navigate to the Survey Options by clicking on the Survey Options Icon on the left hand side of the screen.
2. Select “Quotas” from the Advanced Section
3. Select Add a Quota
4. Choose “Simple Logic Quota”
5. Make the following selections under “Increment the quota when a response is submitted that meets the following conditions:”
   • Question
   • MC question containing your list
   • Select the first option in the MC list
   • Choose “Is Selected”
6. From Quota Options choose, Choose “None for Skip Logic or Survey Flow) from “When the quota has been met, then:” pull-down.
7. On the left-hand side, give the item a name and set the number of students you would like to be able to choose the MC answer selected above. Once you have set how many you like, it should show 0/1. This says that zero people have selected the option out of the 1 you want for each choice.
8. Click Save

See the steps to add quota logic to a question choice in action.

Once you set up the Quota for one of your MC answer choices, you can copy the quota logic and re-use it for the other choices. Additional information can be found in Qualtrics Creating Quotas Documentation.

When you have completed setting up your desired quota for each choice, move on to the Display Logic configuration.

Set the Display Logic for Each Answer Choice

During this step, you will be configuring your survey question to only display each answer until the quota has been reached.

1. Activate the first option in your list.
2. From the pull-down, select “Add Display Logic”
3. Under “Display this Choice only if the following condition is met:” Select “Quota” in the first pull-down
4. Select the first option in your MC list
5. Select “Has Not Been Met” from the third pull down. In other words, only display this option if the quota has not been met.
6. Select Save.

Again, repeat this for each item in your list.

Creating Surveys

Working with Large Lists

In the social justice example described above, there were close to 40 options in one MC question. The long list was copied from a text file and then pasted into the survey. This made it easier and quicker to create the long list. It also helped as we were experimenting with the survey and setting up samples ahead of the design. It is easy to paste by clicking on the first MC question where it says “Click to write Choice 1” and paste your list of options See this in action.

Additionally, to make it easier to navigate, the options were grouped by category using the Assign to Group feature.

Gotchas to Watch Out For

• Survey responses do not increment quota numbers until the survey is submitted. If multiple students launch the survey at the same time, it is possible that they both could make the same choice, resulting in your set quota being exceeded.
• If you are using this survey as an assignment (for instance giving completion points for participation), make sure that your assignment settings do not allow for multiple submissions.

References

Borradaile, G. (2021, March 29). CS 175 Communications Security and Social Movements.