Randomize Survey Questions
Why Randomizing Survey Questions Can Improve Participant Answers
In experience sampling and ecological momentary assessments, randomizing questions can help to reduce response sets. For instance, participants who receive the same order of questions tend to respond in the same way over time in an unthinking way. By randomizing the questions, we change how questions are presented and it can help reduce this problem.
1. Questions within surveys can be randomized (i.e., presented in a random order to participants) (indicated by the orange box in the screenshot below).
2. Questions within question blocks can be randomized (indicated by the blue box in the screenshot below). Researchers can toggle the randomization option within the designated question block. This randomizes the questions within the block.
3. Each survey will display only a selected number of randomized questions within the question block (indicated by the red box in the screenshot below), allowing for diversity in messaging.
Randomization of questions within the question block (as shown in option 2 above) and choosing a selected number of randomized questions (as shown in option 3 above) cannot be done simultaneously, as shown in the screenshot below.
When the randomization option is "on," the button appears green in color (as shown in the screenshot below). This selection randomizes all of the questions and question blocks within the survey.
Selected Number of Randomized Questions within Question Block: This option can be applied to either groups or question groups, and the number of randomized questions can be entered as shown in the screenshots below. If multiple questions are selected, the questions displayed to participants will be completely randomized. For example, two questions are selected in the screenshot below; question 5 (media question) can be shown first, followed by question 2 (single selection question) to participants.
Two randomly selected questions within this group will be displayed in each survey:
One randomly selected question within this question group will be displayed in each survey:
Utilizing Advanced Randomization Techniques - In addition to basic question randomization, advanced techniques offer further customization.
1. Group Creation
- Click the "add group" button to create multiple groups, each named accordingly.
2. Nested Groups
- Establish a hierarchy by placing a group inside another group (referred to as MAIN GROUP in the screenshots below). This nested structure adds an extra layer of organization.
3. Randomization within groups
- (1)Randomize the order of groups within the main group, providing a systematic yet varied survey experience.
- (2)Similarly, randomize the questions within each subgroup, ensuring diverse question sequences.
These advanced randomization techniques not only enhance participant engagement but also offer researchers greater control over the survey experience. By incorporating randomness at multiple levels, surveys become more robust tools for gathering meaningful insights.
Related Articles
Project Screener Survey
Create Your Project Screener When you are recruiting participants from a panel, from a community, or from an online ad, it is important to create a project screener to screen participants for the right attributes. One functionality of the "Project ...Screener Questions
Learn the Screener Question Feature The "Screener Question" feature is used to screen out participants DURING the project. In other words, while they are participating in the experience sampling or ecological momentary assessment project and ...Ways to Group Questions for ESM and EMA
Two Ways to Group Questions For more complex survey structure in experience sampling method (ESM) and ecological momentary assessments (EMA), surveys can be organized into different types of question blocks. Within these question blocks, researchers ...Survey Logic/Branching for EMA and ESM
Three Logic Functions You Need to Know There are several logic functions you can use to manage the flow of your ecological momentary assessment (EMA) and experience sampling method (ESM) survey flow. The three logic functions are: Skip Logic: ...Survey Setting Options
Customize Participant Experience With Survey Setting Options Within the Survey Builder, there are many options to choose from to customize the participant experience. To open the settings within the Builder, select the dotted icon. Then, select the ...