ExpiWell: Randomize Survey Questions

Randomize Survey Questions

Why Randomizing Survey Questions Can Improve Participant Answers 

In experience sampling and ecological momentary assessments, randomizing questions can help to reduce response sets. For instance, participants who receive the same order of questions tend to respond in the same way over time in an unthinking way. By randomizing the questions, we change how questions are presented and it can help reduce this problem.

1. Questions within surveys can be randomized (i.e., presented in a random order to participants) (indicated by the orange box in the screenshot below).

2. Questions within question blocks can be randomized (indicated by the blue box in the screenshot below). Researchers can toggle the randomization option within the designated question block. This randomizes the questions within the block.

3. Each survey will display only a selected number of randomized questions within the question block (indicated by the red box in the screenshot below), allowing for diversity in messaging. 


Questions within surveys can be randomized


Info
Randomization of questions within the question block (as shown in option 2 above) and choosing a selected number of randomized questions (as shown in option 3 above) cannot be done simultaneously, as shown in the screenshot below. 

Randomization of questions within the question


When the randomization option is "on," the button appears green in color (as shown in the screenshot below). This selection randomizes all of the questions and question blocks within the survey.
andomization option is on


Selected Number of Randomized Questions within Question Block: This option can be applied to either groups or question groups, and the number of randomized questions can be entered as shown in the screenshots below. If multiple questions are selected, the questions displayed to participants will be completely randomized. For example, two questions are selected in the screenshot below; question 5 (media question) can be shown first, followed by question 2 (single selection question) to participants.

Two randomly selected questions within this group will be displayed in each survey:

 randomly selected questions within this group


One randomly selected question within this question group will be displayed in each survey:
One randomly selected question within this question group


Utilizing Advanced Randomization Techniques - In addition to basic question randomization, advanced techniques offer further customization.

1. Group Creation
  1. Click the "add group" button to create multiple groups, each named accordingly.
ExpiWell - creating multiple groups



2. Nested Groups
  1. Establish a hierarchy by placing a group inside another group (referred to as MAIN GROUP in the screenshots below). This nested structure adds an extra layer of organization.
ExpiWell - a group inside the main group


3. Randomization within groups
  1. (1)Randomize the order of groups within the main group, providing a systematic yet varied survey experience.
  2. (2)Similarly, randomize the questions within each subgroup, ensuring diverse question sequences.
ExpiWell - Randomizing the groups, and questions within the groups

These advanced randomization techniques not only enhance participant engagement but also offer researchers greater control over the survey experience. By incorporating randomness at multiple levels, surveys become more robust tools for gathering meaningful insights.
    • Related Articles

    • Project Screener Survey

      Create Your Project Screener When you are recruiting participants from a panel, from a community, or from an online ad, it is important to create a project screener to screen participants for the right attributes. One functionality of the "Project ...
    • Screener Questions

      Learn the Screener Question Feature The "Screener Question" feature is used to screen out participants DURING the project. In other words, while they are participating in the experience sampling or ecological momentary assessment project and ...
    • Ways to Group Questions for ESM and EMA

      Two Ways to Group Questions For more complex survey structure in experience sampling method (ESM) and ecological momentary assessments (EMA), surveys can be organized into different types of question blocks. Within these question blocks, researchers ...
    • Survey Logic/Branching for EMA and ESM

      Three Logic Functions You Need to Know There are several logic functions you can use to manage the flow of your ecological momentary assessment (EMA) and experience sampling method (ESM) survey flow. The three logic functions are: Skip Logic: ...
    • Survey Setting Options

      Customize Participant Experience With Survey Setting Options Within the Survey Builder, there are many options to choose from to customize the participant experience. To open the settings within the Builder, select the dotted icon. Then, select the ...