Enhancing Survey Flexibility with Randomized Selection Options

Scheduled Group

This feature allows to do randomized or manual selection process to determine which group or cluster of questions to present to participants based on their scheduled survey sessions. This randomization adds an element of unpredictability, ensuring each participant receives a varied and unbiased selection of questions over time. For instance, consider a survey with four question groups labeled Group A, Group B, Group C, and Group D. Here's an example schedule for two participants:

Participant 1
Day1 - Group B
Day2 - Group A
Day3 - Group D
Day4 - Group C

Participant 2
Day1 - Group D
Day2 - Group A
Day3 - Group B
Day4 - Group C

Setting up

To set this up, navigate to the survey building page and click on the SCHEDULED GROUP icon, as shown in the image below. Then, create as many groups as needed.
Survey Builder - Scheduled Group

On the scheduling page, you'll have the option to either randomize the groups or manually select them for presentation to participants.
Scheduling page - Scheduled group option

You can choose to randomize the groups and specify how many groups participants will receive at each prompt, along with options for with or without replacement.
Random Choice option

Here are some examples for scenarios using the "Random Choice":

  1. Schedule the survey 4 times with replacement (Randomly Choose = 1 out of 4): A, B, A, C
  2. Schedule the survey 4 times without replacement (Randomly Choose = 1 out of 4): A, C, D, B
  3. Schedule the survey 4 times with replacement (Randomly Choose = 2 out of 4): AC, DB, BC, AD
  4. Schedule the survey 4 times without replacement (Randomly Choose = 2 out of 4): - (not applicable)
  5. Schedule the survey 2 times without replacement (Randomly Choose = 2 out of 4): AC, BD

These examples illustrate different scenarios of using the "Randomly Choose" option in survey scheduling, considering both with and without replacement choices.


FAQS

What is with or without replacement?
  1. With Replacement: Survey groups are randomly selected from an available pool and then returned, allowing the same group to be chosen multiple times. This keeps the probability of selecting each group constant throughout the process.
  2. Without Replacement: Survey groups are randomly selected from an available pool but are not returned, ensuring that each group is chosen only once. This changes the probability of selecting each group with each draw as the pool decreases after each selection.

For further inquiries, please reach out to john@expiwell.com

    • Related Articles

    • Group Data Collection

      How Does Group Data Collection Work? For experience sampling and ecological momentary assessment projects, the default is to collect data at the individual level. In other words, we care only about individual experiences. However, there are many ...
    • Ways to Group Questions for ESM and EMA

      Two Ways to Group Questions For more complex survey structure in experience sampling method (ESM) and ecological momentary assessments (EMA), surveys can be organized into different types of question blocks. Within these question blocks, researchers ...
    • Distributing your EMA and ESM project to Participants

      How to Distribute Projects to Participants Once you have created and scheduled your surveys for your ecological momentary assessment (EMA) and experience sampling method (ESM) project, you will reach the next stage of deciding how to distribute your ...
    • Randomize Survey Questions

      Why Randomizing Survey Questions Can Improve Participant Answers In experience sampling and ecological momentary assessments, randomizing questions can help to reduce response sets. For instance, participants who receive the same order of questions ...
    • Survey Pause when Adding New Survey Window

      Learn About Survey Pause Feature When you create multiple event-triggered surveys, you may be concerned about participant burden in taking too many surveys. One feature in Event-Trigger is "Survey Pause". This enables you to stop other scheduled ...