Logs

In ecological momentary assessments and experience sampling research, it is crucial for researchers to have real-time access to the progress of data collection. ExpiWell provides the Logs tab for researchers to monitor this information and interact with participants. Notable features include:

1. Notifications and reminders: Check if all participants are receiving notifications and reminders. 
2. Submission and response rates: See if participants are submitting their surveys. Track the overall response rate of the project in real time. 
3. Sending additional push notifications: If participants have a low response rate, feel free to send additional reminders!
   
4. Participant payments: Compensate participants based on their response rates.
5. Show individual question responses: If you ask for identifying information in your surveys (e.g., emails, unique IDs) you can display that information.

Overview

Researchers can access the "Logs" page under the "Insights" tab.

Here, you will have a quick overview of all the participant information. 

Participant

ExpiWell provides a simple but unique participant number for each participant in the log. The first participant who joins the project will be Participant 1, followed by Participant 2, and so on.

Please note that participants in different projects will have different participant numbers. However, the unique alphanumeric ExpiWell Participant ID will remain the same across all projects.

User Account

User account data will be shown if the participant was invited to join the project via email under 'Invite Participants by ExpiWell user account' or has used a 'Temporary Participant Account' to log in.

Item

This shows the overall project and created surveys.

You will need to drill down to view specific surveys.

As shown below, you can now see the specific surveys in the "Project". Here, we have a "Daily", "Emotions survey", and "Daily Mood" survey.

Scheduled

This shows when the project and surveys are scheduled.

This column is very useful to examine when you have a "Rolling Schedule" and each participant may be starting at different dates. It is also very useful when you have "Randomized" survey schedules such that participants do not receive surveys at the same time each day. You can determine when the survey is scheduled for each participant and for each specific day, which will vary.

As shown below, drilling down shows the unique survey schedule for each participant.

Time Zone Changed

This indicates whether the participant experienced a time zone change during the study period and shows how many times it occurred. In the example below, Participant 1 experienced a time zone change twice.

Clicking on 'Yes' under the 'Time zone Changed' column will display details of the time zone change.

The example below shows that Participant 1 experienced time zone changes twice on their mobile device while traveling on September 2nd and 6th, 2024.

If a survey is submitted outside the scheduled time slot, the participant may have experienced a time zone change midway through the survey. This change could result in the survey being submitted outside the designated window.

Notifications and Reminders

ExpiWell uses push notifications to participants' devices to let them know when to take schedules surveys. You can track if notifications are being sent to participants through the Logs. 

Notif. Type: Whether the notification is the first "initial" notification or the later "reminder" notification.

Notif. Time: The time the notification was sent to the participant

Notif. Status: Whether the notification was 'not sent' or 'received'. 'Not sent' may mean that the participant only added the project after the first survey was scheduled for the day (as indicated by a small red icon next to it), or the participant may have retaken the survey using the personalizer functionality so no notification was sent.

As shown below, you can also change to view initial or reminder notification times.

Submission and Response Rates

You can track real-time participant submissions, submission rates, and response rates.

If a survey participant is actively engaged in a survey when the closing time arrives, the system will automatically submit their responses. It's important to note that submission rates are solely determined by when participants manually submit their surveys, rather than auto-submission.

Submitted

This shows when the participant last submitted a survey. This is useful to check when participants were last active.

Submission Rate

This tracks the rates of submitting surveys. 9 out of 10 survey submissions will translate to 90% submission rate.

Response Rate

This tracks the rates of responses within surveys. 9 out of 10 questions answered will translate to 90% response rate.

Overall and Current

By toggling between "Overall" and "Current," values change for "Submission Rate" and "Response Rate".

Overall: when you are interested in participant responses with respect to all the survey scheduled, from the start to finish. 

Current: when you are interested in participant responses up to the current time. This is very useful for monitoring as data are coming in.

Status

This indicates whether a Project or Set of Surveys is 'Added' if it is pending scheduled submissions or 'In Progress' if it is ongoing. If the study period is over, the Project or Set of Surveys may be marked as 'Complete' for a fully submitted set of surveys or 'Past Due' if some surveys were missed. Individual surveys will also be marked as 'Scheduled' if they are upcoming, 'Complete' if submitted, or 'Past Due' if missed.

IP Address

This shows the IP Addresses of the participants. 

Active

This indicates whether a participant's status is active in the project. A 'green tick' appears when the participant has joined the project and is/was actively engaging with it. A 'red x' appears when the participant has either:

1. Removed the project
2. Deleted their account
3. Was invited by email but later removed by the researcher.

The date and time shown with the 'red x' indicate when any of these scenarios occurred.

Sending Additional Push Notifications

In EMA and ESM, it is often necessary to ping participants, especially those with a low submission or response rate.

Researchers can send additional push notifications to participants using two methods:

1. Send Messages Button: Allows you to send messages to multiple participants at once.
   
2. "Options" Individual Messages: Allows you to send messages to individual participants

Send Messages

To send messages to multiple participants, you can click on the "send" messages as shown below.

On clicking "Send Messages," a pop-up will appear, and you can choose the participant(s) to send the message to. You can also decide on whether to send the participants messages immediately or schedule a later time to send the message.

"Options" Individual Messages

You can send individual messages by clicking on "Options" for a particular participant and then send a message.

In the pop-up, you can type the message you want to send either now or schedule it for later. 

Note that you can also view past messages sent to participants here.

Participant Payments

You can also compensate participants by going to "Options" and clicking on "View Payments"

This will bring up a modal where you can manage participant payments.

As seen above, you will be able to pay participants, send a message alongside the payment, and track the payment history for the participant.

Show Duplicates

This displays participants who may have joined the project multiple times and indicates when they did so.

Here, you can see that Participant 1 joined this project multiple times. 

Hide Participants

This feature allows you to hide certain participants on the 'Logs' page by selecting the participant you wish to hide and clicking on the 'Hide participants' button. A confirmation pop-up will then appear.

This may be helpful if some participants decide to drop out of the project and you do not wish to continue monitoring their progress.

In this example, after you click 'Yes', the 'Logs' Page will only show Participant 1 since Participant 2 is hidden.

You can still view hidden participants by toggling the 'Show hidden participants' button. For example, Participant 2, who was previously hidden, will now be visible on this page.

You can add the hidden Participant 2 back to the main 'Logs' Page by clicking on the participant, selecting the 'Show participants' button, and confirming your selection in the pop-up window.

Balance

This feature allows you to check the remaining funds available to pay your participants and review the payments made in this project.

Download

You can download all of the log data in a CSV file by clicking on the 'Download' button. This is very helpful for keeping a record of participant submission and response rates, notifications, and payment amounts.

The CSV file can be downloaded with the Unix timestamp or in local time

Here's an example of a CSV file with the participants' log data in local time.

Show Individual Question Responses

You can show individual question responses in the participant log. This allows you to note what responses individuals provide.

This is very helpful for two scenarios:

1. Showing participant ID information. You may need to determine if someone you invited has joined the project. Or, showing the participant that may not be responding. This requires you to ask identifying information in your survey question(s).
2. Showing responses on critical questions. You may need to see if participants responded to an important question, or what their response is to a question.
   

To do this, click on 'Show Question Response'.

You can then choose the question you want to show from your surveys. If participants responded, it will appear in the response column.

Additionally, if the survey was scheduled multiple times, you can click on the grey icon in the response column to see all the responses to the selected survey and question.

 

Note that you will not be able to see the following types of questions and question responses: 

1. Instruction : Response will be empty 
   
2. Media : Response will be empty.
   
3. Grid : Response will be empty

'Take One-Off Experience' Participants

If anonymous users answered your survey using the "Take One-Off Experience", you can identify them in the CSV file downloaded from the Insights 'Responses' Tab. This information isn't visible in the 'Logs' tab but can be found in the downloaded response file as shown below.

You can see the records of anonymous users' responses, including details like IP address, time zone, and survey start and finish dates. 

      

• Related Articles

• Overview of Participant Payment Arrangement Process

  ExpiWell allows researchers to configure and manage participant payment arrangements directly within the platform. Below is an overview of the payment arrangement process, including timing, disbursement, and privacy considerations: Amount and Timing: ...

• General Information about EMA and ESM Notifications

  What You Need to Know About EMA and ESM Notifications Information about Push Notifications The ExpiWell app uses Google's Firebase Cloud Messaging push notifications to send surveys, reminders, and message notifications to participants. Push survey ...

• Paying Participants for Survey Participation

  How to Pay the Survey Participants Paying survey participants is usually used by researchers to encourage participants to participate in research. ExpiWell is an experience sampling tool, but we have also created a way to make this possible for ...

• UNIX Timestamps

  How to Use the UNIX Timestamps Unix timestamp is a way to track time as a running total of seconds. It should also be pointed out that this point in time technically does not change no matter where you are located on the globe. In ExpiWell, you can ...

• Creating a Project in ExpiWell: Step-by-Step Guide

  Welcome to ExpiWell! This guide will walk you through the process of creating a project on our platform. It's easy! Main Dashboard After logging in, you'll land on your main dashboard. To create a new project, click on either the '+New' or 'Create ...