Manage Creative Testing campaigns#

This page describes what to consider while running an active campaign and troubleshoots some potential issues that might arise while testing.

For specific steps on how to run a Creative Testing campaign, refer to the Start a Creative Testing campaign documentation.

For information on testing parameters and recommended best practices for Creative Testing campaigns, refer to the Configure Creative Testing campaigns documentation.

Prerequisites#

• Active campaign: To use these management practices, you will need to have a currently active Creative Testing campaign.

Campaign management#

While you are actively running a Creative Testing campaign, the following information will help you with potential questions that arise during a live Creative Testing campaign.

Pause or stop campaigns#

You can pause or stop a Creative Testing campaign at any time in the campaign cycle. It's recommended best practice to use a sample size calculator to determine when you have generated enough data to accurately interpret the creative testing results. Unity recommends running a test campaign until you have delivered at least 20,000 impressions for each creative pack in the campaign.

To pause or stop your Creative Testing campaign at any time, do the following:

1. Go to the Campaigns section of the Unity Ads User Acquisition dashboard and select the checkbox next to your active Creative Testing campaign.
2. Select the Pause campaign button.

Campaigns will retain the Paused status until you delete or restart them.

Multiple test campaigns#

There is no limit to the number of Creative Testing campaigns you can run simultaneously. Because Creative Testing campaigns deliver all impressions equally, your test campaigns will be competing with each other for impressions if they run concurrently. It’s recommended best practice to limit the number of test campaigns running at a time to avoid increasing the time needed to achieve enough impressions.

For more information on how to calculate whether your campaign has reached enough impressions, refer to the Calculate sample size section of this documentation.

Uneven distribution#

If your Creative Testing campaign isn't delivering your creative packs equally, an uneven distribution warning will appear in the Creative packs section of the campaign details. This warning appears when there are notable differences in your creative packs, such as the moderated age rating or the assigned start date.

Hover your mouse over the yellow warning icon next to your creative packs to access a warning tooltip. These tooltips contain information about the creative pack differences that might be leading to uneven distribution. The tooltip will offer guidance on how to resolve the issue, usually by removing the problem creative pack or changing the time frame of your campaign.

Change or add creative packs#

Unity doesn't recommend changing or adding creative packs to an active Creative Testing campaign. Because test campaigns deliver impressions equally, the impression count is an essential metric of the experiment. Any creative packs with an existing impression count will continue that count after you add a new creative pack. This makes accurately comparing creative packs difficult.

If you do add a creative pack to an active Creative Testing campaign, ensure that you adjust the test start date by doing the following:

1. In the Scheduling section of the campaign details, select the edit icon next to Start Date to open the date field.
2. Enter the date that you added or changed a creative pack in the Creative Testing campaign. You can also select the calendar icon to choose the date from a date selector.
3. Select Save to save your details and close the date field.

The start date should be the day you add or change a creative pack in the Creative Testing campaign. This will reset the data in the overview table of the Creatives section as well as in any reports you generate through Report Builder.