A/B test
Optimize ad monetization by conducting A/B tests on waterfall configurations and ad strategies, adjusting traffic splits, and analyzing performance metrics to determine the most effective setup.
読み終わるまでの所要時間 4 分最終更新 1日前
The A/B test tool enables you to test different ad monetization strategies on the ad unit level. You can split user traffic, add ad units to the test at any time, and remove an individual ad unit without closing the entire test. You can start an A/B test from the following locations:
- Mediation management page: test different waterfall settings, including:
- Waterfall setup
- Mediation groups
- New networks
- Instance pricing - To test your waterfall configuration
- Ad units page: create any type of ad strategy test for all of the supported features on the ad unit and placement level:
- Ad unit capping and pacing
- Banner refresh rate
Start an A/B test
The following process details how to start an A/B test from the Mediation management page.- Under Management, select Mediation.
- Select the app, and then select the ad unit to run an A/B test on.
- In the upper right corner, select Start test.
- Enter a name and description for your test.
- Decide how to split the traffic between the test group and the control group. By default, the split is set at 50/50. You can decrease or increase it by increments of 5%.
注
You can also test your ad strategy by A/B testing your capping and pacing. Under Capping & Pacing for group B, adjust the number of ads you want users to see and the frequency at which the ads are shown.
- Under Reward, select the edit icon to adjust the type of reward or the number of rewards a user gets for watching an ad.
注
Each change you make applies only to the test group. However, the following exceptions will update both A and B groups:
- ironSource instances
- Network test mode status
- Activation or deactivation of ironSource as a bidder
- Callbacks
Modify your waterfall setup
On the Mediation Management page, use the toggle to switch between group A (control) and B (test). Adjust the waterfall configuration for group B (test group) according to the variables you want to test. Each change you make will apply only to group B. Supported waterfall components include:- Addition (or subtraction) of instances from the mediation group
- Group configurations
- Delete / add groups
- Instance rates
- Instance level capping
Add an ad unit to a test
To add an ad unit to an A/B test, complete the following steps.- Selecting the ad unit name (Rewarded, Interstitial, or Banner) from the dropdown menu in the upper left corner of the page.
- Select Add to test.
- Adjust the waterfall configuration for your test group (B) according to the variables you want to test.
- Select Save, and the ad unit is immediately be added to the test.
Test monitoring and reports
From the left navigation menu, select A/B to open the A/B Management page, on which you'll see a list of the apps that currently are running an A/B test and apps that have ended an A/B test.注
Traffic that is not yet included in an active A/B test is marked as N/A.
- Select the action button at the end of an app's row
- Select View A/B dashboard.
- Revenue
- ARPDAU
- D0 ARPU
- D3 ARPU
- D7 ARPU
- D1 Retention
- D3 Retention
- D7 Retention
- Revenue
- Impressions
- eCPM
- ARPDAU
- ARPDEU
- Impressions per DAU
- Engagement rate
- Fill rate
注
If the traffic allocation for group B (test group) is less than 50%, the data will be adjusted to represent 50% of the traffic. For example, if group B receives 10% of the traffic, the estimated earnings will be multiplied by 9. This enables a fair comparison with group A, which receives 90% of the traffic. So, if group B earns $10, the adjusted earnings displayed on the A/B dashboard will be $90.
- Select View report to see granular monetization performance data per ad unit in your Performance Report.
- Select User Activity or Cohorts in the left navigation menu to view additional insights.
- Select Real Time Pivot to view your A/B test results in real time.
Adjust your traffic split during a test
To adjust your traffic split at any time, complete the following steps:- Go to to the A/B management page.
- Select the action button on a test.
- Select Adjust traffic split.
- Use the slider to adjust your traffic split to your new configuration.
End a test
Individual ad units
You can remove an ad unit from your test at any time without ending the entire AB test.注
Regardless of where you remove the ad unit, the winning group's settings will immediately apply to 100% of the traffic for the selected ad unit.
- Select the ad unit to remove from the test.
- Select the dropdown menu at the top of the page and select either group A or B.
- Select End test.
- Select either group A or B.
- Select End test.
End all ad unit tests
You can end an A/B test across all ad units.注
Regardless of where you end the test, the winning group's settings will immediately apply to 100% of the traffic on your app.
- Select the app with the active test.
- Select the action button.
- Select either group A or B.
- Select End test.
- On the Overview table, find the test to modify, and then select the button for either group A or B in the corresponding row.
- Select End test.