This article covers the full lifecycle of an A/B test in Adapty: creating a test, running it, and stopping it when you are ready to review results.

Prerequisites

Before setting up an A/B test, you must have:

• At least two paywalls created (or onboardings for an onboarding A/B test)
• A placement configured in your app
• A decision on which A/B test type to use — see A/B test types

Create an A/B test

When creating a new A/B test, you need to include at least two paywalls or onboardings, depending on your test type.

To create a new A/B test:

1. Go to A/B tests from the Adapty main menu.

   

2. At the top right, click Create A/B test.

   

3. In the Create the A/B test window, enter a Test name. This is required. Choose a name that clearly describes what the test is about so you can identify it when reviewing results.

4. Fill in the Test goal to describe what you want to achieve (for example, increase subscriptions or reduce churn).

5. Click Select placement and choose a paywall placement for a regular A/B test or an onboarding placement for an onboarding A/B test.

6. Set up the test content in the Variants table. Each row is a variant, each column is a placement. Add a paywall at each intersection.

   By default, the table has 2 variants and 1 placement. You can add up to 20 variants and multiple placements. Once you add a second placement, the test becomes a Crossplacement A/B test.

   

   Key:

   1	Rename the variant to make it more descriptive.
   2	Change the weight of the variant. The total of all variants must equal 100%.
   3	Add more variants if needed.
   4	Add more placements if needed.
   5	Add paywalls or onboardings to display in the placements for every variant.

7. Save your test. You have two options:

   1. Save as draft: The test won’t go live right away. You can launch it later from either the placement or A/B test list. Use this to review the setup before launch.
   2. Run A/B test: Launches the test immediately. The test goes live as soon as you click this button.

Once saved as a draft, continue to Run an A/B test.

Edit an A/B test

You can only edit A/B tests that are saved as drafts. Once a test is live, it cannot be changed. To update a live test, use the Modify option — this creates a duplicate with the same name where you can make changes. Adapty stops the original test, and both the original and modified versions appear separately in your analytics.

Run an A/B test

Running an A/B test in Adapty means assigning it to a placement so it can start showing paywalls and onboardings to users.

1. Go to the A/B tests section from the Adapty main menu.

2. Make sure you’re viewing the correct list — Regular, Onboardings and Crossplacement A/B tests are shown in separate tabs that you can switch between.

   

3. Switch to the Drafts tab. Only draft tests can be started.

4. Next to the test you want to launch, click Run A/B test.

   

5. The Edit A/B test window opens. Review the setup and make any final changes. If the placement or audience is missing, add it now.

6. After you review the setup, click Run A/B test to start.

After launching the test, you can track its progress and view performance data on the A/B test results and metrics page.

Stop an A/B test

When you stop an A/B test, it ends and you can review the results. You also decide what to show users in the affected placements after the test concludes.

1. Open the A/B tests section and go to the Live tab.

2. Next to the test you want to stop, click the three-dot menu, then choose Stop A/B test.

3. In the Stop the A/B test window, decide what should happen after the test ends. You have three options:

   Option	Description
   Display one of the tested paywalls/onboardings	Choose the winning paywall or onboarding based on test results like revenue, probability to be best (P2BB), and revenue per 1K users. This paywall or onboarding will be shown for the selected placement and audience.
   Select paywalls/onboardings that don’t participate in A/B test	Choose any paywall or onboarding that isn’t part of the current A/B test. Use this when none of the tested variants met your goals.
   Don’t show any specific paywall/onboarding	For the selected placement and audience, no specific paywall or onboarding will be selected after the A/B test ends. Instead, the next available paywall or onboarding based on audience priority will be shown. This is a good choice if you’d rather let your existing setup decide which paywall or onboarding to display, without manually selecting one.

4. Click the Stop and complete this A/B test button.

Once the A/B test is finished, it will no longer be active, and the paywalls or onboardings from it will no longer be displayed to new users.

You can still access the A/B test results and metrics on the A/B test metrics page to review performance for users who participated while the test was running. Metrics may continue to update as new purchase or revenue events are attributed to those users.