Beaver Builder AB Split Test – Documentation

Getting Started

After purchasing the plugin, you will be able to download it from your Beaver Team account.

You'll also need your licence key which is available in your account, under your subscription.

lickey

Install the plugin.

Head to Settings > Beaver Builder > AB Test

Enter your licence key and hit save.

It will tell you if your licence is active or not.

licloc

Now... on to the fun stuff.

Step 1: Create an experiment.

You can skip the "Conversion Page" input.
  1. Give your experiment a name that is easy to remember.
  2. You can skip the "Conversion Page" for now.
  3. Hit "Publish"

Step 2: Create your experiment inside Beaver Builder.

e2
  1. Tag your row or module as an experiment variation.
  2. Look in the row or modules "Advanced" tab for the "Experiment" input. Search for, and select the experiment you just created.
  3. Give it a variation name.
e3
  1. Create your second variation. Tip: Duplicate the row or module that you just tagged as an experiment, then you only need to add a new variation name and make your changes.
  2. Look in the row or modules "Advanced" tab for the "Experiment" input.
  3. Search for, and select the experiment you just created.
  4. Give it a different variation name.

Step 3: Tag your conversion page.

e4
  1. On your conversion page, add the invisible "conversion" Module. It's located in the "Beaver Team" group.
e5
  1. Enter the experiment name you created earlier
  2. Done! Now just wait for the results to flow in.
  3. Experiments are only conducted on logged-out users. So if you want to test your AB test, an incognito window is the easiest way to go.

Step 4: View your results

e6
  1. Back in the WordPress admin, Under "Experiments" you can view the results of your test.
  2. NOTE: You will need to let your test run for a few weeks, or at least a few hundred views of each variation before you should make a decision which is the best. In future versions, you won't have to do anything and the plugin will make the decision for you.
  3. Click into the Experiment you created to see the ranked results.
e7
  1. Clicking into the experiment will show you your ranked results, with the best variations higher up the list.

How do I?

Know when a experiment is complete

To view your experiment results, go to Experiments > All Experiments > {Your Experiment} > Results

When you view a test result, it will tell you:

  • When you need more data (Screenshot below)
  • When you have enough data (Screenshot below)
  • The winner
    • The winner is declared when we are 95% sure of the winning variation. What does this mean?
    • As time goes on, confidence will increase.

 

A test with a winning variation.

 

A test that needs more data

Reset Experiment Data

If you make changes to your tests, you may want to reset the test.

To reset the experiment, go to Experiments > All Experiments > {Your Experiment} > Results > Clear Results

When you click the button, it will clear your experiment data, update the experiment time to now, then reload the page to show you the cleared experiment.

Can I create a single variation with 2 or more modules or rows?

Yes, Just give each module/row the same variation name, and they will be simultaneously shown/hidden based on the test.

How does Split testing affect my SEO?

We've written an article that covers how AB testing affects SEO. Check it out here.

Can I create a variation that is a row, and test it against a variation that is a module?

Yes, we don't restrict your test variations.

Can I move the conversion module to somewhere else in the builder menu?

Sure, add the below filters to your functions.php or similar

 

function bt_bb_ab_conversion_group( $group) {
  return ""; //return a blank string to be in the standard modules
}
add_filter( 'bt_bb_ab_conversion_group', 'bt_bb_ab_conversion_group');
function bt_bb_ab_conversion_category( $cat) {
  $cat= "Info"; // whatever category up you like
  return $cat;
}
add_filter( 'bt_bb_ab_conversion_category', 'bt_bb_ab_conversion_category');

Targeting

What is Targeting?

Targeting allows you to only test on a specific subset of your website visitors. This is handy if you have high traffic sites and don't want to risk showing badly performing variations.

This plugin has two targeting options (as of version 1.1.6), percentage or  URL query

Percentage of traffic targeting

Only subject part of your traffic to a test.

Example: Percentage set

The below example will match any visitor, then generate a random percentage. If the random percentage is less than your percentage, then the user will be subjected to the test.

Enter a value between 1-100

If left blank, we target 100 percent of traffic.

Targeting based on a percentage of incoming traffic

URL query targeting

You can target an experiment based on a URL query string. These are key-value pairs that appear inside URL path.

You can test on visitors that have the presence of a URL query key only, or a query with a key and value.

Leave the value blank, and all visitors will be targeted (depending on the percentage targeting you've set)

 

Example: URL query var with key only

The below example will match any URL that includes the URL query var "utm_source". The value does not matter.

Will match

https://www.beaver.team/?utm_source=bing

Will not match

https://www.beaver.team/?fbclickid=dfgsfdg

targeting query

 

Example: URL query var with key and value

The below example will match any URL that includes the URL query var "utm_source" with the value "facebook".

Will match

https://www.beaver.team/?utm_source=facebook

Will not match

https://www.beaver.team/?utm_source=bing

https://www.beaver.team/?fbclickid=dfgsfdg

targeting query value

How the targeting rules are applied

To maximize efficiency, targeting rules are applied in the following way:

  1. URL query targeting, then
  2. Percentage targeting

Example: URL query var with key and value and percentage targeting

The below example will match any URL that includes the URL query var "utm_source" with the value "facebook".

If there is a match, then the percentage targeting will be applied.

 

Will match 30% of the time

https://www.beaver.team/?utm_source=facebook

Will never match

https://www.beaver.team/?utm_source=bing

https://www.beaver.team/?fbclickid=dfgsfdg

targeting percentage and query

What are visitors that aren't targeted going to see?

If a user has been skipped by the test, these are the rules that show what the user will see.

We check for a special variation name that indicates its the original or default variation:

  • "original"
  • "default"
  • "standard"
  • "one'
  • "1"

If we don't find a version with any of these names, then we select the first variation in the DOM.

We do not log or measure interactions to users that have been skipped.

 

Example with no special variation names

no-test

 

Example with special variation name

special default name

Troubleshooting

I cannot activate (publish) a second experiment.

You will only be able to have one active test, for the following reasons.

  • You have our Starter licence - which is only valid for 1 active test at a time.
  • You haven't added your licence key yet - which enables you to create more tests, depending on your plan.

After you add your licence key, you will be able to publish more tests

My conversions are showing up twice.

Check you have not implemented two separate conversion events.

This could be something like:

  • Two conversion modules on the same page, for the same experiment.
  • Using the conversion page setting in your experiment along with a conversion module (in beaver builder)

I'm not seeing any views or conversions

We don't log views or conversions for logged out users. If you are logged in and creating an A/B test you want to try out. Try using an incognito window, or logout.

I've upgraded my licence, but I cannot access extra experiments.

After upgrading your licence, head to your Beaver Builder A/B test settings page and hit "Save". That will update your licence on your site and allow for additional tests.

Licencing

How do I remove a domain from my licence?

  1. Remove your licence key from your domains AB Test settings page WP Admin > Settings > Beaver Builder > AB Test
  2. Deactivate the plugin  WP Admin > Plugins > Installed Plugins
  3. Head to your Beaver Builder Account Area
  4. Open your subscription
  5. Double click on the domain you want to remove
  6. That's it!

 

Can I hide my licence key?

Sure, add the below filters to your functions.php or similar

add_filter('bb_bt_ab_licence_key',function($string){
  return 'your-licence-key';
});

If you want to hide the empty licence input box, you can add the following CSS to your admin.

.licence-key-input, .licence-key-heading{
display:none;
}