24 Best A/B Testing Tools in 2024 (Reviewed by CRO Experts)

Reading Time: 12 minutes

So, you’ve decided to use an A/B testing tool to optimise your website – how do you know which one is best for you? Our CRO Experts reviewed 24 of the most popular A/B testing tools to help you pick the best one for your business.

There are now 24 major A/B testing tools on the market (not to mention those that offer testing as part of a wider service). We took the market leaders, including Optimizely, VWO, and Google Optimize, and ranked them according to features, usability and price.

UPDATE August 2021: We have removed ClickThroo and Unbounce form the list, since these are Landing Page Builders with A/B Testing feature, not A/B Testing tools to test any website. We have added Evolv.ai and InspectLet that now offers A/B Testing.

UPDATE September 2021: Glassbox has acquired Convertize A/B testing platform, meaning that plans and prices are expected to change as Glassbox integrate the A/B testing tool to their suite.

Four years ago, the market for A/B testing tools was divided between two options: Optimizely and VWO. Since then, the number of options has grown. AB Tasty arrived, with a set of advanced features. In 2017, Google launched Optimize and Optimize 360. Now, there are more than 24 A/B Testing tools on the market.

Some options, such as VWO, offer features like heat-maps, questionnaires and session recording. Others have simplified their software and made it easier to use. Our list takes all these factors into account.

A/B Testing Features

Price is usually the first thing people ask about when choosing a new tool. The second is how easy it is to use. But there are other factors to consider. Our Comparison Table of A/B Testing Tools lists a series of ‘Must-have’ features, ‘Luxury’ features and technical specifications.

A/B Testing Tools “Must-have” features

• A/B/n Testing -In an A/B test, your visitor sees version A or version B of a particular page. A test with three page versions might be called an A/B/C test. “A/B/n” is used as shorthand for a test that has “n” different versions. 
• Visual Editor – Some of the A/B testing tools have in-built platforms for creating and editing webpages — a bit like having their own WordPress interface. They can be useful (particularly if the thought of working with your company’s IT team gives you the shudders)

A/B Testing Tools “Luxury” features

• Dynamic Traffic Allocation (Multi-Armed Bandit) – This allows your Autopilot to finish the test as quickly as possible whilst sending traffic to the highest-converting page. The “Multi-Armed Bandit” is an algorithm that directs traffic to better-performing pages. Some A/B testing tools allocate traffic evenly between variation A and B. This could mean directing half of a website’s traffic to a bad version (which can cost large companies vast amounts of money). A Multi-Armed Bandit stops that happening. 
• Library of A/B Testing Ideas – Everyone has experienced a mind-blank at some point. A library of ideas helps to break the ice
• Multivariate Testing (MVT) -“Multivariate” or “Multivariable” (MVT) tests are simply ones in which you carry out A/B tests (or A/B/n ones) on several independent page elements simultaneously. There are different ways of carrying out multivariate (MVT) tests. You can show every single possible combination of page elements (“full factorial”) or only a fraction of them. The various kinds of “fractional factorial” test often have complicated-sounding names (for example, “Taguchi”). You can also choose to display losing combinations less frequently. 

Technical Specifications

• Client-side – A/B testing tools work by telling internet browsers how to display a page. This is done by ‘tagging’ the page with several lines of Javascript. When the page is loaded, the Javascript contacts a back-office system which then tells the browser which content to show. This back-office system also keeps score of conversions.
• Server Side -“Server-side” A/B testing tools run on the page’s server. The page is compiled by the server, and is presented to the browser in its finished form. In the same way that some PC software is only available for Windows or for Macs, some server-side software is only available for particular servers (such as PHP). 

The tool you choose should reflect the size of your business, your previous experience with A/B testing tools and your resources. If you need help deciding what kind of tool you need, we have created a set of questions to help you find the best A/B testing software.

The 24 Best A/B Testing Tools in 2024

Here is our list of the best A/B Testing tools for web agencies, marketers and e-commerce. For each one, we have built a table of prices and features. The tables show if the tool includes A/B/N testing, MVT, page editing and features like autopilot. 

To compare all of them at once, scroll down to our comparison table or click here: A/B testing tools comparison table

1. Glassbox (Convertize)

Glassbox (Israel) has recently acquired the Convertize A/B testing platform. The software allows any marketer to test their ideas, without the need for a webmaster. The most complex parts of a test, like how to distribute your traffic, have been automated. 

The pricing scale is based on traffic and all plans include all features.

Please note that current plans and prices are expected to change as Glassbox will integrate the tool to their suite.

	20,000 monthly visitors	100,000 monthly visitors	500,000 monthly visitors	1,000,000monthly visitors
Cost/month	$49/month	$199/month	$329/month	$499/month

Starting from just $49 for 20,000 a month (the minimum required for statistically significant results), the tool allows users to test up to 1,000,000 visitors for $499 a month.

Setup & Subscription	$49/month
How Pages are Loaded	Client-side script with "Lightning Mode"
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	No
Autopilot Mode or Multi-Armed Bandit	Yes: Autopilot with Hybrid Statistics
Page Editing	SmartEditor
Tactic Library	Yes: Neuromarketing Tactics

2. Optimizely

Optimizely (USA) is an executive solution that offers A/B testing and customisation options. This is the oldest and best known platform. It is also the most expensive at well over $1000/month.

Setup and Subscription	Around $1000 (Available on Request)
How Pages are Loaded	Client Side or Server Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	Multi-Armed Bandit
Page Editing	WYSIWYG Editor
Tactics Library	Yes: Optiverse

3. Google Optimize

Google Optimize (USA) is Google’s A/B testing tool. It connects to Google Analytics (which is required to use the software). Google Optimize requires a Chrome extension, whilst Optimize 360 ​​provides a paid-for service that can test up to 10 variations of a page. Ergonomics and limitations make the A/B Testing tool difficult to use but it remains a popular option.

Setup and Subscription	Free
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes, in Beta
Autopilot or Multi-Armed Bandit	Non
Page Editing	WYSIWYG Editor
Tactics Library	No

4. VWO

VWO or Visual Website Optimizer (India) is another popular A/B testing tool with a focus on graphics and design. While VWO used to offer plans starting at $199/month, it’s not the case anymore. VWO has gone entreprise and you must contact sales to get custom pricing. 

The pricing scale for VWO is based on both features and traffic.On their last public pricing update in Jan 2019, the most basic plan was priced at $368/month for 50,000 visitors per month.

	Testing Growth	Testing Pro	Testing Enterprise
Price per month (monthly plan)	Gated price	Gated price	Gated price
Annual Price	Gated price	Gated price	Gated price

Setup and Subscription	Gated price (at least $4,000 per year)
How Pages are Loaded	Client-Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	Yes: Idea Factory

5. AB Tasty

AB Tasty (France) is a well-known platform on the French market. It offers a good range of user insight and personalisation features. This A/B testing tool is designed with enterprise marketers in mind. Prices are no longer displayed on the site, indicating a switch in focus towards executive customers.

 

 

Setup and Subscription	$1000 Setup (min.) and $200/month
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot or Multi-Armed Bandit	Multi-Armed Bandit
Page Editing	WYSIWYG Editor
Tactics Library	No

6. Convert

Convert (USA) is one of the A/B Testing tools recommended by ConversionXL founder Peep Laja. The tool positions itself as the alternative to Optimizely, and is similarly high-powered. The pricing policy is now business-oriented, with the first plan costing over $599/month (paid annually).

Convert charges based on both traffic and features. Because of this, the precise cost for each feature is difficult to estimate. 

	10,000 monthly visitors	>10,000	700,000 monthly visitors	1,300,000 monthly visitors
Essential	$599/month	Contact sales	Contact sales	Not available
Pro	Not available	Not available	$799/month	$1699/month

One of the most important differences between the Essential and Pro plans is that the Pro plan includes “DMP profiling”. This feature is an automatic audience profiling system that helps you to segment your visitors.

Setup and Subscription	$599/month
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

7. Kameleoon

Kameleoon (France) is an A/B testing tool designed for mid-sized and enterprise companies. It scales to also include server-side A/B/n testing, feature flagging, and AI personalization. Ecommerce brands value its integrations, including with Shopify Plus. HIPAA and GLBA compliant, Kameleoon is also a popular choice for healthcare and financial services.

The price of the annual license depends on your average monthly unique users/visitors over the last year.  Expect to pay at least $500/month.

Setup and Subscription	Available on request
How Pages are Loaded	Client Side (install SDK for server-side testing)
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot or Multi-Armed Bandit	Multi-Armed Bandit
Page Editing	WYSIWYG Editor
Tactics Library	No

8. Omniconvert

Omniconvert (Romania) targets small and medium enterprises. The A/B testing tool offers local segmentation and personalisation features, and the platform has consistently offered exceptional value for its range of features. The free plan (which allows testing on up to 5000 views) does not provide a plausible alternative to paid software, as it would be almost impossible to achieve significant results with this volume. 

Setup and Subscription	$324/month
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

9. Accenture Omnichannel Testing Platform

The Accenture Testing Platform, launched in 2016, is a suite of digital testing systems which includes an A/B testing feature. Because of this, it is by far the most expensive option on our list. Installation and set-up alone costs over $25000. However, the service provided is comprehensive, and goes well beyond page testing. For those willing to spend the money, the platform provides AI, security and performance testing as well as user-engagement.

A/B Testing Tool Features
Setup and Subscription	Over $25,000
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

10. Adobe Target

Adobe Target (USA) is Adobe’s A/B testing tool. This is an executive service used, for example, by HSBC. The price plan easily exceeds $10,000/month. However, for those who can justify such a heavy outlay, the tool provides large-scale high-powered testing. 

Setup and Subscription	Setup Fee and $1000/month (min)
How Pages are Loaded	Server Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	Multi-Armed Bandit
Page Editing	WYSIWYG Editor
Tactics Library	No

11. Bound

Bound 360 is a user-friendly mid-range platform. For the price, it is disappointing that the platform does not offer multivariate testing.

A/B Testing Tool Features
Setup and Subscription	Contact sales
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	No
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

12. Conductrics

Conductrics is built around the concept of “versions”. The platform delivers both personalisation and A/B testing, giving you full control over who sees what on your website. There is a user-friendly page builder for marketers who don’t have coding experience (“Conductrics Express”) and there is also an API solution for developers.

A/B Testing Tool Features
Setup and Subscription	On request
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	Yes
Page Editing	WYSIWYG Editor
Tactics Library	No

13. Evolv.ai

Evolv AI is an A/B Testing tool that utilize AI and Evolutionary algorithms to speed up multivariate testing. This high-level value proposition is aimed at Entreprise customers.

A/B Testing Tool Features
Setup and Subscription	On request
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	Yes
Page Editing	WYSIWYG Editor
Tactics Library	No

14. Freshmarketer

FreshMarketer (‘Zarget’) (India & USA) Freshworks bought Zarget in 2017 and renamed it Freshmarketer. The A/B testing platform is now part of a bewildering array of marketing tools offered by Freshworks. Despite this, the A/B testing tool comes as part of a generous Conversion Rate Optimization package which includes heat-mapping, personalisation, and page-editing features. The free option is gone and you now need to take the Conversion Rate Optimization Add-on starting from £165 for 10’000 visitors.

Setup and Subscription	£165/month
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	Yes
Tactics Library	No

15. HiConversion

HiConversion is based around a “Mobile Optimization Community”. The principle is that each member of the community shares the insights from their tests to help build shared optimization templates. This is complemented by full MVT capabilities and live-data optimization. Prices are only available on request, but this is known to be a high-cost option.

A/B Testing Tool Features
Setup and Subscription	On Request
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes "Ensemble Testing"
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

16. InspectLet

InspectLet (USA) started as a session recording and heatmaps tool, they later added A/B Testing to their software suite.  Features are pretty limited but enough to run straightforward A/B Tests. They offer a Free plan.

Setup and Subscription	Free, then $39/month
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	No
Autopilot or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

17. Kibo (Monetate)

Monetate is joining with the personalisation software group Kibo to provide a new hybrid service. The platform is based around the principle of optimizing customer experiences and involves testing, personalisation and segmentation.

A/B Testing Tool Features
Setup and Subscription	On Request (based on traffic)
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes "Ensemble Testing"
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

18. OpenText Optimost

OpenText OptiMost is a versatile platform that includes customer experience management and marketing. However, it is certainly more appropriate for larger businesses than small or medium enterprises, with the monthly cost typically over four figures.

A/B Testing Tool Features
Setup and Subscription	On Request
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

19. Oracle Maxymiser

Maxymiser is another enterprise option with powerful testing capabilities. Where other tools create a package including consulting services, Oracle Maxymiser is a self-service tool. To make full use of the APIs and tracking features, you will need some technical expertise. This is a solution built for data-driven marketing departments with in-house IT support.

A/B Testing Tool Features
Setup and Subscription	On Request
How Pages are Loaded	Client Side/Server Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes "Ensemble Testing"
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

20. Simplify (SiteGainer)

Simplify (SiteGainer) purchased SiteGainer in 2018 to integrate the A/B testing to its conversion optimization platform. Pricing has been removed and the business model seems to have gone Entreprise.

A/B Testing Tool Features
Setup and Subscription	On Request (based on traffic)
How Pages are Loaded	Client Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes (new)
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

21. SiteSpect

SiteSpect is a feature-rich solution designed for large, high-volume websites. Each of the packages includes a ROI analysis by a SiteSpect expert and training for your marketing team. SiteSpect describes itself as the “Fastest Optimisation Platform,” which is important for websites that focus on high-impact graphics and user experiences.

A/B Testing Tool Features
Setup and Subscription	On Request
How Pages are Loaded	Depends on Package
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes (new)
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor (not for server-side package)
Tactics Library	No

22. SiteTuners

SiteTuners are a CRO agency focused on partnerships and consulting. The tool they offer is priced according to the number of tests you run. Whilst the support provided is generous, this is not a particularly flexible option. It would suit a medium-sized company without its own CRO department.

A/B Testing Tool Features
Setup and Subscription	Charged per test
How Pages are Loaded	Client side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

23. Webtrends Optimize

Webtrends Optimize supports both A/B/n and multivariate testing across each of your marketing channels. The platform can be used as part of a self-service or “managed” software package, or as a hybrid of the two, so you can choose exactly how much support your team needs. The platform includes a range of additional features that are useful for a multi-channel strategy, such as email capture popups, re-marketing automation, Social Proof features and form optimisation.

A/B Testing Tool Features
Setup and Subscription	On request
How Pages are Loaded	Client Side or Server Side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	Yes
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

24. Zoho Pagesense

This tool from Zoho is an affordable and user-friendly way to perform website analytics. It supports all major integrations and offers a wide range of features. Although the platform does not support multivariate tests, it is a fantastic option for small and medium businesses who do not have the traffic required for those sorts of tests.

A/B Testing Tool Features
Setup and Subscription	$18-435/month
How Pages are Loaded	Client side
A/B/n Testing & Split Testing	Yes
Multivariate Testing (MVT)	No
Autopilot Mode or Multi-Armed Bandit	No
Page Editing	WYSIWYG Editor
Tactics Library	No

Comparison of the 24 Best A/B Testing Tools in 2024

	SETUP + Fees	TECHNOLOGY COMPATIBILITY	A/B/n TESTING & SPLIT TESTING	MULTI-VARIABLE TESTING (MVT)	AUTOPILOT MODE	PAGE EDITING	A/B TESTING IDEAS
Glassbox (Convertize)	0 + 49/month	Client Side with Lightning Mode			Autopilot with Hybrid Algorithm	SmartEditor	Neuromarketing Tactics
AB Tasty	Contact sales	Client Side				Editor WYSIWYG
Accenture Testing Platform	>25,500 + >10,000/month	Client Side				Editor WYSIWYG
Adobe Target	Contact sales	Client Side				Editor WYSIWYG
Bound	Contact sales	Client Side				Editor WYSIWYG
Conductrics	Contact sales	Client Side				Editor WYSIWYG
Convert	0 + 599/month	Client Side				Editor WYSIWYG
Evolv	0 + 95/month	Client Side				Editor WYSIWYG
FreshMarketer (Zarget)	£165/month	Client Side
Google Optimize 360	Contact sales	Client Side				Editor WYSIWYG
HiConversion	Contact sales	Client Side				Editor WYSIWYG
InspectLet	0 + 39/month	Server Side				Editor WYSIWYG
Kameleoon	Contact sales	Client/Server Side				Editor WYSIWYG
Kibo (Monetate)	Contact sales	Client/Server Side				Editor WYSIWYG
Omniconvert	$324/month	Client Side				Editor WYSIWYG
OpenText Optimost	Contact sales	Client Side				Editor WYSIWYG
Optimizely	Contact sales	Client Side				Editor WYSIWYG	Optiverse
Oracle Maxymiser	Contact sales	Client Side				Editor WYSIWYG
Symplify (SiteGainer)	Contact sales	Client Side		With the Executive Plan
SiteSpect	Contact sales	Proxy Server Method				Editor WYSIWYG
SiteTuners	$/test (contact sales)	Client Side				Editor WYSIWYG
VWO	Contact sales	Client Side				Editor WYSIWYG	IdeaFactory
Webtrends	Contact sales	Client/Server Side				Editor WYSIWYG
Zoho Pagesense	0 + $18/month	Client Side				Editor WYSIWYG

The top 10 tools on our list perform well in our comparison table. In particular, Optimizely, VWO and Convert provide robust tried-and-tested ways to test enterprise-level websites. However, with a couple of exceptions, they tend to be much more expensive than the challengers.

There are also some really good options among tools that are not known as A/B testing platforms. In particular, Zoho Pagesense have incorporated A/B testing features to create excellent all-round products.

Here are our recommendations for choosing an A/B testing tool in 2024:

• The best solutions for large businesses: 1. Adobe Target 2. Optimizely 3. Google Optimize 360 (the integrations alone make this a great option)
• The Best A/B testing tools for marketing teams: 1. Convertize 2. VWO  3. Optimizely (if you have the budget)
• The Best A/B testing tools for small and medium-sized business: 1. Convertize 2. Zoho Pagesense 3. InspectLet

However, the A/B testing software market is in a healthy place, with solutions for every size and type of business. Most of the options in our list include a free trial (some as long as 60 days), so there is no reason not to try them for yourself.

Want to learn more about A/B Testing Tools and Conversion Optimization?

Before you sign up for a subscription, it is important to be clear about the needs and resources of your business. An A/B testing tool costs money both directly and through the man-hours it takes up. The best way to ensure you run successful A/B tests is to bookmark the Convertize A/B Testing Guide 2024.

This free guide combines an introduction to A/B testing, a step-by-step guide to conducting tests and a significance calculator. By following it section-by-section, you can calculate your sample size, run tests to statistical significance and avoid some of the most common A/B testing mistakes.

If you have any feedback or insight into the A/B testing tools in our list, please consider giving our other readers the benefit of your experience. Leave your thoughts in the comments section and we will make sure they are reflected in our recommendations.