Open Source Ab Testing Tools Image

Open Source Ab Testing Tools

A growing number of companies are using online experimentation to better understand how to grow their business. This is ostensibly a very simple, low cost and effective way to scientifically test a wide variety of website changes and content on your live website without damaging its performance. But if you’re a non-technical marketer/decision maker/client-side IT-support person then this can seem like a daunting task requiring complex skill sets and tools.

AB Tasty is a suite of open source software for web-based A/B testing. The software is written in PHP and JavaScript and is bundled together within a single package (ZIP file). The software allows you to create and launch A/B tests such as multivariate testing, to display a number of variations as a visitor arrives on your website, to alter content based on the results of an experiment. It has been tested on current versions of Apache, IIS, Nginx, Lighttpd, Cherokee, Amazon EC2 and Heroku servers using PHP 4 and 5.  AB Tasty’s test designers can create advanced experiments with copy, images and headlines that can be presented to your visitors randomly. Tests can also be designed to manipulate specific elements of your page e.g., change the price or availability of products and filter visitors into two groups depending on the results of a question or what they have clicked on.


Nelio offers A/B testing facility for all WordPress-based websites. It is open-source A/B testing software that is easy-to-install and activates to your system to create, delete, and monitor your website’s progress and other related experiments.

(Source: Nelio)


  • Nelio is not just a WordPress plugin, but also offers a conversion optimization service.
  • The software allows you to test the alternative versions of WooCommerce projects.
  • It helps you to create catchy headlines that can achieve the highest click-through rates.
  • The Nelio software offers testing new layouts, new designs, and tweaking finer details using CSS experiments to redesign their website.

 Split Hero

Split Hero

Splithero is A/B testing tool design for WordPress. It helps agencies and clients to find out the responses of a targeted audience. This tool helps you to split test your web pages to gain meaningful and important data.


  • It enables you to create four various variants of the web page.
  • This tool collects important data and helps you to take action on the results of the campaign.
  • You can connect your website by downloading a plugin or entering the API (Application Program Interface) key.
  • It provides User experience (UX) that helps you to deliver an effective split test campaign.


Open Source Ab Testing Tools Image

Conductrics is my favorite experimentation platform. I like the CEO, Matt Gershoff, and he’s been an excellent industry mentor and friend to me. He is also one of the most thoughtful leaders in the analytics and optimization space, so you can trust the direction of the platform.

He has also built a really great piece of software that, in many ways, was far ahead of its time and definitely ahead of most of the others on the list.

Power/feature-wise, it’s the best you can get. You can run A/B tests (client or server side), multivariate experiments, and bandit tests, all from a WYSIWYG visual editor (if you want). You don’t need to install a script until you set things live, as you can use the browser extension to edit and preview variants.

Additionally, the tool lets you run predictive targeting to exploit different segments of your audience. Basically their AI/machine learning will discover which combinations of visitor traits respond best to each of your content variants, automatically.

Definitely a tool for true optimizers.


Appium – an open-source test automation framework for native, hybrid, and mobile web apps. It drives the Android, iOS, and Windows apps using WebDriver protocol. It is a cross-platform testing tool that enables code reuse between Android, iOS, and Windows test suites using the same API.

(Source: Appium)


  • The Appium software supports multiple programming languages like Java, PHP, Ruby, Python, C#, etc.
  • The software uses UIAutomator tool that is used to inspect the mobile elements on the mobile interface.
  • Dynamic device reflection offers an easy-to-use visual interface for easy Appium testing.
  • The Object Spy tool helps in creating new tests and editing recorded tests.


Open Source Ab Testing Tools Image

Optimizely is the biggest brand names on the list, and I have to say, I’ve always loved using the platform. It made javascript, client-side A/B testing world popular. It’s what I learned on, so I’m definitely most comfortable in this interface, even to this day.

Feature-wise, they’ve really improved in the last few years, especially in their enterprise offering. They’ve now got ‘full-stack’ experimentation capabilities, valuable for those who want to run server-side experiments or run tests on IoT, TV, or mobile apps. The also offer unlimited free feature flags and rollouts.

Overall, it’s a robust and powerful enterprise solution that even features a fully fleshed out program management platform (though unfortunately the company doesn’t really maintain support for smaller companies nowadays – it’s really only at tool for large brands).

Their stats engine is based on sequential testing, which is often more efficient, but I do love a bit more flexibility in terms of statistical analysis.

Optimizely is probably in that tier of software where, like IBM, ‘you won’t get fired for buying Optimizely.’


Cucumber is a combination of open-source and commercial test tools, with over 30 million downloads all across the world. It is also ranked as the number #1 tool for Behavior-Driven Development.

(Source: Cucumber)


  • Cucumber is available for multiplatform programming languages including Node.js, Java, C++, Ruby on Rails, Python, and so on.
  • Cucumber software can work well with third-party API automation tools to make your tests faster and less flaky.
  • Stable version ‎3.1.2 of the software was released on July 13, 2018, and is licensed as per MIT licensing.
  • Reporter plugins are available to produce reports informing what scenarios are passed or failed.


Open Source Ab Testing Tools Image

If you want almost all of the features of Optimizely (with the addition of truly wonderful customer support and a free CXL Institute membership), but at a fraction of the price, Convert is the way to go.

For starters, the interface will feel familiar and intuitive to experienced experimenters. For newbies, too, it’s not a cumbersome tool to learn. It’s got a great WYSIWYG editor, and of course all of the typical HTML, CSS, & Javascript editing tools that serious optimizers use in the testing process.

Convert has all the typical functionality you’d expect from a client-side A/B testing tool: A/B tests, split page tests, multivariate, and personalization.

What I like most about Convert is the founder and the team clearly truly care about the industry and their customers. They’re much more transparent about their features and the market, and I find the lack of marketing spin quite refreshing (see: their feature comparisons).

Plus they offer a free 15 day trial, so you’ve got nothing to lose from checking it out and seeing if you like it. I’d recommend those currently only looking at Optimizely or Adobe to take a look and see if might meet your needs as well.


Open source tools that connect the dots between you and your potential customers. These platforms will increase your website’s traffic & revenue by creating a seamless connection between the end user and the right ad.

Similar Posts


No Comment.