A scoring framework for helping select the best A/B testing partner for YOU.

Think about how impactful it would be if employees from all levels of your organization – new hires to SVPs – were engaged and submitting test ideas. And, those employees cut across all departments. Your Optimization team will receive so many new, fresh test ideas that have never been thought of before. Also, many of these ideas will be directly tied to business objectives!

Simplicity and minimalization are directly tied to consumer psychology. A site experience that overwhelms a shopper is not good for business. Not only are the chances high that they will not purchase a product, there’s also a good chance that they tell others about their experience, because as we all know bad news travels much faster than good news.

Is Optimization a means to an end or an end in and of itself? Is it good enough to optimize your “null search results” page on your site simply for the sake of making it as functional as possible for your end user? Or are you doing it to improve conversions? Does the former automatically drive the latter? Does your senior leadership ask about conversion and revenue impact for every test and discard the test if there was none?

You’ve been tasked by your Executive Leadership Team to increase orders and average order value (AOV) over the next 12 months. You have a solid plan in place, as you’ve worked on it for months. Yet there’s something nagging at you, like there could be something important missing in your strategy and you’re not quite sure what is lacking?

If 25% of A/B tests run on the site result in a winner, what do we do with the other 75% of the tests that were run on the site that did not produce a winner? I like to call these tests INCONCLUSIVE AT THE PRIMARY METRIC LEVEL. I don’t like the term “losers” at all. Once you call a test a “loser,” your executive team stops listening. Trust me on this one, I see it happen all the time in meetings!

Let’s use the term Confidence Interval as a case study in how easily it is to use stories to effectively communicate difficult terms.

Hear from 33 Sticks Principal Architect, Jenn Kunz, and 33 Sticks Principal Optimization Strategist, Jason Boal, about how you and your organization should be thinking about MarTech server-side technology.

This article provides you with a framework that you can leverage to ensure you deliver value and ensure that your group has a great experience each and every time you are in front of them presenting the results of your hard work in building your optimization program.

You have put a tremendous amount of effort into compiling a prioritized list of test ideas for your Optimization roadmap. It’s taken months to build and includes data analysis, coordinating and facilitating ideation sessions across the organization, and ranking test ideas based upon potential impact. Now you are tasked with building out the Optimization roadmap on the calendar for the next several months and now you are to deliver your strategy to your VP……but, you’re not quite sure how to plan all of these test ideas into an integrated schedule on the calendar. Not to mention the complications that come with running overlapping tests on the same site pages. This is where Sample Size calculations come in handy.

Whether your optimization program is just starting and only one employee is involved or if your optimization program has been in place for years and spreads across multiple teams within your organization, it is vital that the program impact is being measured and communicated broadly.

Why you may ask? Well, there are a few important reasons…