A/B Test: New UI – No news is good news

I’ve just wrapped up another A/B test on our new donation form.

In it we were testing a new UI (User Interface) treatment that Jordan developed for us this year.

As a team, we liked the new design and how it better connected with the design of the fundraising ask on the Firefox Snippet, but because even small tweaks to this form can have significant impact on our campaign we wanted to test it before making it the new default for all our users.

Old UI

Old UI

New UI

New UI

It’s always more fun when a test finds a big win that increases conversion rates, but in this case the most important thing to check was that the new form didn’t decrease conversion rates.

And it didn’t.

No statisitcally significant impact on conversion

No statistically significant impact on conversion

This allows us to clean up another bit of the code base, and makes the UI of our donation form a little more consistent from start to finish which is always good news.