In most large organizations, tasks such as optimizing yield (revenue per page view), user retention or sign up rate, web server performance (speed), sales per page view, newsletter opens rate, and user experience are spread across several teams.
Each team does its own A/B or multivariate testing, but there is (in most cases) no centralization of these efforts, and no global predictive model associated with the A/B testing activities. To the contrary, small organizations can test multiple levers across the entire spectrum of levers, at the same time, and do a better job even without any use of a statistical model. Here's what we did, and the results:
- replace flash banner ads by animated gifs ==> significant user experience improvement for IE users (particularly for users with a brand new computer)
- remove the "visitor map" ==> increase sign up rate, as user is more comfortable about privacy
In the past, we increased the sales per page view ratio by 30%, and revenue per page view by 80%.