Comment by davedx
8 years ago
Indeed. When I was advocating for A/B testing at the last company I worked for, I tried hard to teach people that every test should have a sane hypothesis behind it based on some kind of usability theory. Not just “let’s try changing the header font color to red and see what happens!”
I worked for a company with an obsessed AB culture. Biggest hole I found. Clicks != satisfaction. Time spent on site also != satisfaction.
There’s something very powerful just talking to the user, feeling their pain and working with them to fix it until they say “this is awesome”.