Ever wondered what someone thinks of your plugin the first time they try it? The four of us at Wysija sure do.
Our users give us positive feedback on how “easy it is“. The adoption rate of our plugin tells a similar tale.
Over half of Wysija’s 175 000 downloads use the latest versions. This is the story told in this piechart on our page on the WordPress plugins’ repository:
But what about the unhappy people who dropped Wysija after 5 minutes? We’ll never hear from them. A tree fell in the forest, and we weren’t there to hear it.
The happy users themselves will forgive you for the small confusing details or non critical bugs. They’ll never mention them to you. You simply won’t know.
Don’t ask questions, let them do it
The idea to create user tests was largely inspired by the group working on WordPress’ user interface. The videos helped them make smart improvements.
2 things we need to know:
- how do users pick a plugin on the WordPress repository?
- what do users think in the first 5 minutes of using Wysija?
Take a look at one example:
The good, the bad, and the UI
The results reassured us, but we discovered a few surprising elements nevertheless.
What we observed as “bad”:
- There’s no single obvious call to action on the first page they see, the newsletters list. They’re not sure what to do.
- Nobody reads the guide in our default newsletter. Too long.
- The plugin’s messages in beige at the top of pages are ignored. Totally.
- The default newsletter’s browser version is blank. A new bug!
- 2 users didn’t realize they could click on the newsletter to edit it.
- Our name, Wysija. You can’t pronounce it. You can’t remember it. “If it sounds complicated, it’s probably complicated“, – Myself, Kim.
The positive points:
- the visual editor is appreciated by users of all ability.
- the widget is easy to configure.
- the settings aren’t as intimidating as we thought.
- these users are actually looking for a newsletter plugin for their own site.
- star rating is critical because it’s the only element of differentiation when searching for plugins on the repository.
We’re hungry for different information now. For example, we can’t answer these simple questions:
- on average, how many lists do our users have?
- on average, how many subscribers do our users have?
- how many newsletters a month do they send?
Our users will soon be able to share anonymous data with us, if they want. More data equals better plugin. Right?
* Siobhan is pronounced "Shé-von". That's more complicated than "Wysija".