I must say, I don’t like this way of testing things.
New customers who have the new layout, won’t know any difference, and will use the app the way that works for them… because they have no choice.
I appreciate people don’t like change - Look at every social media design change that’s ever happened - It’s usually despised at the start (people don’t like change) and then they just get used to it.
Perhaps I’ve misunderstood how it works, or just don’t understand this way of doing things, but having feedback/usage stats from someone who knows no different is useless in my eyes.
Monzo have a chance to improve on their existing app, and the people who have been using it for the past 2 years are in a great position to guide that (like this thread has shown).
I think they were trying to see if it affected how people use the app/stick with Monzo. There were some graphs showing that activation of card and adding of money didn’t change and was roughly the same whether they were on the old layout or the new one.
It’s called A/B testing. It’s pretty standard practice for UI changes. Users who know they have a redesign will interact with the UI differently to those who don’t so it lets them get some real world testing in.
Yeah, I’m well aware of A/B testing (it’s commonly used by Monzo with lots of things) - The point was more that it would be wrong (in my opinion), to take usage stats from completely new users to shape the future of the app.
They might not be doing that of course, but with the recent Monzo Plus trials, the feedback seemed to be overwhelmingly “this isn’t worth it right now” etc etc - Certainly on the forums.
They either completely ignored that feedback, or were selective in what feedback to listen to, because they launched the exact same product a few weeks ago (and the same complaints were raised).
I don’t think a new user could provide worthwhile feedback on the app (on the whole), because they know no difference…
Also, does anyone have the new update, with an overdraft?
When I go to my personal account (I usually live in the Joint), and tap on “View All”, all I get is the “learn about overdrafts” button, which doesn’t do anything when tapped…
Usage stats and views for someone who has never known different could be very different to those from our small self-selective grouping here (not that any of us can agree!) and are likely to be more typical of the tens of thousands now joining
Maybe they are interested in how it is used by someone who is not comparing it with anything other than their previous bank
I think this is an intermittent bug! I had the same behaviour at times but then other times it brings up the usual overdraft on-boarding screen (as expected).
Oh, I definitely wouldn’t use us forum members as the benchmark I just hope the usage stats from the new users don’t turn out to be a step back for the majority.
I can see it now…
“New users aren’t using the summary… So we’ve removed it” - That’s the selective feedback I think would be best avoided (appreciate that specific example is unlikely to happen, but it was the easiest one I could think of).
Appreciate we are thinking along different lines here, but I feel this is what Monzo are doing too much of lately.
Rather than compare with other banking apps, they should want to do what they keep saying they want to do… change banking!
Just like they shouldn’t be comparing Monzo Plus with other packaged accounts, they shouldn’t compare usage with other banking apps (IMO).
Be brave, be different and genuinely make a change!
Good to know, I never check it, so have never seen the expected behaviour!
Have you watched the open office? Bruno does a really good job of explaining it, but essentially they’re not after typical feedback from a new user. They’re looking at trends and to validate / disprove some early fears they had over the redesign - so this is a data driven approach to see, compared with the bulk of ‘normal’ users (esp. a similar set of new users) whether this leads to a statistically significant difference in either good or bad outcomes. As was noted above, the initial data is showing there’s no real difference.
Having 10% of new users on the new UI could be a useful metric.
That way, Monzo can work out what percentage of the 10% do X, compared to the percentage of the 90% of the new users using the old UI.
So they can see if the new UI is better for new users overall, or if it is a step back. They don’t want to create a new UI that stops people signing up!
I just hope the usage stats from the new users don’t turn out to be a step back for the majority.
