Request info

Mobile Application Testing Pitfalls to Avoid

 

And there also environment concerns. Different screen resolutions, OSes, and possible network limitations all top the list for common issues with mobile testing.

How do testers handle all of that while advocating for the user? From the esoteric to the oops-should’ve-thought-of-that, here’s a round-up of every major mobile app testing fail.

Saving testing for the end

Developing purely agile or purely waterfall is a bit of hoax. The vast majority of teams operate in some sort of hybrid mode. But even when testing is supposed to be built in, it’s easy to fall prey to the temptation of leaving it until the end (especially for small projects).

Mobile apps are typically expected to release very quickly, so there’s no time to save the process until the end. When that happens, it’s too late to make high-level changes that users might really appreciate.

Not paying enough attention to the state of the device

Even though teams know in theory how important mobile device states are to a performance of an app, they still might ignore this type of testing, or not delve deeply enough.

Users enter new device states every day, so not paying attention to them isn’t an option.

Here are some of the things to test for:

  • Location services on/off
  • Battery level
  • Interactions with background apps
  • Permissions and settings for notifications
  • Screen brightness
  • Incoming calls and texts
  • Actions of any physical buttons on devices

 

JasonArbonQuote.jpg

 

Wasting resources by purchasing a variety of devices

While a testing lab full of dozens of different devices sounds super fun, it’s likely a waste of funds. Devices change all the time, and you need not only access to different devices, but to the networks they function on in other countries.

You’ll still want to test with whatever you have access to in-house, but when it comes to going “all out” for device coverage, find another way than purchasing devices whose relevance won’t last.

 

Hanging on to a traditional, function-driven test mentality

The “it does what it’s supposed to do” mentality works for lots of types of testing, like ERP and EAI products. But for mobile? Not really.

Testers really need to adopt that user-advocate mindset. Never before have testers been required to be so creative and so user-focused. Mobile users are pickier and more critical because devices are personal. They’re an extension of our natural capabilities and we need them to do what we want, how we want, and when we want every single day.

From an organizational stand-point, keeping everyone involved, whether employees or contractors, mindful of user expectations is how you build a brand and a product that disrupts the market. You empower everyone on the team to be customer-focused.

ReggStruykQuote.jpg

 

Relying on users to be testers

For development teams with a small testing budget and no access to testers, it’s tempting to proof the app yourself and allow users to be your initial testers.

Not only do you need a second eye for UX concerns and device concerns, but you also don’t want to risk the time it takes to implement the fixes. Reviews are not bug submittals. Imagine the horror! Your app is approved by the store, it goes live, and you get a few positive reviews, with also some frustrated bug finds.

You can’t erase that review and just make it go away. You also can’t fix it quickly. Even if you upload your fix within a day, you don’t control when that fix gets deployed to users, and you can’t rush the process with the app store.

 The only thing worse than saving testing until the end is not testing at all.

 

Focusing on localization without globalization efforts

A typical development process is to design an app in the native or primary language and then translate, having testers check that the translations are in the right place.

 

mobileapplicationtestingmistakes.jpg

Releasing mobile app updates without customer transition testing

Is an old feature missing? If so, this should be explained during the release of the new version either in the app store info, within pop up explainer messages inside the app, on the company blog—or all three.

Is customer data suddenly missing after the upgrade? That could be an error!

Ok testers, over to you! What else do you do (or not do) when testing mobile apps?