Mobile Automation testing challenges

Here is the list of main challenges.

  1. Biometrics automation is not possible on real devices
  2. You can not automate document scanning scenario. You will have to use stubs on emulators
  3. Setting up the appium environment on new machine is a nightmare as it needs multiple tools like java, android sdk, UiAutomator, XCUITest, xcode, simulators, carthage, node etc and versions of all these tools needs to be compatible with each other.
  4. Running tests on emulators is painful as it runs very slowly especially launching the emulator is very time consuming.
  5. Integration of appium tests in cloud like Azure, AWS is very challenging as we need to write the script to install all tools automatically and also execution is very slow in cloud
  6. New versions of Xamarin forms (4.0) are not supported by Appium 1.15.1 so We need to ask developers to modify the app in such a way that Appium can identify the elements
  7. Touch actions like swiping, long tapping differ based on resolution of the emulator so writing compatible tests for all emulators is challenging
  8. Sometimes Android emulator and apps may crash which makes tests very shaky
  9. Noted that webdriverwait does not work in iPhone simulator but works in Android emulator so need to use different wait mechanism for iPhone simulators
  10. Sometimes the app provided by developer does not work on the simulators but it works on devloper machine due to version issues of xcode, build configurations etc. This may result in strained relationship with devlopers.
  11. Mostly automation testers come from Windows OS background but automating the iOS apps needs knowledge of MAC OS. So training may be required to learn MAC OS and iOS
  12. Some technical challenges may arise depending upon the app. e.g. XCUItest was not able to select value from the dropdown in one of the iOS app.
  13. Many platforms - Android, iOS, Windows, Firefox OS
  14. Many versions of Same platform - e.g. In iOS, possible versions can be 11, 12, 13 etc
  15. Many device types - Tablets, Phablets, Phones, iPads
  16. Device orientation - Portrait and landscape Orientation can cause issues in testing.
  17. App types - native, hybrid, web
  18. If web debugging is disabled in the Android app settings, Appium will not be able to switch the context to web view. In this case, you need to ask developer to create the different build with web debugging enabled.
  19. Multiple automation technologies - XCUiTest, Espresso, UiAutomator, Selendroid
  20. Multiple tools - Appium, Ranorex, Robotium, MonkeyRunner, UFT Pro or LeanFT
  21. Multiple cloud based testing providers - Browserstack, saucelabs, experitest, applitools, AWS device farms
  22. Multiple languages - Java, Python, JavaScript, C#.Net, PHP, Ruby

Youtube | Facebook | Twitter | Website Home | Online Grocery Shopping Brisbane