Adhoc Testing is the ability in Sofy to perform quick, unstructured testing of the app using real device. Here are some use case scenarios.
- A developer fixes a device–specific bug and wants to validate if issue has been fixed before committing the changes. He/she can acquire the specific device from the Device Lab from Sofy, upload the build from the local machine, and validate the functionality.
- A Tester gets a new build and wants to perform smoke test to validate basic functionality to ensure the build is good enough for exhaustive testing. Adhoc testing is a good way to perform such manual testing.
Here the are steps:
- Select the App (package)
- Acquire the Device (Device Lab.png)
3. Override with specific build test (if it is not the default one)
4. Perform Adhoc Testing
The question is often asked regarding the pros and cons of testing using real devices Vs Emulators and Simulators. Here are some of the considerations for testing with real device or virtual device.
|Real Devices||Virtual Device (Emulators and Simulators)|
|Testing with Real Devices better reflects the device performance characteristics. So, when performance and resource usage are important, testing with real devices is a better choice.
Also, when you want to test hardware characteristics (e.g. battery life), real devices is the only way to test them.
|Debugging the app easier using virtual devices so in early stages of development. Developers get a lot of debugging information when using virtual device.|
|Using Real Device is faster in terms of setup so a Tester can be productive testing with real devices.||Testing is slower because of the overhead of emulation and simulation.
|Real devices are expensive to acquire devices. With remote work, devices are not easily shared with coworkers. This is alleviated using cloud-based solutions like Sofy which provide access to 100s of real devices.
|Using virtual devices does not incur cost. This is a useful approach when you are not clear what devices your customer will be using. Also, when you have test with custom devices which are hard to procure or other expensive, virtual device choice is preferred.|
|Real devices are quite useful for Android app testing due to proliferation of device types.||Due to closed ecosystem nature of IOS, testers find IOS emulators adequate for testing.|