Case Study

EFFECTIVE DATE: April 1, 2021

20
Microsoft Oce reduces time spent
on testing mobile apps testing time
before release from 5 days to 4 hours
1

21

21

21

About Microsoft Office App

MS Oce App is a one stop mobile app for the complete work suite including Word, Excel, PowerPoint and other Office products. With Micro-soft’s focus on cloud and mobile, Office app is a flagship product of Microsoft used by millions of enterprises and consumers every day for their professional as well as personal work.
2
22
“QA testing was our major roadblock in releasing features faster in the market and Sofy’s platform reduced the time spent on QA by 90%. It’s a fast, easy and very accurately automates our manual tests. The access to devices is easy and the dashboards give a comprehensive view of results. We were able to automate tests within days using their no-code platform and its seamless integration with CI/CD helped us test our builds daily. Sofy is a game changer.”

Sachin J

Engineering Manager for Oce, Microsoft Corp.

Problem

MS Office app is used by millions of users every day to work on their documents,
spreadsheets and presentations to get work done. With an ever-evolving market and the need to launch features faster, the team was facing a bottleneck with QA testing in speeding
up the release cycles for the mobile app. The team had manual testing in place and had tried out automation frameworks as well, but with the variance in number of devices and constantly changing frameworks, scripted automation was also not working out well. Thus,
the manual testers were burdened with running hundreds of exploratory and functional tests manually on tens of devices ever week for multiple builds leading to suffinecient testing and missing important issues as well as deadlines. The team had access to shared devices internally earlier but the availability was sporadic and since the testing was manual, collecting quantifiable data both quantitative and qualitative
was difficult to manage and analyze.






Solution

Since automation testing was not working out well, MS Office team chose Sofy to supercharge the manual testers in the mobile apps team with Sofy’s no-code testing automation platform, which allowed them to record manual tests once and replicate them across multiple builds, devices, languages on both android and iOS. The team took five days to setup hundreds of test cases, scenarios and datasets, ran the tests manually once each in landscape, portrait and converted those to automated runs on the platform.
The team was also able to access hundreds of devices on-demand from the cloud platform and was able to replicate real-world phone
simulation to track performance metrics- page, app load times, network, phone and battery usage and optimize the app accordingly. They were able to identify crashes which previously went undetected
in manual testing, as well as perform accessibility testing.

Result

Sofy helped reduce the testing cycle from 5 days to 4 hours, helped the team nd an average of 5 crashes previously not detected using manual tests. Once the test cases were setup, the tests ran automatically on all
the chosen devices in multiple languages every time a new build was released by the developers for QA.
Test Use Cases
400
22
Time to Automate Once
500k
22
Runs
3600
hours
22
Automation Scripts Saved
600Popular Apps powerd by Sofy


1 2 3
Sofy announces $7.75 million funding in seed round led by Voyager Capital and others. Read more