Provided services
Test Automation Services, Project Management, CI/CD Implementation & Modernization. DevOps Services, Software Reengineering, Refactoring and Modernization. Cloud Migration, Software Maintenance and Support Services
Client
Our client specializes in location-based marketing for the gaming industry, using geofencing technology, which kicks into action when a customer’s mobile device steps into or out of a designated zone. Their app reels in potential customers who are just within reach, increasing businesses’ visibility.
Challenge
In the midst of their rapid growth, the client was rolling out both web and mobile versions of their product along with juggling a ton of customized implementations for different companies. No wonder that as the functionality of both the web and mobile platforms kept expanding, they ended up with multiple versions of their applications.
Additionally, what got lost in the mix, was the complexity involved in customizing functionalities to address the diverse needs of their customer segments. This ramped up the complexity of their codebase, demanding to balance between innovations and the system’s robustness.
The client’s existing approach to platform testing fell short, leading to several critical software issues:
- Unstable and inefficient development: Adding new functionalities and multiple platform versions, though essential for growth, bogged down the in-house development resources. Decreased stability and extended time-to-market for new releases, made it challenging to keep up a consistent flow of new software builds.
- Poor software quality: The growing volume and complexity of the codebase, opened up a significant performance gap in the quality assurance and deployment process. The existing testing methodologies could not keep pace with the development cycles, causing delays and potential quality issues.
Recognizing the need for a reliable testing solution, the client was looking for an experienced test automation partner to come up with and implement a comprehensive test management strategy. Their goal was to lighten the load on in-house resources and avoid the investment in their own testing infrastructure, allowing them to focus more on development. It was our proven expertise in QA and testing and battle-tested professionals that tipped the scale in our favor.
Project context
- Codebase oversight: With the codebase snowballing, we had to come up with a comprehensive and resilient testing ecosystem that could effortlessly handle complexity issues. Reusable test components and smarter test automation became the backbone of this process.
- Parallel testing: To speed up testing cycles, sync up with development cycles, and trim down time-to-market, it was crucial to carry out tests in parallel within a single run. That way, our client would be able to excel at hitting aggressive release schedules.
- Test management: We had to draw up a holistic and dependable test strategy that covered in-depth reporting, analytics, and flawlessly tied into existing development workflows, so that we could keep track of the testing status and understand its impact on release decisions.
Project scope
JazzTeam joined the client’s team to step up their automated testing processes and tackle concerns about software quality and delivery speed. Here are the key objectives included in the project scope:
Expand test coverage: Ramp up the number of automated tests to improve software quality and cut down post-launch bug risks.
Facilitate web testing: Put together and roll out a comprehensive suite of automated tests to cover web application functionality.
Enhance test performance: Bring in tools and approaches to speed up the performance of automated tests and shorten execution time, dealing with challenges of rapid development cycles.
Streamline integration: JazzTeam offered and gained approval to set up a system to automate the build and testing process, addressing the limitations of isolated testing and heading off the turmoil caused by fragmented testing practices.
Solution
To address the client’s critical need for at-scale software testing, JazzTeam designed and implemented a dependable test automation framework for web and mobile applications from scratch. The implementation was complicated by the fact that we had to create a large number of diverse test scenarios to ensure comprehensive test coverage and stress-test the infrastructure against various user actions, data inputs, or unexpected circumstances.
Our test automation infrastructure for the web application relied on the following components:
- Selenium-based framework. Our team of QA engineers prepared 6000+ Selenium tests, which allowed for full coverage of system functionality — user interface interactions, data validation, and business process flows included — and facilitated cross-browser compatibility testing.
- Data-Driven Testing (DDT). To improve test maintainability and scalability, our team applied a data-driven testing approach to web application testing. This helped us separate test data from the script in .xls file, which, in turn, led to a more centralized and efficient testing process.
- Continuous Integration. Achieving a fast-paced release cadence required a simultaneous implementation of continuous integration. That’s why our team established a dedicated infrastructure for automatic building and application testing, using Jenkins, VNC, and Linux server administration.
The foundation of our mobile app test automation framework included the following elements:
- Combined test automation framework. We combined Espresso and Appium frameworks for a comprehensive testing strategy. Using Android Studio, our QA team implemented over 1000 automated tests for individual modules and pages of the Android application.
- Firebase Test Lab integration. Our QA engineers employed Google’s Firebase Test Lab cloud infrastructure to analyze the structure of the application’s user interface and automatically test it by simulating user actions.
On top of it, we integrated the entire test automation system with TestRail to set up a centralized test case repository, ensure real-time test execution tracking and facilitate detailed reporting.
Testimonial
"After initial project setup processes our venture became very efficient. You started this project with only 20 test cases being covered and after 1 year we had 700 of them. This changed our company’s strategy a lot. Your team became a key part of our test processes and earned great level of respect from our team and high management.
I also want to highlight high professional level of your team members. They have wide spectrum of knowledge in many technical software programming related skill, were able to analyze and resolve any issue we faced over this time. All technologies implemented by your team made us very strong and successful on highly competitive market of Silicon Valley.
Over all we are so happy about our mutual work and looking forward to increase our business with you, spreading it to other areas."
Result
Despite a 9-hour time gap with our client, JazzTeam managed to establish a seamless collaborative environment with the client’s team through daily stand-ups, weekly sprints, and regular demos. Our proactive approach to the project and end-to-end test automation expertise made JazzTeam a core asset of the client’s company, with our QA team playing a pivotal role in release decisions.
In the course of 8 years, we’ve become a trusted tech partner who implemented a 360-degree test management strategy, along with the full cycle of Continuous Integration, and effectively managed the complexity of multi-module architecture.
Working hand in hand with the client’s team, we’ve achieved the following results:
- By implementing a holistic test automation strategy and expanding test coverage, JazzTeam improved release stability by 300%.
- Automated testing, encompassing in total over 7,000 tests, significantly reduced testing cycles and allowed for timely releases and updates.
- JazzTeam documented the testing processes and created manuals for streamlined test management, enabling an effective knowledge transfer.
- We reduced future maintenance costs by 40% by focusing on proactive technical debt management and implementing best coding practices.
- Our team slashed operational costs by 24% through building a cost-efficient testing infrastructure
- We improved solutions’ performance by 17%, ensuring their uninterrupted operation across all devices and versions.
JazzTeam also went the extra mile and pitched in with our frontend development expertise to help the client resolve compatibility issues, implement multimedia HTML5 features, and conduct code refactoring. Our timely assistance helped the client improve user experience and optimize application performance.
In numbers
- 2 QA experts involved
- 7000+ automated tests cases prepared
- 300% increase in release stability
- 200% Increase in application performance
Screenshots
Technologies
Selenium WebDriver, Virtual Network Computing (VNC), Jenkins, Git, Jira, TestNG, Maven, Linux, TestRail, XPath, Linux, Espresso, Appium, Firebase Test Lab, Android Studio, UI Automator, Gradle, JUnit, Hamcrest.
