Download Our New Mogul App Worldwide

Become your best self with a community of real women around the world who have your back.

Download Now

3MajorBarriersToSteadyAndContinuousTesting

3 Major Barriers To Steady And Continuous Testing

Continuous testing, can be termed as the process of conducting automated tests as part of the software delivery pipeline agreement which enables the individuals to obtain feedback on the business risks that are sometimes autonomously associated with a software release. 

Test automation is crucial for continuous and perennial testing, but that is not all. The reason why test automation is designed is to develop a set of pass/fail data points that are correlated to user stories.

Continuous testing is more focused on business risk and on providing insights on whether the software can be released at a particular time or not. Apart from test automation, continuous testing involves practices such as aligning the testing with the company’s business risk, applying service virtualization and stateful test data management to stabilize testing for continuous integration, and performing exploratory testing to expose “big block” issues early in each iteration. 

Continuous testing has become imperative today. Survey shows 97 percent of organizations have adopted agile and 71 percent are practicing or adopting devops.

The major roadblocks that fall into the following three categories:

  1. Time and resources

  2. Complexity

  3. Results


Time and Resources

Time and resources are often ignored by development teams when it comes to using them for a sustainable test automation. Basic UI tests to run are a great start when it comes to automation. But, one also needs to plan for the time and resources that are required to a) Keep annoyingly fragile tests scripts from generating arbitrary false positives b) Create separate tests for each new and updated requirement.

c) Construct a test framework which leverages reuse and data-driven testing.

d) maintain individual tests and the broader test framework in sync.

Complexity

When focusing on complexity of said tests, one needs to ensure that,

  • Testing resources is a must in order to understand how and when to automate tests across all the different technologies.

  • There is enough of stateful, secure, and compliant test data which is required to set up a realistic, practical test and drive the test through a complex series of steps.

  • There is a reliable, continuous, and cost-effective access to all the dependent systems that are required for your tests. These includes APIs and third-party applications that may be unstable, or accessible only at limited times.

  • You hire QA engineers who are expert in their field, understand the dynamics of your organization, and readily available at your disposal whenever needed. 

Results

An overwhelming number of false positives is one of the most dreaded things when it comes to test results. These results need to be confronted. With time, when the test suite grows and the frequency of tests increase, addressing the false positives promptly becomes an instrumental task. 

In such cases, teams either start to ignore these false positives or entirely give up on test automation.

With devops and continuous delivery initiatives a major issue is that they do not necessarily provide the risk-based insight required to make a fast go/go-no decision.

However, would someone be  willing to make a product release decision based on certain results like,

  1. 44,545 tests passed.
  2. 11,054 tests failed.
  3. 545 tests did not execute.

In most of the cases, failures are related to trivial functionality  or maybe the most critical functionality like engine failure. This would take loads and loads of man hours and manual investigation which may generate delayed and inaccurate answers.

Test results focusing on the number of test cases leave you with a big blind spot that becomes critical and dangerous with time, especially if you are moving at the speed of agile and devops. 

Conclusion

There is no single argument that settles the problem once and forever. As discussed, most businesses focus on agile methodology when it comes to development. Agile methods creates agile problems. And agile problems need agile quality testing services to tackle it in the best possible manner.


0 replies

As a guest user, you can still reply to conversations. Just press the "Reply" button below, which will prompt you to sign in or sign up on Mogul before your Reply posts.


Report this post
Report this post

Want your dream job or internship?

Join the women worldwide who discovered their next opportunity on Mogul.

Get My Dream Job Now

Moguls Interested in Yale

Want your dream job or internship?

Join the women worldwide who discovered their next opportunity on Mogul.

Get My Dream Job Now

Trending Jobs

See All Jobs