Skip to Content

World Quality Report 2021: Quality Assurance is now integral to software delivery as agility becomes non-negotiable

30 Sep 2021
  • Testing is no longer seen as an obstacle across the software development lifecycle but is a factor in its achievement;
  • Organizations are keen to put artificial intelligence (AI) and machine learning (ML) techniques to good use in their quality assurance programs.

Paris, September 30, 2021 – There has been a significant shift towards a more orchestrated approach to Quality Assurance (QA) as organizations are growing increasingly aware of its importance, according to the 13th edition of the World Quality Report 2021-2022, published today by Capgemini,  Sogeti and Micro Focus. The report finds significant developments in key trends across quality assurance and testing that are underlining this shift in perception across the board, including artificial intelligence (AI), agile and DevOps, and specifically the evolving area of Intelligent Industry[1].

The report finds that expectations in testing and QA are becoming more realistic; key focus areas of IT strategy such as enhancing customer experience (63%), enhancing security (62%), responsiveness to business demands (61%), and high quality of software solutions (61%) are being given broadly equal weight.

Confidence in AI in Quality Assurance is increasing
There is a growing desire amongst organizations to put AI and ML techniques to good use in their quality assurance programs. The report finds that nearly half of the respondents (48%) have a ready repository of test execution data required by AI and machine learning (ML) platforms, 42% say business owners trust the intelligence provided by these platforms, and 46% say their organization is willing to act on intelligence provided by the AI/ML platform. Confidence in AI in Quality Assurance is high, plans are robust, and skills and toolkits are being developed to put AI and ML techniques to good use in their quality assurance programs. Despite this, AI in Quality Assurance hasn’t reached a point of maturity yet. According to the report, there is a growing need for test strategy and test design skills for AI, which indicates that organizations are beginning to understand the intricacy of AI, the challenges in taking advantage of it, and the difficulties of testing AI itself.

Businesses are reaping the rewards of agile and DevOps in QA
The adoption of agile and DevOps in QA and testing is a continuing trend, and businesses are already reaping the rewards of laying greater emphasis on agile and DevOps, such as improvements in productivity, quality of software, and cost.  The report found a significant realignment in factors that respondents deemed to be the most important for successful DevOps adoption, with over half (52%) of the respondents recognizing business priorities as the most important factor — an 11-point jump from last year. The technology stack, on the other hand, has dropped in importance – with only 49% of respondents placing it first this year compared to 65% in 2020.

But lack of professional testing expertise in agile teams continues to remain a challenge. As boundaries blur between software development and test teams, organizations must focus on collaboration and upskilling all employees responsible for quality.

The future of testing is intelligent
Quality Assurance teams will soon become a source of rapid growth in Intelligent Industry, so there is immense value to be derived from allocating time, energy and budget here. The report notes that organizations are keen to achieve digital transformation, and the key drivers for intelligent industry, include improved efficiency (47%), increased quality (46%), better agility and flexibility (44%), and improved customer experience (43%). To achieve this, the first steps for organizations involve management buy-in and, demonstrating feasibility. A sizeable 42% of respondents in the report also noted plans to upgrade their existing test labs with capabilities in 5G, Internet of Things (IoT), AI, and autonomous systems in order to facilitate this. This requires significant investment and organizations need to focus on investing in products and services that will deliver the most value in the shortest amount of time, as well as in people.

What’s coming across loud and clear in this year’s World Quality Report is the shift in perception and increased attention towards Quality Assurance as a whole,” said Mark Buenen, Global Leader, Digital Assurance and Quality Engineering, Capgemini Group. “The pandemic has reinforced the importance of agility for organizations across all industries, and as IT is being modernized and environments are moving to the cloud to enable agility, businesses are growing more aware of the relevance and value of Quality Assurance. As a result, we’re seeing increasing investment in this area, particularly in those technologies that will enable Intelligent Industry.”

“The World Quality Report is a one-of-a-kind global study, and this year’s survey highlights the effect of the evolving pandemic-impacted requirements for applications across new deployment methods, the continued growth of AI, as well as QA’s adoption of agile and DevOps practices,” said Rohit de Souza, Senior Vice President, General Manager – ITOM Product Group & ADM Product Group, Leader of the CTO office and Product Security, Micro Focus. “As our customers look to improve their software quality, velocity, productivity, security, and overall customer experience across a range of devices and environments, these findings showcase the need for organizations to advance their modernization initiatives through AI-powered continuous quality and test automation tools.” 

For further information and the recommendations based on the research, access the full report here.

World Quality Report 2021 research methodology
The World Quality Report, which this year interviewed 1,750 CIOs and other senior technology professionals, across 10 industries, from 32 countries, is the only global report analyzing application quality and testing trends. It has been produced annually since 2009. Now in its 13th edition, the 2021-22 report adopted data collection through computer aided telephone interviews. Based on analysis of seven respondent groups: Chief Innovation Officer (CIO), Vice President Applications, IT Director, Quality Assurance/Testing Manager, Chief Data Officer/Chief Marketing Officer, Vice President/Director of Research & Development, and Chief Technology Officer (CTO)/Product Head, the report surveyed respondents from across the globe through quantitative interviews followed by qualitative deep-dive discussions.

About Capgemini
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of 290,000 team members in nearly 50 countries. With its strong 50 year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group reported in 2020 global revenues of €16 billion.

Get The Future You Want |

About Sogeti
Part of the Capgemini Group, Sogeti operates in more than 100 locations globally. Working closely with clients and partners to take full advantage of the opportunities of technology, Sogeti combines agility and speed of implementation to tailor innovative future-focused solutions in Digital Assurance and Testing, Cloud and Cybersecurity, all fueled by AI and automation. With its hands-on ‘value in the making’ approach and passion for technology, Sogeti helps organizations implement their digital journeys at speed.

Visit us at

About Micro Focus
Micro Focus delivers enterprise software to empower 40,000 customers worldwide to run, transform, and adapt. With a comprehensive portfolio, underpinned by a robust analytics ecosystem, Micro Focus delivers pragmatic, customer-centric solutions to bridge the gap between existing and emerging technologies and enable organizations to achieve Smart Digital Transformation

[1] Intelligent Industry, powered by data, is the term used by Capgemini for digital transformation that brings together the physical and digital worlds. Intelligent Industry harnesses the power of data to foster innovation, make new and differentiated ‘smart’ products, improve supply chains, create new customer experiences and deliver new sources of value. It explores how organizations use embedded software, data, 5G, edge computing, artificial intelligence (AI), automation, and the Internet of Things (IoT) to rethink what they do, and how they do it.