Skip to Content
DotCom_Banner_1540x600

World Quality Report 2019-20

Your annual source of essential reading on quality engineering

For over a decade, the World Quality Reports have inspired CXOs to review their approach to quality engineering. In the 11th edition, over 1700 have voted ‘contribution to business growth and outcomes’ as the top quality assurance objective. Download your e-copy to find out how your peers are maximizing growth with the quality multiple.

        <div class="pf_forms__container ">
                        <form id="pf_form_500856" class="pf_form__form" action="" method="post" enctype="multipart/form-data">
                        <div class="pf_field pf_field--text pf-required" data-validate="text">
            <label for="_pf_447347_4096">First Name                 &nbsp;<span class="pf-required--symbol"> * </span></label>
            <input type="text" id="_pf_447347_4096" class="pf_field__input empty" name="_pf_447347_4096" required="">
        </div>
                <div class="pf_field pf_field--text pf-required" data-validate="text">
            <label for="_pf_469378_3451">Last Name                  &nbsp;<span class="pf-required--symbol"> * </span></label>
            <input type="text" id="_pf_469378_3451" class="pf_field__input empty" name="_pf_469378_3451" required="">
        </div>
                <div class="pf_field pf_field--text pf-required" data-validate="text">
            <label for="_pf_494180_703">Role                    &nbsp;<span class="pf-required--symbol"> * </span></label>
            <input type="text" id="_pf_494180_703" class="pf_field__input empty" name="_pf_494180_703" required="">
        </div>
                <div class="pf_field pf_field--text " data-validate="text">
            <label for="_pf_494463_6224">Organization                   </label>
            <input type="text" id="_pf_494463_6224" class="pf_field__input empty" name="_pf_494463_6224">
        </div>
                <div class="pf_field pf_field--email pf-required" data-validate="email">
            <label for="_pf_447347_8100">Email                  &nbsp;<span class="pf-required--symbol"> * </span>              </label>
            <input type="email" id="_pf_447347_8100" class="pf_field__input empty" name="_pf_447347_8100" required="">
        </div>
                <div class="pf_field pf_field--tel pf-required" data-validate="tel">
            <label for="_pf_499171_482">Phone                   &nbsp;<span class="pf-required--symbol"> * </span>              </label>
            <input type="tel" id="_pf_499171_482" class="pf_field__input empty" name="_pf_499171_482" pattern="^[0-9-+s()]*$" required="">
        </div>
                <div class="pf_field pf_field--country pf-required">
            <label for="_pf_500856_2761">Country                    &nbsp;<span class="pf-required--symbol"> * </span>              </label>
            <select id="_pf_500856_2761" class="pf_field__input empty select2-hidden-accessible" name="_pf_500856_2761" data-validate="select" required="" tabindex="-1" aria-hidden="false">
                                        <option value=""></option>
                                        <option value="AF">Afghanistan</option>
                                        <option value="AX">Aland Islands</option>
                                        <option value="AL">Albania</option>
                                        <option value="DZ">Algeria</option>
                                        <option value="AS">American Samoa</option>
                                        <option value="AD">Andorra</option>
                                        <option value="AO">Angola</option>
                                        <option value="AI">Anguilla</option>
                                        <option value="AQ">Antarctica</option>
                                        <option value="AG">Antigua And Barbuda</option>
                                        <option value="AR">Argentina</option>
                                        <option value="AM">Armenia</option>
                                        <option value="AW">Aruba</option>
                                        <option value="AU">Australia</option>
                                        <option value="AT">Austria</option>
                                        <option value="AZ">Azerbaijan</option>
                                        <option value="BS">Bahamas</option>
                                        <option value="BH">Bahrain</option>
                                        <option value="BD">Bangladesh</option>
                                        <option value="BB">Barbados</option>
                                        <option value="BY">Belarus</option>
                                        <option value="BE">Belgium</option>
                                        <option value="BZ">Belize</option>
                                        <option value="BJ">Benin</option>
                                        <option value="BM">Bermuda</option>
                                        <option value="BT">Bhutan</option>
                                        <option value="BO">Bolivia</option>
                                        <option value="BA">Bosnia And Herzegovina</option>
                                        <option value="BW">Botswana</option>
                                        <option value="BV">Bouvet Island</option>
                                        <option value="BR">Brazil</option>
                                        <option value="IO">British Indian Ocean Territory</option>
                                        <option value="BN">Brunei Darussalam</option>
                                        <option value="BG">Bulgaria</option>
                                        <option value="BF">Burkina Faso</option>
                                        <option value="BI">Burundi</option>
                                        <option value="KH">Cambodia</option>
                                        <option value="CM">Cameroon</option>
                                        <option value="CA">Canada</option>
                                        <option value="CV">Cape Verde</option>
                                        <option value="KY">Cayman Islands</option>
                                        <option value="CF">Central African Republic</option>
                                        <option value="TD">Chad</option>
                                        <option value="CL">Chile</option>
                                        <option value="CN">China</option>
                                        <option value="CX">Christmas Island</option>
                                        <option value="CC">Cocos (Keeling) Islands</option>
                                        <option value="CO">Colombia</option>
                                        <option value="KM">Comoros</option>
                                        <option value="CG">Congo</option>
                                        <option value="CD">Congo, Democratic Republic</option>
                                        <option value="CK">Cook Islands</option>
                                        <option value="CR">Costa Rica</option>
                                        <option value="CI">Cote D'Ivoire</option>
                                        <option value="HR">Croatia</option>
                                        <option value="CU">Cuba</option>
                                        <option value="CY">Cyprus</option>
                                        <option value="CZ">Czech Republic</option>
                                        <option value="DK">Denmark</option>
                                        <option value="DJ">Djibouti</option>
                                        <option value="DM">Dominica</option>
                                        <option value="DO">Dominican Republic</option>
                                        <option value="EC">Ecuador</option>
                                        <option value="EG">Egypt</option>
                                        <option value="SV">El Salvador</option>
                                        <option value="GQ">Equatorial Guinea</option>
                                        <option value="ER">Eritrea</option>
                                        <option value="EE">Estonia</option>
                                        <option value="ET">Ethiopia</option>
                                        <option value="FK">Falkland Islands (Malvinas)</option>
                                        <option value="FO">Faroe Islands</option>
                                        <option value="FJ">Fiji</option>
                                        <option value="FI">Finland</option>
                                        <option value="FR">France</option>
                                        <option value="GF">French Guiana</option>
                                        <option value="PF">French Polynesia</option>
                                        <option value="TF">French Southern Territories</option>
                                        <option value="GA">Gabon</option>
                                        <option value="GM">Gambia</option>
                                        <option value="GE">Georgia</option>
                                        <option value="DE">Germany</option>
                                        <option value="GH">Ghana</option>
                                        <option value="GI">Gibraltar</option>
                                        <option value="GR">Greece</option>
                                        <option value="GL">Greenland</option>
                                        <option value="GD">Grenada</option>
                                        <option value="GP">Guadeloupe</option>
                                        <option value="GU">Guam</option>
                                        <option value="GT">Guatemala</option>
                                        <option value="GG">Guernsey</option>
                                        <option value="GN">Guinea</option>
                                        <option value="GW">Guinea-Bissau</option>
                                        <option value="GY">Guyana</option>
                                        <option value="HT">Haiti</option>
                                        <option value="HM">Heard Island &amp; Mcdonald Islands</option>
                                        <option value="VA">Holy See (Vatican City State)</option>
                                        <option value="HN">Honduras</option>
                                        <option value="HK">Hong Kong</option>
                                        <option value="HU">Hungary</option>
                                        <option value="IS">Iceland</option>
                                        <option value="IN">India</option>
                                        <option value="ID">Indonesia</option>
                                        <option value="IR">Iran, Islamic Republic Of</option>
                                        <option value="IQ">Iraq</option>
                                        <option value="IE">Ireland</option>
                                        <option value="IM">Isle Of Man</option>
                                        <option value="IL">Israel</option>
                                        <option value="IT">Italy</option>
                                        <option value="JM">Jamaica</option>
                                        <option value="JP">Japan</option>
                                        <option value="JE">Jersey</option>
                                        <option value="JO">Jordan</option>
                                        <option value="KZ">Kazakhstan</option>
                                        <option value="KE">Kenya</option>
                                        <option value="KI">Kiribati</option>
                                        <option value="KR">Korea</option>
                                        <option value="KW">Kuwait</option>
                                        <option value="KG">Kyrgyzstan</option>
                                        <option value="LA">Lao People's Democratic Republic</option>
                                        <option value="LV">Latvia</option>
                                        <option value="LB">Lebanon</option>
                                        <option value="LS">Lesotho</option>
                                        <option value="LR">Liberia</option>
                                        <option value="LY">Libyan Arab Jamahiriya</option>
                                        <option value="LI">Liechtenstein</option>
                                        <option value="LT">Lithuania</option>
                                        <option value="LU">Luxembourg</option>
                                        <option value="MO">Macao</option>
                                        <option value="MK">Macedonia</option>
                                        <option value="MG">Madagascar</option>
                                        <option value="MW">Malawi</option>
                                        <option value="MY">Malaysia</option>
                                        <option value="MV">Maldives</option>
                                        <option value="ML">Mali</option>
                                        <option value="MT">Malta</option>
                                        <option value="MH">Marshall Islands</option>
                                        <option value="MQ">Martinique</option>
                                        <option value="MR">Mauritania</option>
                                        <option value="MU">Mauritius</option>
                                        <option value="YT">Mayotte</option>
                                        <option value="MX">Mexico</option>
                                        <option value="FM">Micronesia, Federated States Of</option>
                                        <option value="MD">Moldova</option>
                                        <option value="MC">Monaco</option>
                                        <option value="MN">Mongolia</option>
                                        <option value="ME">Montenegro</option>
                                        <option value="MS">Montserrat</option>
                                        <option value="MA">Morocco</option>
                                        <option value="MZ">Mozambique</option>
                                        <option value="MM">Myanmar</option>
                                        <option value="NA">Namibia</option>
                                        <option value="NR">Nauru</option>
                                        <option value="NP">Nepal</option>
                                        <option value="NL">Netherlands</option>
                                        <option value="AN">Netherlands Antilles</option>
                                        <option value="NC">New Caledonia</option>
                                        <option value="NZ">New Zealand</option>
                                        <option value="NI">Nicaragua</option>
                                        <option value="NE">Niger</option>
                                        <option value="NG">Nigeria</option>
                                        <option value="NU">Niue</option>
                                        <option value="NF">Norfolk Island</option>
                                        <option value="MP">Northern Mariana Islands</option>
                                        <option value="NO">Norway</option>
                                        <option value="OM">Oman</option>
                                        <option value="PK">Pakistan</option>
                                        <option value="PW">Palau</option>
                                        <option value="PS">Palestinian Territory, Occupied</option>
                                        <option value="PA">Panama</option>
                                        <option value="PG">Papua New Guinea</option>
                                        <option value="PY">Paraguay</option>
                                        <option value="PE">Peru</option>
                                        <option value="PH">Philippines</option>
                                        <option value="PN">Pitcairn</option>
                                        <option value="PL">Poland</option>
                                        <option value="PT">Portugal</option>
                                        <option value="PR">Puerto Rico</option>
                                        <option value="QA">Qatar</option>
                                        <option value="RE">Reunion</option>
                                        <option value="RO">Romania</option>
                                        <option value="RU">Russian Federation</option>
                                        <option value="RW">Rwanda</option>
                                        <option value="BL">Saint Barthelemy</option>
                                        <option value="SH">Saint Helena</option>
                                        <option value="KN">Saint Kitts And Nevis</option>
                                        <option value="LC">Saint Lucia</option>
                                        <option value="MF">Saint Martin</option>
                                        <option value="PM">Saint Pierre And Miquelon</option>
                                        <option value="VC">Saint Vincent And Grenadines</option>
                                        <option value="WS">Samoa</option>
                                        <option value="SM">San Marino</option>
                                        <option value="ST">Sao Tome And Principe</option>
                                        <option value="SA">Saudi Arabia</option>
                                        <option value="SN">Senegal</option>
                                        <option value="RS">Serbia</option>
                                        <option value="SC">Seychelles</option>
                                        <option value="SL">Sierra Leone</option>
                                        <option value="SG">Singapore</option>
                                        <option value="SK">Slovakia</option>
                                        <option value="SI">Slovenia</option>
                                        <option value="SB">Solomon Islands</option>
                                        <option value="SO">Somalia</option>
                                        <option value="ZA">South Africa</option>
                                        <option value="GS">South Georgia And Sandwich Isl.</option>
                                        <option value="ES">Spain</option>
                                        <option value="LK">Sri Lanka</option>
                                        <option value="SD">Sudan</option>
                                        <option value="SR">Suriname</option>
                                        <option value="SJ">Svalbard And Jan Mayen</option>
                                        <option value="SZ">Swaziland</option>
                                        <option value="SE">Sweden</option>
                                        <option value="CH">Switzerland</option>
                                        <option value="SY">Syrian Arab Republic</option>
                                        <option value="TW">Taiwan</option>
                                        <option value="TJ">Tajikistan</option>
                                        <option value="TZ">Tanzania</option>
                                        <option value="TH">Thailand</option>
                                        <option value="TL">Timor-Leste</option>
                                        <option value="TG">Togo</option>
                                        <option value="TK">Tokelau</option>
                                        <option value="TO">Tonga</option>
                                        <option value="TT">Trinidad And Tobago</option>
                                        <option value="TN">Tunisia</option>
                                        <option value="TR">Turkey</option>
                                        <option value="TM">Turkmenistan</option>
                                        <option value="TC">Turks And Caicos Islands</option>
                                        <option value="TV">Tuvalu</option>
                                        <option value="UG">Uganda</option>
                                        <option value="UA">Ukraine</option>
                                        <option value="AE">United Arab Emirates</option>
                                        <option value="GB">United Kingdom</option>
                                        <option value="US" selected="selected">United States</option>
                                        <option value="UM">United States Outlying Islands</option>
                                        <option value="UY">Uruguay</option>
                                        <option value="UZ">Uzbekistan</option>
                                        <option value="VU">Vanuatu</option>
                                        <option value="VE">Venezuela</option>
                                        <option value="VN">Viet Nam</option>
                                        <option value="VG">Virgin Islands, British</option>
                                        <option value="VI">Virgin Islands, U.S.</option>
                                        <option value="WF">Wallis And Futuna</option>
                                        <option value="EH">Western Sahara</option>
                                        <option value="YE">Yemen</option>
                                        <option value="ZM">Zambia</option>
                                        <option value="ZW">Zimbabwe</option>
                                </select><span class="select2 select2-container select2-container--default" dir="ltr" aria-hidden="true"><span class="selection"><span class="select2-selection select2-selection--single" aria-haspopup="true" aria-expanded="false" tabindex="0" aria-labelledby="select2-_pf_500856_2761-container" role="combobox"><span class="select2-selection__rendered" id="select2-_pf_500856_2761-container" role="textbox" aria-readonly="true" title="United States">United States</span><span class="select2-selection__arrow" role="presentation"><b role="presentation"></b></span></span></span><span class="dropdown-wrapper" aria-hidden="true"></span></span>
        </div>
                <div class="pf_field pf_field--consent pf-required" data-validate="checkboxes">
            <div class="pf_consent__wrapper">
                <input type="checkbox" id="_pf_447347_7122" name="_pf_447347_7122[]" value="1" required="">
                <label for="_pf_447347_7122">

                    By submitting this form, I understand that my data will be processed by Capgemini as indicated above and described in the <a href="https://www.capgemini.com/us-en/terms-of-use/">Terms of use.</a>&nbsp;<span class="pf-required--symbol">*</span>                 </label>
            </div>
        </div>
                <div class="pf_field pf_field--recaptcha">
            <div class="g-recaptcha" data-sitekey="6Lc3OpIUAAAAADY4ErEHF0HF6Tr7vuknduDU-fbl"><div style="width: 304px; height: 78px;"><div><iframe title="reCAPTCHA" src="https://www.google.com/recaptcha/api2/anchor?ar=1&amp;k=6Lc3OpIUAAAAADY4ErEHF0HF6Tr7vuknduDU-fbl&amp;co=aHR0cHM6Ly93d3cuY2FwZ2VtaW5pLmNvbTo0NDM.&amp;hl=en&amp;v=QENb_qRrX0-mQMyENQjD6Fuj&amp;size=normal&amp;cb=wimzped1fsxe" width="304" height="78" role="presentation" name="a-p2p6s9mpiden" frameborder="0" scrolling="no" sandbox="allow-forms allow-popups allow-same-origin allow-scripts allow-top-navigation allow-modals allow-popups-to-escape-sandbox"></iframe></div><textarea id="g-recaptcha-response" name="g-recaptcha-response" class="g-recaptcha-response" style="width: 250px; height: 40px; border: 1px solid rgb(193, 193, 193); margin: 10px 25px; padding: 0px; resize: none; display: none;"></textarea></div><iframe style="display: none;"></iframe></div>
        </div>

        <div class="pf_field pf_field--submit">
            <input type="submit" class="pf_field__input" id="_pf_447347_6427" value="Submit">
        </div>
                    <input type="hidden" name="form_id" data-validate="number" class="pf_form__id" value="500856">
            <input type="hidden" name="form_title" class="pf_form__title" value="2019-gl-world-quality-report-2019-20">
            <input type="hidden" name="wp_rest_nonce" class="pf_form__wp_rest_nonce" value="3a46257682">
        </form>

        <div class="pf_form__success">
            <h2><b><u>Thank you for registering; you’ll receive a link to the e-copy of the World Quality Report 2019-20 on your mailing ID.</u></b></h2><p></p>
        </div>
        <div class="pf_form__errors">
            <p>We are sorry, the form submission failed. Please try again.</p>
        </div>
                </div>

Keeping up with rapid changes in software testing can be a daunting task for CIOs. The World Quality Report combines easy to interpret data with expert commentary to help you make the most of software testing trends for 2020.

The demands for quality at speed

There’s an urgent call for aligning software quality ambitions with business growth and outcomes. It’s driving a transformation that federates the ownership of quality. Far from being a limited mandate of testing communities, quality is now an enterprise-wide mission. Speed, precision and efficiency are at the core of this transformation. And yet, one in four respondents say operational and business priorities continue to impede the adoption of agile and DevOps.

Artificial intelligence in QA: lack of skills calls for external help

It’s still early days, but there’s more interest in AI and ML for smart testing today than ever before—well, at least since the Report started tracking it. This year, data highlights the lack of specific skills required to realize the true potential of artificial intelligence in software testing. Statistical skills, mathematical skills, metrics that are specific to the business strategy and ambitions—all these will need to form part of the AI-related armory. Survey points towards an acceptance of external help.

Test automation as a platform

There’s evidence in the report that businesses run the risk of automating software testing to replace the manual stuff. The need of the hour is to reimagine automation as a smart connected platform that enables seamless QA. From build through to deployment! There are indications it’s happening, that test automation is being addressed as a full lifecycle requirement, not just a functional one.

Test environments: escalation in costs and challenges

A staggering 60% of the WQR sample reports cost as the greatest test environment challenge. Going by the voice of respondents, it appears that precious little is being done to fix environments. There are potential efficiency gains from a course correction that they’re willing to forgo, according to the data.

QA budgets are down to 2013 levels

The drop in budgets reflects how quality engineering is no longer a bolt-on but embedded in the overall development process. We view this as a long-term positive. More on software testing budgets across sectors in the report!

For more on the regional developments covered in this global study, download e-copies of the regional pull-outs.