Given the growing complexity of production environments increasingly co-located across cloud and systems hosted in-house, setting-up and then supporting test environments that accurately represent the production conditions present several challenges.
In the recently released World Quality Report 2013-14 (WQR) 55% of the senior executives acknowledged that their organizations lack the necessary skills in-house for configuring and managing test environments. Clients often say that they have a good understanding of their core production systems and data, but they don’t have the configuration management skills to deliver test environments combining the right operating system, application version, set of test data, version of cloud-based functionality and authorisation of the testers.
On the other hand, 63% of the same senior executives state that their company has a permanent test environment.
Where affordable, this would seem like a pragmatic approach as the environment would be available to testers at all times. Although, as long as it’s not ready-to-use in the time that it is needed and with appropriate configurations then it would only be a cost centre. We see that 53% of the same population have difficulty in managing multiple versions of their systems whereas 45% struggle to efficiently use the available configurations.
An analysis of current testing and test environment practices followed by implementation of a set of policies, standards and tooling can improve software release schedule by 25% whereas cutting infrastructure costs by 10%.
To download the World Quality Report and know more about what companies said about their test environment management capabilities, see here.