Most of our clients are keen to use crowd testing to increase the quality and reliability of application, one of the challenge they face is how to budget for this effort. Crowd is used for different purposes
a. Crowd is used only for additional test execution, effort can be estimated using regular estimation models
b. Fixed number of crowd testers are used for a specific period, cost can be estimated upfront
The challenge is when you want to use large and wide crowd platform for doing testing, it may be difficult to budget this efforts upfront. One of the model used is ‘Price per Defect’ while using a large crowd, as the testers are paid based on the outcome not based on the effort, they are paid based on valid and complexity of defects they find.
How this effort can be budgeted upfront?
One way is to use defect prediction model to predict the number defects, there are several defect prediction models which requires minimum input to predict, they can predict for each phase of testing.
You can find more details from this white papers
Use a defect prediction tool and predict the numbers of defects you will find, based on that you will be able to estimate cost for crowd testing effort. We used a simple defect prediction tool, which was internally built using T-92-52 and Rayleigh defect prediction model principles, which predicts with very little margin of error