I have found evaluation of analytics capability/competency to be a challenge.
Some people are good at tools ( SAS/SPSS) and they have no clue whatsoever when a business problem is posed to them and which techniques to use. They know standard proc routines and they run them like a factory. A few others understand business issues but have no statistical application knowledge. Past experience does not seem to enough indicator of the person's caliber or capability. Some times too much of predictive model/technique focus leads to poor understanding of business issue and the interpretation of model scores & variables is of a very poor quality.
How does one evaluate them and are there standard testing procedures one can use to evaluate them and separate the best from the average.
If there are testing questionnaires and answers that can help me evaluate, do share them please.
Thanks in advance,