A Data Science Central Community
We would like to organize a competition where human beings compete against computers, to make predictions. The concept is simple: the brain, after all, is capable of doing raw predictions - weather predictions, stock market predictions, economic predictions, and so on. Even the tiny brain of some animals seem better than computers or the human brain, for short-term weather predictions. Human or animal brains, as well as computers, rely on (sensor) data to make predictions.
How would you set up a robust test to accurately measure who is consistently better at predictions? Let's say that we focus on predicting the stock market: how do you design a test to compare human beings with computers, both feeding on big data, with regard to making successful buy/sell transactions? Evidently, if we have a large number of participants designing stock trading strategies, some are going to perform very well just by chance. We want to reward people who succeed thanks to either sheer brain or computer power, but not thanks to chance.
We believe that the human brain, just like a computer or server cluster (cloud) equipped with SAS, R, Python, NoSQL database, Hadoop or other software, is an analytic machine. Indeed, I was once offered a well paid Wall Street job where no programming skill was required: only an analytic brain good with contrarian strategies (they were mostly hiring MIT and Princeton graduates, so I was a bit of an outlier).
Here we are looking for suggestions and participants for a human vs. machine predictive analytics competition. If you are interested in this project, please contact us at [email protected]