Subscribe to DSC Newsletter

Today's Big Data is Not Yesterday's Big Data

The on-going Big Data media hype stirs up a lot of passionate voices. There are naysayers ("it is nothing new"), doomsayers ("it will disrupt everything"), and soothsayers (e.g., Predictive Analytics experts). The naysayers are most bothersome, in my humble opinion. (Note: I am not talking about skeptics, whom we definitely and desperately need during any period of maximized hype!) 

We frequently encounter statements of the "naysayer" variety that tell us that even the ancient Romans had big data.  Okay, I understand that such statements logically follow from one of the standard definitions of big data: data sets that are larger, more complex, and generated more rapidly than your current resources (computational, data management, analytic, and/or human) can handle -- whose characteristics correspond to the 3 V's of Big Data.  This definition of Big Data could be used to describe my first discoveries in a dictionary or my first encounters with an encyclopedia.  But those "data sets" are hardly "Big Data" -- they are universally accessible, easily searchable, and completely "manageable" by their handlers. Conversely, in today's big data tsunami, each one of us generates insurmountable collections of data on our own. In addition, the correlations, associations, and links between each person's digital footprint and all other persons' digital footprints correspond to an exponential (actually, combinatorial) explosion in additional data products.

Nevertheless, despite all of these clear signs that today's big data environment is something radically new, that doesn't stop the naysayers.  With the above standard definition of big data in their quiver, the naysayers are fond of shooting arrows through all of the discussions that would otherwise suggest that big data are changing society, business, science, media, government, retail, medicine, cyber-anything, etc. I believe that this naysayer type of conversation is unproductive, unhelpful, and unscientific. The volume, complexity, and speed of data today are vastly different from anything that we have ever previously experienced, and those facts will be even more emphatic next year, and even more so the following year, and so on.  In every sector of life, business, and government, the data sets are becoming increasingly off-scale and exponentially unmanageable. The 2011 McKinsey report "Big Data: The Next Frontier for Innovation, Competition, and Produc..." made this abundantly clear.  When the Internet of Things and machine-to-machine applications really become established, then the big data V's of today will seem like child's play.

In an attempt to illustrate the enormity of scale of today's (and tomorrow's) big data, I have discussed the exponential explosion of data in my TedX talk "Big Data, small world" (e.g., you can fast-forward to my comments on this topic starting approximately at time 8:50 in the video). You can also read more about this topic in the article "Big Data: Compound Interest Growth on Steroids", where I have elaborated on the compound growth rate of big data -- the numbers will blow your mind, and they should blow away the naysayers' arguments.  Read all about it at http://www.bigdatarepublic.com/author.asp?section_id=3146&doc_i....

Views: 2159

Comment

You need to be a member of AnalyticBridge to add comments!

Join AnalyticBridge

Comment by Randy Bartlett on August 11, 2013 at 10:31am

I am on board with Big Data.  To be fair with the naysayers, I think their main message is that their skill set is still applicable and that this change is part of a continuum and not a step making everything we did in the past obsolete.  Big Data is still data and possesses the same properties just in different proportions. 

Comment by Kirk Borne on August 1, 2013 at 3:25pm

@Vincent, your paper.li news summary makes a "perfect 30" ... the number of such summaries listed below. Thanks.

Comment by Vincent Granville on August 1, 2013 at 8:32am

And here's our news summary:

@analyticbridge: http://paper.li/analyticbridge/1375330636

Comment by Kirk Borne on July 31, 2013 at 1:57pm

For daily (and weekly) summaries of the Big Data, Analytics, Statistics, and Data Science discussions in the news, check out some of these excellent paper.li aggregations (which are just a small sample of many choices):

@datascientists : http://paper.li/datascientists/1334960083

@rwang0 : http://paper.li/rwang0/1328150054

@DrMattRoach : http://paper.li/drmattroach/1321267421

@hyounpark : http://paper.li/hyounpark/1335311993

@data_nerd : http://paper.li/data_nerd/1306264508

@vcdave : http://paper.li/vcdave/1358730585

@jaimefitzgerald : http://paper.li/jaimefitzgerald/1335279494

@Hixgrid : http://paper.li/Hixgrid/1347750212

@MicoYuk : http://paper.li/MicoYuk/1361157548

@TextAnalysisPro : http://paper.li/TextAnalysisPro

@SocialNewsCorp : http://paper.li/SocialNewsCorp/1329078602

@ratzesberger : http://paper.li/ratzesberger

@NISSSAMSI : http://paper.li/NISSSAMSI/statistics

@Analytics_TL : http://paper.li/tl_analytics/1316226977

@Rup3r7_7 : http://paper.li/Rup3r7_7/1320384087

@TomHCAnderson : http://paper.li/TomHCAnderson/1308093004

@lbmadsen : http://paper.li/lbmadsen/1314891745

@silverdata : http://paper.li/silverdata/1336406068

@tomheger : http://paper.li/tomheger/1361227711

@luiy : http://paper.li/luiy/1354795092

@brendantierney : http://paper.li/brendantierney/1364568794

@TheDMPL : http://paper.li/TheDMPL/1338944730

@prakashd : http://paper.li/prakashd/1365567523

@VisualOfData : http://paper.li/VisualOfData/1371604296

@merapps : http://paper.li/merapps/1361963207

@sna_social3 : http://paper.li/sna_social3/1340610253

@shawnrog : http://paper.li/shawnrog/business-intelligence

@RajneeshB : http://paper.li/RajneeshB/1362297831

@predictivemktng : http://paper.li/predictivemktng

Follow Us

On Data Science Central

On DataViz

On Hadoop

© 2017   AnalyticBridge.com is a subsidiary and dedicated channel of Data Science Central LLC   Powered by

Badges  |  Report an Issue  |  Terms of Service