Subscribe to DSC Newsletter

Ahmed
  • United Kingdom
Share on Facebook
Share
 

Ahmed's Page

Latest Activity

Siva Karthikeyan commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"SAP Lumira Desktop Edition can be also of good help."
Feb 23, 2014
Ahmed commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"@ aliyu Dauda and Thomas J Bate: I spent the last 50 days exploring excel PowerPivot, PowerQuery, Visokio Omniscope, Amazon EC2 Virtual Machines, etc.. PowerPivot and PowerQuery are must-have tools, I never thought I could fit 66 Million rows…"
Dec 24, 2013
aliyu Dauda commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"Hi Ahmed. Apologies for the late response. PowerPivot for excel is free, you can download it as an add-in on microsoft's website. The limitation is as follows: for pwerpivot for excel 2010, the file size cannot be more than 2G for the 32bit…"
Nov 6, 2013
Paulo Santos commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"You can use pentaho data integration. I have used it with 13 million records and done all the summaries needed for large data sets. It can do most of the steps of excel pivot tables integrated in the process. The programming is graphic in nature…"
Oct 29, 2013
Paul Hiller commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"User friendly? Say no more, Ahmed! I work for StatSoft, so, of course, I recommend the tool rated "#1 in User Satisfaction" by 2013 Rexer Data Miner Survey: that tool is STATISTICA. Yes, we have free trialware, but since you are…"
Oct 25, 2013
Blaise F Egan commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"I would recommend MariaDB, the replacement for MySQL. There are lots of good books on SQL and MySQL that you can learn from. The software is free."
Oct 25, 2013
Thomas J Bate commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"You install Omniscope on a rented AWS Desktop the same as you would on your home machine, just download and install. Omniscope will do most of what PowerPivot does, but with no other (M$oft) software needed, just Omniscope. Omniscope functionally…"
Oct 25, 2013
Ahmed commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"Thanks Vincent for the leaving the comment here. @ Thomas, seems like a great idea. I spent sometime trying to learn more about AWS and Omniscope. (I don't have any experience in programming or databases), but how do I install Omniscope on the…"
Oct 25, 2013
aliyu Dauda commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"millions of rows easily using the in-memory data analytics engine Microsoft calls xVelocity. You can extend its capability with DAX; Data analysis expression language which is very easy to learn. You can create pivot tables on the fly while you…"
Oct 24, 2013
aliyu Dauda commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"I think you can use excel powerpivot. It's a simple but powerful tool. It can handle"
Oct 24, 2013
Thomas J Bate commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"Consider Visokio Omniscope...free to try...often used for exactly the tasks you describe, same level of  ease of use and  accessibility as Excel, but much better suited to visual and formulaic scrubbing, text processing and many other…"
Oct 24, 2013
R.A.S. Ravi Sankar commented on Ahmed's blog post Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...
"IBM Bigdata Infosphere is an ideal Haddop and NoSQL database (like excel) based solution for handling Tera and Petabites of data. It can be integrated with IBM SPSS Modeler and other related ETL and BI tools. Cost, I don't know. I hope it is…"
Oct 24, 2013
Ahmed replied to Lakshmi Narasimha Rao's discussion Survival analysis of customers using text analytics
"I'm not what do you mean by customer survival, but try contacting Decooda. Hope this helps. http://decooda.com/consulting/text-analytics-consulting/"
Oct 23, 2013
Ahmed posted a blog post

Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...

I have a 5-20K USD budget to get a tool (w/wo dedicated hardware), including training for 2 people, to prepare (clean, merge, etc...) and summarize (samples, grouping/aggregations, etc) large data sets (over 5GBs, over 4 million rows).I need an efficient solution (fast data processing and fast to learn), and definitely easy to use. I would have done it with excel if excel could handle such large data files.After preparing and summarizing the data, I'll use excel pivot tables for the analysis. I…See More
Oct 22, 2013

Profile Information

Field of Expertise:
Business Analytics
Professional Status:
Manager

Ahmed's Blog

Help Needed! Getting a user-friendly tool (or system) to prepare large data sets for analysis...

Posted on October 22, 2013 at 2:16pm 13 Comments

I have a 5-20K USD budget to get a tool (w/wo dedicated hardware), including training for 2 people, to prepare (clean, merge, etc...) and summarize (samples, grouping/aggregations, etc) large data sets (over 5GBs, over 4 million rows).

I need an efficient solution (fast data processing and fast to learn), and definitely easy to use. I would have done it with excel if excel could handle such large data files.

After preparing and summarizing the data, I'll use excel pivot tables…

Continue

Comment Wall

You need to be a member of AnalyticBridge to add comments!

Join AnalyticBridge

  • No comments yet!
 
 
 

On Data Science Central

© 2019   AnalyticBridge.com is a subsidiary and dedicated channel of Data Science Central LLC   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service