As you would know, SQL is essential for many tasks involving working with large quantities of data.

Members of Analytic Bridge might like to download my guide to SQL titled 'SQL Essentials' available for free download from my personal website www.markmcilroy.com

Also on my personal website is a practice SQL environment where you can query a sample database and try out the examples from the book.

This book and my…

Continue

Here's a new tool that can help to bridge the business-IT divide -- Executable English.



It's a platform on the Web that can support people socially writing their own apps, by typing  Executable English knowledge into browsers.



For example, here's the "source code" of an app written in executable English:



    www.reengineeringllc.com/demo_agents/GrowthAndDebt1.agent



Anyone on the…

Continue

Program development for data process often involves cross-database relational operations. The following example will illustrate Java’s method of handling these operations. sales table is in db2 database, employee table is in mysql database. The task is to join sales with employee through sellerid of sales table and eid of employee table, and filter out the data insales and employeethat…

Continue

The computing power of SQL for mass structured data is complete, that is to say, it is impossible to find anything that SQL cannot compute. But its support layer is too low, which can lead to over-elaborate operation in practical application.…

Continue

1. What OLAP We Need Indeed?

Category: Model

OLAP is an important constituent part of BI(business intelligence).

Understood literally, OLAP is online analytical processing, that is, users conduct analytical operation on real-time business data.

But, currently the concept of OLAP is seriously narrowed, and only it refers to operations such as conducting drilling,…

Continue

I have a 5-20K USD budget to get a tool (w/wo dedicated hardware), including training for 2 people, to prepare (clean, merge, etc...) and summarize (samples, grouping/aggregations, etc) large data sets (over 5GBs, over 4 million rows).

I need an efficient solution (fast data processing and fast to learn), and definitely easy to use. I would have done it with excel if excel could handle such large data files.

After preparing and summarizing the data, I'll use excel pivot tables…

Continue

I attendedAngelHack Sydney recently during the month of May.

AngelHack is a hackathon where developers and entrepreneurs come together to prototype a viable business idea within 24 hours.

The project that I worked on was called "DropQuery". The basic concept is this.

* You have some data files - CSV, XLS, XML

* You want to quickly query it.

I talked to a few people at the…

Continue

 

See: http://bit.ly/RWBoCk…

Continue

Java is the most widely used programming language with an outstanding architecture. It is the top preferred language to develop the enterprise application. However, Java is not fit for the mass data computation. If encountering the computation that is too complex to be represented in a single SQL statement or it is not allowed to add stored procedures to database, then drawbacks of Java would be highlighted.

Hereby is a case on how to deal with above questions with…

Continue

I have been building data mining solutions within relational databases. Almost every process is done within the database environment. We enjoy the functions provided by databases: security, scalability, analytic functions, manageability, easy model deployment, SQL, etc. Since data mining is done on the server side, the crash of my laptop hard drive has minimum impact on my work (it happened twice in the last two years).