Subscribe to DSC Newsletter

Featured Blog Posts (1,476)

High Precision Computing in Python or R

Here we discuss an application of HPC (not high performance computing, instead high precision computing, which is a special case of HPC)  applied to dynamical systems such as  the logistic map in chaos theory. defined as X(k) = 4 X(k) (1 - X(k-1)). 

For all these systems, the loss of precision propagates exponentially, to the point that after 50 iterations, all generated values are completely wrong. Tons of articles have been written on this subject - none of them acknowledging the…

Continue

Added by Vincent Granville on November 13, 2017 at 7:00pm — No Comments

Linear Models Don’t have to Fit Exactly for P-Values To Be Accurate, Right, and Useful

There is no need to get confused with multiple linear regression, generalized linear model or general linear methods. The general linear model or multivariate regression model is a statistical linear model and is written as Y = XB + U.





Usually, a linear model includes a number of different statistical models such as ANOVA, ANCOVA, MANOVA, MANCOVA, ordinary linear regression, t-test and F-test. The GLM is a generalization of multiple…

Continue

Added by Chirag Shivalker on November 2, 2017 at 11:30pm — 1 Comment

Information Retrieval Document Search Engine in R

Introduction:

In this post, we learn about building a basic search engine or document retrieval system using Vector space model. This use case is widely used in information retrieval systems. Given a set of documents and search term(s)/query we need to retrieve relevant documents that are similar to the search query. 

Problem statement:

The problem statement explained above is represented as in below image. …

Continue

Added by suresh kumar Gorakala on November 7, 2017 at 6:30am — No Comments

Fascinating Time Series with Cool Applications

Here we describe well-known chaotic sequences, including new generalizations, with application to random number generation, highly non-linear auto-regressive models for times series, simulation, random permutations, and the use of big numbers (libraries available in programming languages to work with numbers with hundreds of decimals) as standard computer precision almost always produces completely erroneous results after a few iterations  -- a fact rarely if ever mentioned in the scientific…

Continue

Added by Vincent Granville on November 6, 2017 at 8:30pm — No Comments

Interesting Problem: Self-correcting Random Walks

Section 3 was added on October 11. Section 4 was added on October 19.  A $2,000 award is offered to solve any of the open questions, click here for details

This is another off-the-beaten-path problem, one that you won't find in textbooks. You can solve it using data science methods (my approach) but the mathematician with some…

Continue

Added by Vincent Granville on October 4, 2017 at 2:00pm — 5 Comments

Book on Computer Programming

Data scientists use a range of tools in their work and some of these eventually require programming. This book, titled The Art and Craft of Computer Programming, is a guide to computer programming. It does not focus on a specific programming language, but instead contains the essential material from a first year Computer Science course. The book is available from Amazon.com.…

Continue

Added by Mark McIlroy on October 19, 2017 at 8:00pm — 1 Comment

What Kind of OLAP Do We Really Need?

The narrow-sensed OLAP

OLAP is part and parcel of a BI application. As the name suggests, the word is an acronym for online analytical processing. Users, frontline employees, to be precise, are responsible for performing various types of data processing online.  

But, the concept of OLAP tends to be used in a very narrow sense. It has almost become an equivalence of multidimensional analysis. Based on a prebuilt data cubic, the analysis performs summarization…

Continue

Added by JIANG Buxing on October 9, 2017 at 4:00am — No Comments

9 Off-the-beaten-path Statistical Science Topics with Interesting Applications

You will find here nine interesting topics that you won't learn in college classes. Most have interesting applications in business and elsewhere. They are not especially difficult, and I explain them in simple English. Yet they are not part of the traditional statistical curriculum, and even many data scientists with a PhD degree have not heard about some of these concepts.…

Continue

Added by Vincent Granville on October 2, 2017 at 1:43pm — No Comments

Audience is The Future Business Model, Data Analytics Can Improves It

Companies and enterprises are facing a daily grind, while they are also required to see to it that their customers are happy & satisfied, operations is efficient and employees are satisfied; and all this makes running the business – a real challenge. “Audience is the new business model”, and if any organization is struggling miserably to communicate with customers or their audience, there certainly is a negative impact of it across the business plan,…

Continue

Added by Chirag Shivalker on September 26, 2017 at 12:30pm — No Comments

Why Analytics Projects Fail – And It’s Not The Analytics!

Being in a highly technical, complex field it is easy to sometimes lose the ‘human aspect’ of the solutions we are developing. We focus on apply edge computing concepts, or whether a seasonality model works better for our predictive accuracy than some other approach. Don't get me wrong, these are all important activities. However, in working with many firms in developing, deploying and supporting advanced analytics solutions, particularly in the domain of the Industrial IoT space, it’s often…

Continue

Added by Ed Crowley on September 26, 2017 at 3:00pm — No Comments

Can you solve these mathematical / statistical problems?

I recently posted an article featuring a non traditional approach to find large prime numbers. The research section of this article offers interesting challenges, both for data scientists interested in mathematics, and for mathematicians interested in data science and big data. My approach is data, pattern recognition, and machine learning heavy. Here is the introduction:

Large prime numbers have been a topic of considerable research, for its own mathematical beauty, as well as to…

Continue

Added by Vincent Granville on September 21, 2017 at 9:00pm — No Comments

Building Convolutional Neural Networks with Tensorflow

In the past year I have also worked with Deep Learning techniques, and I would like to share with you how to make and train a Convolutional Neural Network from scratch, using tensorflow. Later on we can use this knowledge as a building block to make interesting Deep Learning applications.

The pictures here are from the full article. Source code is also provided.…

Continue

Added by ahmet taspinar on September 7, 2017 at 7:30am — No Comments

A Day in the life of an Analyst

A typical day in the life of an Analyst

An Analyst works on varied projects with multiple deliverables and varied duties depending on the business objectives.

However there are some tasks that can be easily classified as “common everyday duties” in a “typical work day of a business analyst”

Clarification and…

Continue

Added by Ivy Pro School on September 3, 2017 at 2:00pm — No Comments

Overpromising and Underperforming: Understanding and Evaluating Self-service BI Tools

From the OLAP concept in earlier years to the agile BI over the last few years, BI vendors never stop advertising the self-service capability, claiming that business users will be able to perform analytics by themselves. Since there are strong self-service needs among users, the two really hit it off and it is very likely that a quick deal is made. The question is - does a BI product’s self-service functionality enable a truly flexible data analytics by business users?

There isn’t a…

Continue

Added by JIANG Buxing on August 31, 2017 at 12:00am — 1 Comment

Curious Mathematical Object: Hyperlogarithms

Logarithms turn a product of numbers into a sum of numbers: log(xy) = log(x) + log(y). Hyperlogarithms generalize the concept as follows: Hlog(XY) = Hlog(X) + Hlog(y), where X and Y are any kind of objects, and the product and sum are replaced by operators in some arbitrary space. …

Continue

Added by Vincent Granville on August 16, 2017 at 12:00pm — 1 Comment

Fighting eCommerce fraud with graph technology



ECommerce fraud is growing quickly, creating new challenges in terms of prevention and detection. As merchants gather more and more information about customers and their behaviors, the key element in the fight against fraud is now to draw on the connections within the data collected to uncover fraudulent behaviors. In this post we explain why and how graph technologies are crucial in the detection of eCommerce fraud.…

Continue

Added by Elise Devaux on August 9, 2017 at 9:30am — No Comments

Type I and Type II Errors in One Picture

This picture speaks more than words. It explains the concept or false positive and false negative, that is, what is referred to by statisticians as Type I and Type II errors.

Other great pictures summarizing data science and statistical concepts, can be found…

Continue

Added by Vincent Granville on August 10, 2017 at 5:17pm — No Comments

Capturing Low-Probability, High-Impact Events 'Black Swans' in Economic and Financial Models

Capturing Low-Probability, High-Impact Events 'Black Swans' in Economic and Financial Models

Jamilu Auwalu Adamu , Lecturer, Nigeria

Incorporation of Fat - Tailed Effects of the Underlying Assets Probability Distribution using Advanced Stressed Methods.



Capturing the effects of Low-Probability, High-Impact "Black Swans" in the existing stochastic and deterministic models is tremendously…

Continue

Added by Jamilu Auwalu Adamu on July 31, 2017 at 8:30am — No Comments

Introducing User Behavioral Analysis in the Risk Process

Many years ago when I was entering the intelligence community, I attended a class in Virginia where the instructor opened the session with a test that I will never forget and that I have applied to almost every analytic task in my career. At the beginning of the class we were shown a ten-minute video of grand central station at rush hour with tens of thousands of people and were asked if we could find a single pickpocket in the crowd by the end of the video.  At the end of ten minutes no…
Continue

Added by Andrew Marane on July 31, 2017 at 11:30am — No Comments

Featured Monthly Archives

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

Follow Us

On Data Science Central

On DataViz

On Hadoop

© 2017   AnalyticBridge.com is a subsidiary and dedicated channel of Data Science Central LLC   Powered by

Badges  |  Report an Issue  |  Terms of Service