A Data Science Central Community
Here is our new selection of articles and resources recently posted:Continue
Added by Vincent Granville on December 15, 2017 at 3:30pm — No Comments
Summary: Here are our 6 predictions for data science, machine learning, and AI for 2018. Some are fast track and potentially disruptive, some take the hype off over blown claims and set realistic expectations for the coming year.
It’s that time of year again when we do a look back in order to offer a look forward. What trends will speed up, what things will actually happen, and what things won’t in the coming year for data science, machine…Continue
Added by Vincent Granville on December 14, 2017 at 3:00pm — No Comments
Here is our selection of featured articles recently posted:
Added by Vincent Granville on December 9, 2017 at 1:42pm — No Comments
Summary: As a profession we do a pretty poor job of agreeing on good naming conventions for really important parts of our professional lives. “Machine Learning” is just the most recent case in point. It’s had a perfectly good definition for a very long time, but now the deep learning folks are trying to hijack the term. Come on folks. Let’s make up our minds.
As a profession we do a pretty poor job of agreeing on good naming conventions for…Continue
Added by Vincent Granville on December 7, 2017 at 2:41pm — No Comments
Here is our selection of featured articles and resources posted recently:
Added by Vincent Granville on December 2, 2017 at 1:47pm — No Comments
Here is our selection of featured articles and resources recently published:
Added by Vincent Granville on November 25, 2017 at 4:46pm — No Comments
In some applications, using the standard precision in your programming language of choice, may not be enough, and can lead to disastrous errors. In some cases, you work with a library that is supposed to provide very high precision, when in fact the library in question does not work as advertised. In some cases, lack of precision results in obvious problems that are easy to spot, and in some cases, everything seems to be working fine and you are not aware that your simulations are completely…Continue
Added by Vincent Granville on November 19, 2017 at 9:30am — No Comments
Here is our selection of featured articles and resources posted in the last few days:
Added by Vincent Granville on November 18, 2017 at 10:00am — No Comments
Here we discuss an application of HPC (not high performance computing, instead high precision computing, which is a special case of HPC) applied to dynamical systems such as the logistic map in chaos theory. defined as X(k) = 4 X(k) (1 - X(k-1)).
For all these systems, the loss of precision propagates exponentially, to the point that after 50 iterations, all generated values are completely wrong. Tons of articles have been written on this subject - none of them acknowledging the…Continue
Added by Vincent Granville on November 13, 2017 at 7:00pm — No Comments
Here is our selection of featured articles and resources posted in the last few days:Continue
Added by Vincent Granville on November 11, 2017 at 4:55pm — No Comments
Summary: This is the first in a series about Chatbots. In this first installment we cover the basics including their brief technological history, uses, basic design choices, and where deep learning comes into play. In subsequent articles we’ll describe in more detail about how they are actually programmed and best practice dos and don’ts.…Continue
Added by Vincent Granville on November 8, 2017 at 1:30pm — No Comments
Data Science Central (DSC) is excited to announce our competition to solve a new, interesting problem in statistical science, pertaining to stochastic processes. DSC members are invited and encouraged, to submit a theoretical solution or an application to real life problems, including but not limited to fintech, operations research, statistical science, computer science, economics, engineering, social, actuarial, biological or physical sciences.
The statistical process central to this…Continue
Added by Vincent Granville on November 8, 2017 at 12:00pm — No Comments
In this post, we learn about building a basic search engine or document retrieval system using Vector space model. This use case is widely used in information retrieval systems. Given a set of documents and search term(s)/query we need to retrieve relevant documents that are similar to the search query.
The problem statement explained above is represented as in below image. …Continue
Added by suresh kumar Gorakala on November 7, 2017 at 6:30am — No Comments
Here we describe well-known chaotic sequences, including new generalizations, with application to random number generation, highly non-linear auto-regressive models for times series, simulation, random permutations, and the use of big numbers (libraries available in programming languages to work with numbers with hundreds of decimals) as standard computer precision almost always produces completely erroneous results after a few iterations -- a fact rarely if ever mentioned in the scientific…Continue
Added by Vincent Granville on November 6, 2017 at 8:30pm — No Comments
Full title: Trend Analysis of Fragmented Time Series: Hypothesis Testing Based Adaptive Spline Filtering Method.
Missing data present significant challenges to trend analysis of time series. Straightforward approaches consisting of supplementing missing data with constant or zero values or with linear trends can severely degrade the quality of the trend analysis, which significantly reduces the reliability of the…Continue
Added by Vincent Granville on November 3, 2017 at 10:23am — No Comments
There is no need to get confused with multiple linear regression, generalized linear model or general linear methods. The general linear model or multivariate regression model is a statistical linear model and is written as Y = XB + U.
Usually, a linear model includes a number of different statistical models such as ANOVA, ANCOVA, MANOVA, MANCOVA, ordinary linear regression, t-test and F-test. The GLM is a generalization of multiple…
The logistic map is the most basic recurrence formula exhibiting various levels of chaos depending on its parameter. It has been used in population demographics to model chaotic behavior. Here we explore this model in the context of randomness simulation, and revisit a bizarre non-periodic random number generator discovered 70 years ago, based on the logistic map equation. We then discuss flaws and strengths in widely used random number generators, as well as how to reverse-engineer…Continue
Added by Vincent Granville on October 30, 2017 at 12:00pm — No Comments
This famous statement -- the six degrees of separation -- claims that there is at most 6 degrees of separation between you and anyone else on Earth. Here we feature a simple algorithm that simulates how we are connected, and indeed confirms the claim. We also explain how it applies to web crawlers: Any web page is connected to any other web page by a path of 6 links at most.
The algorithm below is rudimentary and can be used for simulation purposes by any programmer: It does not even…Continue
Added by Vincent Granville on October 25, 2017 at 11:43am — No Comments
Here is our selection of featured articles and resources posted recently:Continue
Added by Vincent Granville on October 22, 2017 at 5:19pm — No Comments
Non-traditional strategies for mid-career switch to Data Science and AI
In this post, I explore strategies to switch to Data Science mid-career. This switch is not easy, but based on the experience of many who I have taught/mentored/recruited – it is possible. Most people consider PhD/MooC etc for switching their career to Data Science. But here, I will explore some non-traditional/unorthodox ways of switching to Data Science. …Continue
Added by Vincent Granville on October 20, 2017 at 12:10pm — No Comments