If you team is evaluating privacy-preserving synthetic data, three factors will usually come into consideration:

• Does synthetic data solve my problem?
• Does the technology fit my requirements?
• What’s the Return on Investment (ROI) of implementing privacy-preserving synthetic data?

This post focuses on the last factor: the value of adding synthetic data generation capabilities to your team’s…

This articles discusses some of the data challenges that the healthcare industry faces. It also revisits how Statice's collaboration with the leading health organization Roche to test the use of synthetic medical data for clinical research and what opportunities we see from this.

The data challenges in the healthcare industry 

Maybe more than for other industries, research and innovation…

Given n observations x1, ..., xn, the generalized mean (also called power mean) is defined as 

The case p = 1 corresponds to the traditional arithmetic mean,…

10 use-cases for privacy-preserving synthetic data

Fast-evolving data protection laws are constantly reshaping the data landscape. The organizational ability to overcome sensitive data usage restrictions while safeguarding customer privacy will be a key driver of tomorrow’s successful businesses. This blog presents ten concrete applications for privacy-preserving synthetic…

This blog takes a closer look at the concept of privacy-preserving synthetic data. It answers the question “what is synthetic data” and looks at the origin of synthetic data in the context of data privacy. It also presents one way of generating privacy-preserving synthetic data and its benefits for organizations.…

Bernouilli lattice processes may be one of the simplest examples of point processes, and can be used as an introduction to learn about more complex spatial processes that rely on advanced measure theory for their definition. In this article, we show the differences and analogies between Bernouilli lattice processes on the standard rectangular or hexagonal grid, and the Poisson process, including convergence of discrete lattice processes to continuous Poisson process, mainly in two…

Summary:  Explaining data science to a non-data scientist isn’t as easy as it sounds.  You may know a lot about math, tools, techniques, data, and computer architecture but the question is how do you explain this briefly without getting buried in the detail.  You might try this approach.

We’ve all been…

Product of two large primes are at the core of many encryption algorithms, as factoring the product is very hard for numbers with a few hundred digits. The two prime factors are associated with the encryption keys (public and private keys). Here we describe a new approach to factoring a big number that is the product of two primes of roughly the same size. It is designed especially to handle this problem and identify flaws in encryption algorithms.  …

We discuss a simple trick to significantly accelerate the convergence of an algorithm when the error term decreases in absolute value over successive iterations, with the error term oscillating (not necessarily periodically) between positive and negative values. 

We first illustrate the technique on a well known and simple case: the computation of log 2 using its well know, slow-converging series. We then discuss a very interesting and more complex case, before finally focusing on a…

One of the main challenges in data science projects is managing stakeholder expectations. Often those in the business will have little idea of the complexity and timescales of seemingly simple tasks.

Sourcing Data

Consider sourcing data. In some organisations, with a non-collaborative culture, something as simple as getting a file of data from IT can take weeks. Add on time to check the data, spend time with someone to explain it, handle revisions and…

The methodology described here has broad applications, leading to new statistical tests, new type of ANOVA (analysis of variance), improved design of experiments, interesting fractional factorial designs, a better understanding of irrational numbers leading to cryptography, gaming and Fintech applications, and high quality random numbers generators (and when you really need them). It also features exact arithmetic / high performance computing and distributed algorithms to compute millions of…

Summary: The Gartner Magic Quadrant for Data Science and Machine Learning Platforms is just out the big news is how much more capable all the platforms have become.  Of course there are also some interesting winner and loser stories.

The Gartner Magic Quadrant for Data Science and Machine Learning Platforms is just out for 2020.  The really big news is how many excellent choices are now available.  In a remarkable move, the whole field…

In this notebook, we try to predict the positive (label 1) or negative (label 0) sentiment of the sentence. We use the UCI Sentiment Labelled Sentences Data Set.

Sentiment analysis is very useful in many areas. For example, it can be used for internet conversations moderation. Also, it is possible to predict ratings that users can assign to a certain product (food, household appliances, hotels,…

By 2022, Gartner predicts that 90% of corporate strategies will explicitly mention information as a critical enterprise asset and analytics as an essential competency.



“Increasingly, leading and thriving organizations in every segment are wielding data and analytics as a competitive weapon, operational accelerant, and innovation catalyst,” notes analysts in …

Probably the worst error is thinking there is a correlation when that correlation is purely artificial. Take a data set with 100,000 variables, say with 10 observations. Compute all the (99,999 * 100,000) / 2 cross-correlations. You are almost guaranteed to find one above 0.999. This is best illustrated in may article How to Lie with P-values (also discussing…

Fermat's last conjecture has puzzled mathematicians for 300 years, and was eventually proved only recently. In this note, I propose a generalization, that could actually lead to a much simpler proof and a more powerful result with broader applications, including to solve numerous similar equations. As usual, my research involves a significant amount of computations and experimental math, as an exploratory step before stating new conjectures, and eventually trying to prove them. The…

Hundreds of programming languages dominate the data science and statistics market: Python, R, SAS and SQL are standouts. If you're looking to branch out and add a new programming language to your skill set, which one should you learn? This one picture breaks down the differences between the four languages.…