Articles

I have used synthetic data sets many times for simulation purposes, most recently in my articles Six degrees of Separations between any two Datasets and How to Lie… Read More »Surprising Uses of Synthetic Random Data Sets

I have used synthetic data sets many times for simulation purposes, most recently in my articles Six degrees of Separations between any two Datasets and… Read More »Surprising Uses of Synthetic Random Data Sets

Everyone’s talking data. Data is the key to unlocking insight, the secret sauce that will help you get predictive, the fuel for business intelligence. The… Read More »Want to be data-driven? Better start thinking about DataOps

Probably the worst error is thinking there is a correlation when that correlation is purely artificial. Take a data set with 100,000 variables, say with… Read More »Common Errors in Machine Learning due to Poor Statistics Knowledge

Please join me in Las Vegas at Hitachi Vantara’s NEXT 2019 in October where I’ll be talking about data lake “second surgeries” – viva, baby. Data… Read More »Wrestling with Data Science “Second Surgeries”? Try MVE!

In addition to being the sexiest job of the twenty-first century, Data Science is new electricity as quoted by Andrew Ng. A lot of professionals from various… Read More »Exploratory Data Analysis with Python

After posting my most recent blog using census data to illustrate handling “large” dataframes in R exploiting fst and feather file formats, I realized I could have taken the… Read More »Writing/Reading Large R dataframes/data.tables — Addendum.

Many statistics, such as correlations or R-squared, depend on the sample size, making it difficult to compare values computed on two data sets of different… Read More »Simple Trick to Normalize Correlations, R-squared, and so on