Category Archives: Machine Learning

Data Anomaly Detection Using Farthest Centroid With C#

One evening while I was walking my dogs, I came up with an idea for a simple data anomaly detection algorithm. I call it farthest centroid anomaly detection. The idea is very simple. If you have a source dataset that … Continue reading

Posted in Machine Learning | Leave a comment

“Multi-Class Classification Using LightGBM” in Visual Studio Magazine

I wrote an article titled “Multi-Class Classification Using LightGBM” in the May 2024 edition of Microsoft Visual Studio Magazine. See https://visualstudiomagazine.com/Articles/2024/05/02/LightGBM-multi-class-classification.aspx. A multi-class classification problem is one where the goal is to predict a discrete variable that has three or … Continue reading

Posted in Machine Learning | Leave a comment

Data Anomaly Detection Using Principal Component Analysis (PCA) Reconstruction Error

One evening, while I was walking my two dogs, I thought about the possibility of looking for data anomalies by analyzing principal component analysis (PCA) reconstruction error. Bottom line: the technique works, but it just doesn’t feel right to me. … Continue reading

Posted in Machine Learning | Leave a comment

One-Shot Learning, Few-Shot Learning, Zero-Shot Learning, and Fine-Tuning

The terms one-shot learning, few-shot learning, zero-shot learning, and fine-tuning don’t have universally agreed-upon definitions. All four terms are kinds of “transfer learning” where the goal is to start with an existing model and use it on a new problem. … Continue reading

Posted in Machine Learning | Leave a comment

Time Series Regression Using a Standard Neural Network With C#

Time series regression (TSR) problems are very challenging. There are dozens of techniques — and the fact that there are so many techniques for TSR indicates that there’s no single best approach. There’s been quite a bit of recent research … Continue reading

Posted in Machine Learning | 1 Comment

Regression Example Using LightGBM (Light Gradient Boosting Machine)

I’ve been looking at the LightGBM (light gradient boosting machine) system lately. One morning before work, I figured I’d zap out a regression demo. LightGBM is a sophisticated tree-based system that can perform classification (multi-class and binary), regression, and ranking. … Continue reading

Posted in Machine Learning | Leave a comment

Clustering Mixed Categorical and Numeric Data Using k-Means With C#

Data clustering is the process of grouping data items together so that similar items are in the same group/cluster. For strictly numeric data, the k-means clustering technique is simplest, and the most commonly used. For non-numeric, i.e. categorical data, there … Continue reading

Posted in Machine Learning | Leave a comment

Data Anomaly Detection For Mixed Data Using a Self-Organizing Map (SOM) From Scratch JavaScript

Several days ago, I put together a demo of data anomaly detection for mixed numeric and categorical data using a self-organizing map (SOM), from scratch, using the C# language. Then, a few days later, I refactored the C# version to … Continue reading

Posted in JavaScript, Machine Learning | Leave a comment

Multi-Class Classification Example Using LightGBM (Light Gradient Boosting Machine)

Early one Sunday morning, while I was waiting for the dog path to dry off from the evening rain so that I could walk my mutts, I figured I’d take a look at multi-class classification using the LightGBM (light gradient … Continue reading

Posted in Machine Learning | Leave a comment

“Data Anomaly Detection Using a Neural Autoencoder with C#” in Visual Studio Magazine

I wrote an article titled “Data Anomaly Detection Using a Neural Autoencoder with C#” in the April 2024 edition of Microsoft Visual Studio Magazine. See https://visualstudiomagazine.com/Articles/2024/04/15/data-anomaly-detection.aspx. Data anomaly detection is the process of examining a set of source data to … Continue reading

Posted in Machine Learning | Leave a comment