Category Archives: Machine Learning

“Microsoft Researchers Use Neural Transformer Architecture for Cybersecurity” on the Pure AI Web Site

I contributed to an article titled “Microsoft Researchers Use Neural Transformer Architecture for Cybersecurity” on the October 2022 edition of the Pure AI web site. See https://pureai.com/articles/2022/10/03/neural-transformer-architecture.aspx. The article describes two new techniques for cybersecurity that use deep neural transformer … Continue reading

Posted in Machine Learning | Leave a comment

An Example of Sensitivity Analysis for a PyTorch Model

In sensitivity analysis, you examine the effects of changing input values to a machine learning prediction model. The classic example is looking at a model that predicts the credit worthiness of a loan applicant based on things like income, debt, … Continue reading

Posted in Machine Learning, PyTorch | Leave a comment

How to Encode Ordinal Predictor Values for a Neural Network

If you have categorical (also called nominal) predictor data, you can encode it using one-hot encoding. For example, a predictor variable of color with possible values (red, blue, green) can be encoded as red = 1 0 0, blue = … Continue reading

Posted in Machine Learning, PyTorch | Leave a comment

Why I Became Disillusioned With Semi-Supervised Learning

In semi-supervised learning, you have data where only a few items have labels but most data items are not labeled. For example, you might have a data for 1,000 hospital patients (age, sex, blood pressure, etc.) that have been tested … Continue reading

Posted in Machine Learning | Leave a comment

“Researchers Make Computer Chess Programs More Human” on the Pure AI Web Site

I contributed to an article titled “Researchers Make Computer Chess Programs More Human” on the September 2022 edition of the Pure AI web site. See https://pureai.com/articles/2022/09/06/more-human-chess-programs.aspx. In some machine learning scenarios, it’s useful to make a prediction system that is … Continue reading

Posted in Machine Learning | Leave a comment

The Maia Computer Chess Program

I came across an interesting research project named Maia. Maia is a computer chess program that was designed to play more like a human than conventional chess programs. See https://www.microsoft.com/en-us/research/project/project-maia/. There is a long and fascinating history of chess, computer … Continue reading

Posted in Machine Learning | Leave a comment

ANOVA Using C# in Visual Studio Magazine

I wrote an article titled “ANOVA Using C#” in the August 2022 edition of Microsoft Visual Studio Magazine. See https://visualstudiomagazine.com/articles/2022/08/17/anova-csharp.aspx. Analysis of variance (ANOVA) is a classical statistics technique that’s used to infer if the means (averages) of three or … Continue reading

Posted in Machine Learning | Leave a comment

Researchers Demonstrate Transformer Architecture-Based Anomaly Detection for Cybersecurity on the Pure AI Web Site

I contributed to an article titled “Researchers Demonstrate Transformer Architecture-Based Anomaly Detection for Cybersecurity” on the Pure AI web site. See https://pureai.com/articles/2022/08/02/ta-anomaly-detection.aspx. Researchers at Microsoft have demonstrated a new technique for anomaly detection. The technique is based on deep neural … Continue reading

Posted in Machine Learning | Leave a comment

The Difference Between Encoding, Embedding, and Latent Representation — in My World

Bottom line: In the machine learning projects I work on, an encoding converts categorical data to numeric data (example: one-hot encoding where “red” = [0 1 0 0]), an embedding converts an integer word ID to a vector (ex: “the” … Continue reading

Posted in Machine Learning | Leave a comment

Yes, TensorFlow is Dead

July 2022: the TensorFlow neural network code library is dead. OK, that statement is somewhat of a provocative exaggeration but bear with me. It’s impossible to get hard data about the usage of TensorFlow (and Keras) relative to the other … Continue reading

Posted in Keras, Machine Learning, PyTorch | 2 Comments