Author Archives: jamesdmccaffrey

Xenobots: Tiny Bio-Robots Designed Using Machine Learning

I ran into a truly fascinating research paper recently that described “xenobots”. Briefly, a xenobot is a tiny (about 4 one-hundredths of an inch in diameter — about the size of a grain of sand) programmable bio-robot made from frog … Continue reading

Posted in Machine Learning | 1 Comment

Reading IMDB Movie Review Dataset Files

I was working on the well-known IMDB movie review sentiment analysis problem The goal is to create a machine learning model that accepts the text of a movie review and predicts if the review is positive (class 1) or negative … Continue reading

Posted in Machine Learning | Leave a comment

The Best Algorithm I’ve Discovered for Positive and Unlabeled Learning (PUL)

A positive and unlabeled learning (PUL) problem occurs when a machine learning set of training data has only a few positive (class 1) labeled items and many unlabeled (could be either negative class 0, or positive class 1) items. For … Continue reading

Posted in Machine Learning | Leave a comment

A Predict-Next-Word Example Using Hugging Face and GPT-2

Deep neural transformer architecture (TA) systems can be considered the successors to LSTM (long, short-term memory) networks. TAs have revolutionized the field of natural language processing (NLP). Unfortunately, TA systems are extremely complicated and implementing a TA system from scratch … Continue reading

Posted in Machine Learning | Leave a comment

NFL 2021 Week 7 Predictions – Zoltar Likes the Raiders to Cover Against the Eagles

Zoltar is my NFL football prediction computer program. It uses reinforcement learning and a neural network. Here are Zoltar’s predictions for week #7 of the 2021 season. It usually takes Zoltar about four weeks to hit his stride and takes … Continue reading

Posted in Zoltar | Leave a comment

The Effects of COVID-19 on Business Collaboration on Pure AI

I contributed to an article titled “The Effects of COVID-19 on Business Collaboration” in the October 2021 edition of the online Pure AI web site. See https://pureai.com/articles/2021/10/04/covid-business-collaboration.aspx. A group of Microsoft analysts investigated how work collaboration patterns at their company … Continue reading

Posted in Miscellaneous | Leave a comment

Principal Component Analysis (PCA) From Scratch vs. Scikit

A few days ago I coded up a demo of anomaly detection using principal component analysis (PCA) reconstruction error. I implemented the PCA functionality — computation of the transformed data, the principal components, and the variance explained by each component … Continue reading

Posted in Machine Learning | Leave a comment

Ordinal Classification Using PyTorch in Visual Studio Magazine

I wrote an article titled “Ordinal Classification Using PyTorch” in the October 2021 edition of the Microsoft Visual Studio Magazine. See https://visualstudiomagazine.com/articles/2021/10/04/ordinal-classification-pytorch.aspx. The goal of an ordinal classification problem is to predict a discrete value, where the set of possible … Continue reading

Posted in PyTorch | Leave a comment

Nucleus Sampling for Natural Language Processing

I ran into an interesting idea called nucleus sampling, also called top-p sampling. Nucleus sampling is used for natural language processing (NLP) next-word prediction. Suppose you have a sentence that starts with “I got up and ran to the . … Continue reading

Posted in Machine Learning | Leave a comment

NFL 2021 Week 6 Predictions – Zoltar Likes Underdogs

Zoltar is my NFL football prediction computer program. It uses reinforcement learning and a neural network. Here are Zoltar’s predictions for week #6 of the 2021 season. It usually takes Zoltar about four weeks to hit his stride and takes … Continue reading

Posted in Zoltar | Leave a comment