Category Archives: Machine Learning

I Give a Talk on Back-Propagation

I recently gave a lecture on back-propagation. I’ve spoken on this topic before and it’s always a challenge because back-propagation has many interrelated ideas. Even defining back-propagation is quite tricky because you can think of it in many ways. Back-propagation … Continue reading

Posted in Machine Learning | Leave a comment

IMDB Movie Review Sentiment Analysis using Keras

The IMDB movie review dataset consists of a total of 50,000 movie reviews from ordinary people. Reviews are simple text and can be positive (7 stars or more) or negative (4 stars or fewer). The Keras neural network library documentation … Continue reading

Posted in Keras, Machine Learning | Leave a comment

Introduction to Keras with TensorFlow

I wrote an article titled “Introduction to Keras with TensorFlow” in the May 2018 issue of Visual Studio Magazine. See https://visualstudiomagazine.com/articles/2018/05/01/inroduction-to-keras.aspx. It’s possible to create neural networks from raw code. But there are many code libraries you can use to … Continue reading

Posted in Keras, Machine Learning | Leave a comment

Avoiding an Exception when Calculating Softmax

The softmax of a set of values returns a set of values that sum to 1.0 so they can be interpreted as probabilities. The softmax function is one of the fundamental tools for machine learning. Suppose you have some neural … Continue reading

Posted in Machine Learning | Leave a comment

A Quick Look at the Embedded Learning Library (ELL)

The Embedded Learning Library (ELL) is an open source project. The goal is to create a cross compiler for machine learning models. Briefly, machine learning models, such as those for image recognition, are typically very large in terms of memory. … Continue reading

Posted in CNTK, Machine Learning | Leave a comment

Latent Dirichlet Allocation – What is It?

Latent Dirichlet allocation (LDA) is a machine learning technique that is most often used to analyze the topics in a set of documents. The problem scenario is best explained by a concrete example. Suppose you have 100 documents, where each … Continue reading

Posted in Machine Learning | Leave a comment

Neural Network Library Dropout Layers

Until quite recently, neural network libraries like TensorFlow and CNTK didn’t exist, so if you wanted to create a neural network, you’d have to do so by writing raw code using C/C++ or C# or Java or similar. In those … Continue reading

Posted in Machine Learning | 1 Comment