Category Archives: Machine Learning

Experimenting with Neural Network L2 Regularization

Regularization is a standard technique used in neural network training. The most common form of regularization is called L2. The idea is to add the sum of squared (the “2” in “L2”) weight values to the error term during training. … Continue reading

Posted in Machine Learning | Leave a comment

Experimenting with Neural Network Dropout

Whenever I read about some sort of technology, no matter how clear the explanation is, I never feel that I fully understand the topic unless I can code a demo program. This is probably a character strength and weakness of … Continue reading

Posted in Machine Learning | Leave a comment

Factor Analysis using R

I wrote an article in the March 2017 issue of Visual Studio Magazine titled “Revealing Secrets with R and Factor Analysis”. See https://visualstudiomagazine.com/articles/2017/03/01/revealing-secrets-r-factor-statistics.aspx. Factor Analysis is a classical statistics technique that analyzes data to determine if some set of observed … Continue reading

Posted in Machine Learning, R Language | Leave a comment

March Madness and Machine Learning

As I write this blog post, I’m at the 2017 Visual Studio Live Conference in Las Vegas. By coincidence, the 2017 NCAA college basketball tournament (“March Madness”) started just a few minutes ago. I’ve always been fascinated by things related … Continue reading

Posted in Machine Learning | 2 Comments

Loading a Text File into a Python Matrix

My Python programming had gotten a bit rusty lately so I’ve been brushing up by doing short demo programs. In machine learning, a common task is to load a text file containing numbers into a matrix. So I wrote a … Continue reading

Posted in Machine Learning | Leave a comment

Neural Networks with Raw Python and NumPy

I’ve been brushing up on my Python programming language skills. One thing I like to do with any language is implement a simple feed-forward neural network. The code to create a neural network uses all the basic control structures and … Continue reading

Posted in Machine Learning

Python Matrices

I’ve been using the Python programming language increasingly often over the past few months, mostly because two powerful machine learning libraries — Google’s TensorFlow and Microsoft’s CNTK — have Python interfaces. For both tools, a solid knowledge of Python is … Continue reading

Posted in Machine Learning