From Animation to Intuition

Visualizing Optimization Trajectory of Neural Nets

Flying over Storm King Art Center in New York, Summer 2018. Photo by me on DJI Mavic Air

Update: I have ported the code to a Python package here. Feel free to experiment and produce similar plots like the ones in this post!

In the previous post, I showed some animated plots for the training process of linear regression and logistic regression. Developing a good “feel” of how they “learn” is…