The links between neuroscience and machine learning are currently receiving a lot of attention, but interactions between these fields have a long history.  I will discuss the relationship between the perceptron, a classic early machine learning network, and neural circuits in the cerebellum and in the mushroom body, a learning and memory center of the fly brain.