Machine learningML & AI Methods

Topological properties of basins of attraction and expressiveness of width bounded neural networks

A study has shown that autoencoders trained with standard SGD methods create bounded basins of attraction around their training data, answering a previous question and providing insight into why certain neural network functions are not dense in continuous function spaces.