In toy models, as features become sparser, a neural network can represent more features than it h..., Sonic AI
“In toy models, as features become sparser, a neural network can represent more features than it has dimensions, with experiments showing the ability to represent 5 features in a 2-dimensional space.”