The number of "almost orthogonal" concepts that can be represented in a neural network is exponen..., Sonic AI
“The number of "almost orthogonal" concepts that can be represented in a neural network is exponential in the number of neurons, based on principles like the Johnson-Lindenstrauss lemma.”