The number of 'almost orthogonal' concepts that can be represented in a neural network is exponen..., Sonic AI
“The number of 'almost orthogonal' concepts that can be represented in a neural network is exponential in the number of neurons, a principle related to the Johnson-Lindenstrauss lemma.”