3
$\begingroup$

I thank all the commenters for the valuable feedback. I'm trying to improve this question (which I had long ago -- omg I'm getting old).

Is there a way to simply derive the generalization bounds for the classical perceptron model? More specifically, how to derive the maximum number of patterns that a N-large perceptron can store? And in the case of an NxN network of neurons, how to derive the number of patterns (or memories) and their basins of attractions? Are there simple methods, other than the ones invoking replica theory, as it's done in Gardner's works?

More details:

I'm basically referring to the great work of Elizabeth Gardner in this matter. I find that her work is often overlooked in the field of neuroscience, arguably because it is too difficult to understand its mathematical derivation. Yet, her results are so fundamental that many in the field are aware of them.

I couldn't find anywhere a simple explanation of her derivation and the implications of her results, in a terminology that also undergrads could also understand. Of course, I couldn't come up with one myself either. I suppose "Field Theory for Dummies" applied to theoretical neuroscience is what I'm really asking for...

See: Gardner, E. "The space of interactions in neural network models." Journal of physics A: Mathematical and general 21.1 (1988): 257.

$\endgroup$

closed as unclear what you're asking by Seanny123, mfloren, Fil, Chris Rogers, Steven Jeuris Sep 21 '17 at 14:45

Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.

  • 1
    $\begingroup$ Title of your question is misleading. You mean the number of stable fixed points in a recurrent neural network? This is definitely not the classical perceptron model. $\endgroup$ – Memming Feb 9 '15 at 18:25
  • 1
    $\begingroup$ I agree with @Memming. Voted for closing the question since "Field Theory for Dummies" is too broad of a question for this site. Even an explanation of the whole paper would be out of scope. So fabioedoardoluigialberto, if you could specify your question in more detail, maybe even quoting equations or figures from the paper, your chances of getting help would substantially increase :) $\endgroup$ – awakenting Aug 8 '16 at 17:58
  • $\begingroup$ also, since you're mostly talking about the mathematical properties of neural networks, I'm convinced (once this question is narrowed down) that it would be more appropriate for cs.stackexchange.com $\endgroup$ – Seanny123 Aug 9 '16 at 12:56
  • $\begingroup$ Also, adding an actual question (ending with a question mark) might make things more clear. I realize a question is implied when you say "I couldn't find anywhere a simple explanation of her derivation and the implications of her results, in a terminology that also undergrads could also understand.", ... but writing a question might be a good exercise. ;) It might also make it more clear you are asking for quite a broad topic. Also consider narrowing it down as per the previous comments. $\endgroup$ – Steven Jeuris Sep 21 '17 at 14:44