2
$\begingroup$

I am looking for simple artificial neural networks that may perform the following serializing task.

Consider two identical Hopfield networks, one being at rest, the other being in a stable state of acitivity (a subset of its neurons firing synchronously).

The task is to connect these two networks to a serializer and a deserializer network with the serializer passing only a sequence of signals to the deserializer (along one single line) such that the stable state of the first network will be reconstructed in the second network, just by the specific sequence of signals.

Can be seen at a glance that this task cannot be solved with (de)serializers made out of McCulloch-Pitts neurons alone?

If it can not be solved: which kind of neurons would be needed?

If it can be solved: how (in the most simple way)? (For simplicity's sake you may consider two Hopfield networks of only three MP neurons each.)

enter image description here

Note, that not the total of $n$ (e.g. 3) bits (to describe completely the state of network A) has to be transferred (because of the reconstruction abilities of the identical network B). The other way around: network B might reach the copied state earlier than the end of message arrived.

Improve this question
$\endgroup$
5
  • 1
    $\begingroup$ Given that Hopfield networks are content-addressable memories would it be acceptable for me to post an answer using a different form of content-addressable memory, such as a NEF/SPA associative memory? Additionally, why are you using a Hopfield network? May I ask what the greater context of this extremely interesting question is? $\endgroup$
    – Seanny123
    Commented Sep 14, 2017 at 16:51
  • $\begingroup$ Of course it would. And I used Hopfield networks only because I know them quite well (having attractors and the like). Concerning the greater context: I'll do my best to provide it in an addendum. $\endgroup$
    – Hans-Peter Stricker
    Commented Sep 14, 2017 at 17:01
  • $\begingroup$ Hopfield networks consist of McCulloch-Pitts neurons (which are good approximations of integrate-and-fire neurons), they are content-addressable memories, they have stable attractors,... That's why I started with them. $\endgroup$
    – Hans-Peter Stricker
    Commented Sep 14, 2017 at 17:13
  • $\begingroup$ To distill your question further, are you just trying to transfer knowledge between two content-addressable memories or are you also trying to change the state? $\endgroup$
    – Seanny123
    Commented Sep 14, 2017 at 23:43
  • $\begingroup$ After having understood how the former works I definitely would also try the latter. But starting with transfer seems more tractable, doesn't it. $\endgroup$
    – Hans-Peter Stricker
    Commented Sep 15, 2017 at 5:24

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.