15
Artificial neural networks (ANNs) are mathematical constructs, originally designed to approximate biological neurons. Each "neuron" is a relatively simple element --- for example, summing its inputs and applying a threshold to the result, to determine the output of that "neuron".
Several decades of research went into discovering how to build network ...
15
The widely quoted figure of "10% at a time" is actually overestimating simultaneous brain activity by up to an order of magnitude. As demonstrated by Lennie 2003 (Current Biology), the
number of neurons that can be substantially active concurrently
is possibly as small as 1% of the brain's neurons, due to the high metabolic cost of spiking. Generally, ...
12
It's a local rule. All that it means is that the connection between two neurons gets stronger if you use that specific connection more. The specific connection (the synapse) must be used though; it doesn't apply to two random neurons that aren't connected that happen to fire at the same time.
Hebbian learning is generic term for outcome; there are ...
12
I'd like to add to Chuck's excellent answer; the computational approach is very well-represented in neuroscience, and actually involves a large number of very heterogeneous methods. Thus, a very different set of neuroscientists and examples have sprung to mind for me.
To my mind, the best single example of the utility of a computational approach to ...
11
There are many neuroscientists who use the techniques of advanced mathematics and statistics to analyze actual neural data for patterns.
George Gerstein, who is now retired, has been a pioneer in applying "particle" methods in analyzing neuronal interactions. The originator of the Gravity transform, he used this tool to untangle some of the stochastic ...
11
I'm studying computer science at KIT (Karlsruhe Institute of Technology, Germany) specializing in Machine Learning and a minor in Mathematics. I am not a biologist.
An artificial neural network is basically a mathematical function. It is built from simple functions which have parameters (numbers) which get adjusted (learned). One example of such a function ...
10
Many parts of the fetus brain begin showing neural activity before the senses that feed them are sufficiently developed to provide actual sensory information. In other words, it is unlikely that spiking activity in the brain is initiated by the senses. Some of the cells that become sensory organs, however, often fire in very specific patterns similar to the ...
9
There is a passage in On intelligence about the differences between parallel processing in human versus computers :
From the dawn of the industrial revolution, people have viewed the
brain as some sort of machine. They knew there weren't gears and cogs
in the head, but it was the best metaphor they had. Somehow
information entered the brain and the ...
9
Humans actually exhibit both slow and fast learning and they have somewhat different properties. One distinction is between "declarative" memory (for example, facts like "tigers have stripes" or "Paris is the capital of France") and "procedural" learning (such as perceptuo-motor skills like riding a bike or playing a musical instrument). Declarative memory ...
9
To my knowledge, with respect to the context of the question, the first neural-like model of computations capable of learning – or, for that matter, computational model of neural processing and learning – has been put forward in McCulloch/Pitts (1943), as is also acknowledged in some of the texts about Turing's unorganized machines (›A-/B-type neural ...
9
Disclaimer: Quantifying the capacity of the human brain is quiet complex as you might imagine. And although in cognitive neuroscience we often compare the brain to computers this is not an exact comparison, in many ways the brain is far more complicated and encodes information in a very different way than the comparison of CPU processors and hard-drives. The ...
9
Biological Plausibility of Back-Prop
No, the algorithm of back-prop (BP) isn't biologically plausible. However, there are other means which involve propagating the error through multiple layers of neurons in a feed-forward network which are biologically plausible. But before we evaluate these substitutions, let's review why back-prop isn't biologically ...
8
The use of neural-networks in the cognitive sciences has been around since Turing. However, many of the networks common in connectionism suffer from a lack of biological plausibility. Of these abstract ones, even the ones that try to capture some properties of biological neural networks only do some metaphorically. See for instance the limitations of cascade ...
8
The human visual processing system receives input from the eyes, and then passes it through a number of areas of the brain that break it down, process it in various different ways, recombine it, and break it down again several times. I'm assuming this question is only about the visual cortex, general theories about how information might be broken down for ...
8
Answer
Yes, theoretically.
Now
According to my ongoing informal research, there are two sides of brain preservation innovation: 1) the preservation and mapping (building) the connectome; and 2) the reinstantiation of memories and/or creating consciousness from a connectome.
From http://www.brainpreservation.org/overview/:
[N]euroscience is now identifying ...
8
I've read evidence for single-neuron, two-neuron, and larger loops/cycles throughout the cortex, including intralaminar, interlaminar, and interareal neural loops. But it would take me far too long to back that statement up.
Instead, I offer a list of papers to get you started. I've read all these papers, and they all provide evidence for neural loops in ...
7
I think this recent paper fits your requirements. It considers biological plausibility by showing that the number of neurons required in the proposed method is within a reasonable size for the human brain, and dismisses a series of unreasonable models. Specifically, they create a neural network using the Neural Engineering Framework (NEF) and the Semantic ...
7
I think that your intuition about the lower "energy ratio" of spurious states explaining their greater susceptibility to unlearning might be correct.
In a Hopfield Network spurious states are activity patterns that have not been explicitly embedded in the synaptic matrix, but are nonetheless stable. They are in other words "unwanted" attractor states that, ...
7
One way the biological plausibility of an artificial neural network could be assessed is to look at how much a neural network abstracts away from the behavior of real neurons.
For instance, it is common in psychology and machine learning to use a sigmoidal activation function to determine the output of a node. If biological plausibility is a concern, one ...
7
In general, what you're looking for is a biologically plausible model of reinforcement learning and/or conditioning. I know of two publications in particular that address this.
The first is A Biologically Plausible Spiking Neuron Model of Fear Conditioning and the second is A Spiking Neural Integrator Model of the Adaptive Control of Action by the Medial ...
7
My question is: are these all the rules?
No.
Some things you left out:
Plasticity (change)
Very-short-term synaptic "plasticity" (changes in synaptic strength); at least a few different forms of this (post-tetanic potentiation, short term synaptic depression, synaptic facilitation).
Very-short-term intrinsic "plasticity" (changes in spiking behavior): ...
7
David Chalmers has argued against the thermostat view, suggesting that adaptation to the environment is not sufficient. John Searle also disagrees that the current state of machine learning is capable of consciousness on the grounds that information processing is not a sufficient criterion (public lecture, 2016). Both of these philosophers emphasize clarity ...
6
Wen & Chklovskii (2005) looked at exactly this question through a simulation study. They assumed that the segregation of white and gray matter was the the result of evolutionary pressure to maximize some aspect of connectivity. They tested the idea that simultaneously maximizing interconnectivity (neurons should be able to connect to all other neurons ...
6
Far from being one single organ performing a single homogeneous function, the brain is actually several lobes, and each lobe is like a separate organ performing a dozen functions. Putting it in another way, the brain is not like a "thinking machine", it is more like a collection of computers, instrument panels of an aircraft, radars and sonars of a submarine,...
6
Due to my newness to the field, I can only talk about comparisons of biological plausibility when discussing the Neural Engineering Framework (NEF) and functional modeling. What is missing from this answer is a purely bottom-up modelling perspective in the same vein as the Blue-Brain project, but I'll leave that to another user.
One of the claims driving ...
6
In contrast to artificial neural networks, which are almost all feed-forward architectures, networks in biological brains are highly recurrent. In the networks of cortex, the majority of synaptic inputs a neuron receives come from nearby neurons in the same area of cortex (Binzegger et al. 2004). These are the "circular" connections that you are referring to....
6
First off, you mention 'metals'. What is a metal?
In common speech, a metal is a shiny material that conducts electricity and heat well.
In physics, a metal is regarded as a substance capable of conducting electricity at zero Kelvin. Many elements and compounds become metallic under high pressures, for instance iodine. Reversely, the metal sodium ...
5
After doing some additional research, I think the answer is yes. It just means using a fixed timestep for the continuous-time activation equation (as described here). Since this is a differential equation, implementing it in software requires implementing a numerical integration method. I recommend the Exponential Euler Method as a starting point, because it'...
5
Maybe I just don't get it, but I see your question as confusing because:
1/ Your brain is capable of running multiple parallel processes. Actualy each one of tasks you've mentioned consists of number of processes that are done at the same time. Lots of your neurons and neuronal networks are being used at the very same moment.
2/ If you can do something ...
Only top voted, non community-wiki answers of a minimum length are eligible
