How your brain learns to ride the subway—and why AI developers care
News May 19, 2016
In machine learning, a programmer might develop an artificial intelligence (AI) that can calculate all possible consequences of a single action. Humans, however, don't have the same raw computational power; we have to efficiently create and execute a plan. We mentally invent different "layers" to organize our actions and then think about the higher levels rather than individual steps, according to a Neuron study from members of Google DeepMind and the University of Oxford.
"The idea is basically to understand how humans or animals make long-term decisions," says Jan Balaguer, a PhD student at University of Oxford and member of Google DeepMind. "We're interested in trying to find machine-learning solutions to difficult tasks and real-life problems. Quite often it can be useful to draw inspiration from neuroscience."
Balaguer and his colleagues used a navigational game as a proxy to decode the human brain's decision-making processes. On a virtual subway system analogous to the London Underground, each station stop represented an individual step, while the different colored subway lines represented a higher level of the hierarchy. Twenty-two participants were trained on the game and then given a destination station as a goal, and played while in an fMRI scanner.
The researchers examined whether participants focused more on the subway lines or on the individual stations while navigating in the game. The team found that, generally, brain activity and response time increased with the number of line changes standing between participants and their destinations, rather than with the number of stations themselves. The areas in the brain linked to this type of decision making were the dorsal portion of the medial prefrontal cortex, which is known to support higher cognitive functions such as planning, and the premotor cortex, which is more involved in the execution of real or imaginary movements.
Related: Human behavior simulator
"We show, in a more straightforward and direct manner than previous studies, that there are hierarchical representations reflected in the brain," says Balaguer.
However, there were some parts of the brain that became more active as participants inched closer to achieving their goal, with fewer stations left on a single line: the ventromedial prefrontal cortex and the hippocampus. In previous work, the hippocampus has been shown to react to proximity to a given goal.
Overall, Balaguer says, "We want to see how the human brain implements things like hierarchical structures in order to design more clever algorithms. In machine learning, having a hierarchical representation for decision making might be helpful or harmful depending on whether you choose the right hierarchy to implement in the first place."
Note: Material may have been edited for length and content. For further information, please contact the cited source.
Balaguer J et al. Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network. Neuron, Published May 18 2016. doi: 10.1016/j.neuron.2016.03.037
A recent retrospective study evaluating continuous electroencephalography (cEEG) of children in intensive care units (ICUs) found a higher than anticipated number of seizures. The work also identified several conditions closely associated with the seizures, and suggests that cEEG monitoring may be a valuable tool for helping to identify and treat neurological problems in patients who are 14 months old or younger.
Pain is a negative feeling that we want to get rid of as soon as possible. In order to protect our bodies, we react for example by withdrawing the hand. This action is usually understood as the consequence of the perception of pain. A team from the Technical University of Munich (TUM) has now shown that perception, the impulse to act and provision of energy to do so take place in the brain simultaneously and not, as was expected, one after the other.