北京师范大学IDG /麦戈文脑科学研究所Yunzhe Liu课题组取得最新进展。他们发现经验回放与有效的非局部学习相关。相关论文于2021年5月21日发表于国际顶尖学术期刊《科学》杂志上。

使用直接与间接价值学习分开步骤，并结合脑磁图技术，他们研究了神经回放在人类非局部学习中的作用。获得奖励后，他们发现非局部经验发生了显著的向后回放，状态与状态之间的时差为160毫秒，这与有效学习动作值有关。非局部学习的向后回放和行为证据在对未来行为有更大益处的经验中更为明显。这些发现支持非局部回放作为解决学习过程中复杂学分分配问题的神经机制。

研究人员表示，为了做出有效的决定，人们需要考虑行动与结果之间的关系。这些通常被时间和空间分隔开。不相交的动作和结果联系在一起的神经机制仍然未知。一种潜在假设涉及非局部经验的神经回放。

附：英文原文

Title: Experience replay is associated with efficient nonlocal learning

Author: Yunzhe Liu, Marcelo G. Mattar, Timothy E. J. Behrens, Nathaniel D. Daw, Raymond J. Dolan

Issue&Volume: 2021/05/21

Abstract: To make effective decisions, people need to consider the relationship between actions and outcomes. These are often separated by time and space. The neural mechanisms by which disjoint actions and outcomes are linked remain unknown. One promising hypothesis involves neural replay of nonlocal experience. Using a task that segregates direct from indirect value learning, combined with magnetoencephalography, we examined the role of neural replay in human nonlocal learning. After receipt of a reward, we found significant backward replay of nonlocal experience, with a 160-millisecond state-to-state time lag, which was linked to efficient learning of action values. Backward replay and behavioral evidence of nonlocal learning were more pronounced for experiences of greater benefit for future behavior. These findings support nonlocal replay as a neural mechanism for solving complex credit assignment problems during learning.

DOI: 10.1126/science.abf1357

Source: https://science.sciencemag.org/content/372/6544/eabf1357