文献类型：期刊文献

中文题名：带动量项的梯度下降算法的收敛性

英文题名：Convergence of Gradient Descent Algorithm with Momentum

作者：彭先伦[1];谢纲[1]

机构：[1]华东理工大学数学学院,上海200237

年份：2021

卷号：47

期号：6

起止页码：779

中文期刊名：华东理工大学学报（自然科学版）

外文期刊名：Journal of East China University of Science and Technology

收录：Scopus;北大核心:【北大核心2020】；CSCD:【CSCD_E2021_2022】；

语种：中文

中文关键词：神经网络;反向传播算法;动量;动量系数;收敛

外文关键词：neural networks;back-propagation algorithm;momentum;momentum coefficient;convergence

摘要：本文对基于三层前馈神经网络的带动量项的反向传播算法进行了理论分析。在我们的模型中,学习率为常数,动量系数为一个适应性的变量。本文给出了带动量项的反向传播算法的收敛性结果及详细的证明。相比于目前已有的结果,本文中的结论更具有一般性。
At present,neural networks have been widely used,and have achieved some success in many fields.However,there is not much theoretical analysis about neural networks.This paper analyzed the convergence of the back-propagation algorithm with momentum for the three-layer feed-forward neural networks.In our model,the learning rate is set to be a constant,and the momentum coefficient is set as an adaptive variable to accelerate and stabilize the training procedure of network parameters.The corresponding convergence results and detailed proofs are given.Compared with the existing results,our results are more general.