文件名称:Design-of-a-fast-convergent-backpropagation
介绍说明--下载内容均来自于网络,请自行研究使用
The main contribution of this paper is using
optimal control theory for improving the convergence
rate of backpropagation algorithm. In the proposed
approach, the learning algorithm of backpropagation
is modeled as a minimum time control problem
in which the step-size of its learning factor is considered
as the input of this model. In contrast to the traditional
backpropagation, learning algorithms which
the step-size by trial and error, it is selected
adaptively based on optimal control criterion. The effectiveness
of the proposed algorithm is uated in
two simulations: XOR and 3-bit parity. In both simulation
examples, the proposed algorithm outperforms
well in speed and the ability to escape local minima.-The main contribution of this paper is using
optimal control theory for improving the convergence
rate of backpropagation algorithm. In the proposed
approach, the learning algorithm of backpropagation
is modeled as a minimum time control problem
in which the step-size of its learning factor is considered
as the input of this model. In contrast to the traditional
backpropagation, learning algorithms which
the step-size by trial and error, it is selected
adaptively based on optimal control criterion. The effectiveness
of the proposed algorithm is uated in
two simulations: XOR and 3-bit parity. In both simulation
examples, the proposed algorithm outperforms
well in speed and the ability to escape local minima.
optimal control theory for improving the convergence
rate of backpropagation algorithm. In the proposed
approach, the learning algorithm of backpropagation
is modeled as a minimum time control problem
in which the step-size of its learning factor is considered
as the input of this model. In contrast to the traditional
backpropagation, learning algorithms which
the step-size by trial and error, it is selected
adaptively based on optimal control criterion. The effectiveness
of the proposed algorithm is uated in
two simulations: XOR and 3-bit parity. In both simulation
examples, the proposed algorithm outperforms
well in speed and the ability to escape local minima.-The main contribution of this paper is using
optimal control theory for improving the convergence
rate of backpropagation algorithm. In the proposed
approach, the learning algorithm of backpropagation
is modeled as a minimum time control problem
in which the step-size of its learning factor is considered
as the input of this model. In contrast to the traditional
backpropagation, learning algorithms which
the step-size by trial and error, it is selected
adaptively based on optimal control criterion. The effectiveness
of the proposed algorithm is uated in
two simulations: XOR and 3-bit parity. In both simulation
examples, the proposed algorithm outperforms
well in speed and the ability to escape local minima.
(系统自动生成,下载前可以参看下载内容)
下载文件列表
Design of a fast convergent backpropagation.pdf