Dual Network DQN Algorithm Based on Second-order Temporal Difference Error

Aiming at the problem of poor convergence stability caused by overestimation of Depth Q-Network(DQN) algorithm, on the basis of traditional Temporal Difference (TD), the concept of n-order TD error is proposed and a dual¬network DQN algorithm based on second-order TD error is designed. A value function updating formula based on second-order TD error is constructed. Meanwhile, a two-network model is established in combination with DQN algorithm, …