Knowledge Guided DRL for Intelligent Reconfiguration and Scheduling in Customized and Personalized Manufacturing Workshop

To meet personalized user demands, customized and personalized production (CPP) has become an effective manufacturing paradigm. However, wired network connections inhibit flexible production line reconfiguration and current DRL methods cannot converge and obtain eligible scheduling results for CPP due to the high-dimensional solution space and the negligence of significant machine reconfiguration time. To address this challenge, we first propose a wireless manufacturing system framework to support ultra-flexible reconfiguration and resource scheduling. Next, we build a reconfiguration oriented scheduling model to reflect the significant impact of reconfiguration time. Then, we design a knowledge guided deep reinforcement learning algorithm to effectively solve the CPP scheduling problem facing the dimension explosion problem. The knowledge guidance incorporates reconfiguration time and machine workload to significantly reduce the feasible action space, enabling the rapid convergence of KGDRL. The experiment results show that our approach provides a robust and scalable solution and obtains shorter total makespan of whole production during scheduling.