Decoupling Capacitor Selection Algorithm for PDN Based on Deep Reinforcement Learning

Selection of decoupling capacitors (decaps) is important for power distribution network (PDN) design in terms of lowering impedance and saving cost. Good PDN designs typically mean satisfying a target impedance with as less decaps as possible. In this paper, an inductance-based method is utilized to calculate the port priority fist, and afterwards deep reinforcement learning (DRL) with deep neural network (DNN) is applied to optimize the assignment of decaps on the prioritized locations. The DRL algorithm can explore by itself without any prior physical knowledge, and the DNN is trained with the exploration experience and eventually converges to an optimum state. The proposed hybrid method was tested on a printed-circuit-board (PCB) example. After some iterations of training the DNN successfully reached to an optimum design, which turned out to be the minimum number of decaps that can satisfy the target impedance. The usage of DRL with DNN makes the algorithm promising to include more variables as input and handle more complicated cases in the future.