How to find the unused parameters in networkAn easy way to find unused params is train your model on a single node without the DDP wrapper. after loss.backward() and before…Jun 27, 2021Jun 27, 2021
How to plot figures on remote server?The information below is from the following websites. The purpose here is only for personal notes taking.Apr 22, 2021Apr 22, 2021
Eistein SummationEistein Summation is very convenient for high dimension matrix multiplication.Apr 21, 2021Apr 21, 2021
