dwHow to find the unused parameters in networkAn easy way to find unused params is train your model on a single node without the DDP wrapper. after loss.backward() and before…1 min read·Jun 27, 2021----
dwHow to plot figures on remote server?The information below is from the following websites. The purpose here is only for personal notes taking.3 min read·Apr 22, 2021----
dwEistein SummationEistein Summation is very convenient for high dimension matrix multiplication.1 min read·Apr 21, 2021----