Find A Winning Sign: Sign Is All We Need to Win the Lottery

Pruning mask ▪ For IMP to succeed,  Network should maintain stability against SGD noise after pruning and rewinding, ensuring it can still converge to a solution that remains linearly mode-connected to the original solution  A network is considered stable against SGD noise if it converges to a set of solutions without high error barriers along the linear path between them (linearly modeconnected), despite different SGD randomness