Revisiting Neural Networks for Few-Shot Learning: A Zero-Cost NAS Perspective

Observations. 1. Existing proxies (i.e., NASWOT) suffer from larger score variance, which will degrade the accuracy. 2. Kendall's Tau between accuracy and information entropy remains unchanged.