Neural Dependencies Emerging from Learning Massive Categories

Figure 1 . Illustration of neural dependencies that emerge (a) within a single network and (b) between two independently learned networks. Taking the intra-network dependency as an instance, the logits predicted for the category "macaw" can be safely replaced by a linear combination of the logits predicted for a few other categories, barely scarifying the accuracy.