HCL-FF: Hierarchical and Contrastive Learning for Forward-Forward Algorithm
Jie-En Yao, Hong-En Chen, C.-C. Jay Kuo
摘要
Deep neural networks trained with backpropagation have achieved outstanding performance in vision tasks but remain biologically implausible, computationally demanding, and difficult to interpret. The Forward-Forward (FF) algorithm offers a promising alternative by training each layer independently through local goodness objectives. However, its purely local optimization lacks hierarchical coordination across layers, and the decoupling of goodness from features leaves the representations unconstrained and semantically ambiguous. We propose a Hierarchical and Contrastive Learning FF framework (HCL-FF) to address these limitations. HCL-FF introduces (1) a coarse-to-fine hierarchical learning strategy that guides representations from low-level cues to high-level semantics, and (2) a supervised contrastive objective that enforces class-discriminative alignment after goodness decoupling. Experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet demonstrate that HCL-FF achieves new state-of-the-art performance among FF-based methods, with notable accuracy gains of +5.46%, +17.00%, and +12.51%, respectively.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna 等NeurIPS 2020 · 被引用 7,049 次
- Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward PassGiorgia Dellaferrera, Gabriel KreimanICML 2022 · 被引用 80 次
- NBDT: Neural-Backed Decision TreeAlvin Wan, Lisa Dunlap, Daniel Ho, Jihan Yin 等ICLR 2021 · 被引用 56 次
- Towards Scaling Difference Target Propagation by Learning Backprop TargetsMaxence Ernoult, Fabrice Normandin, Abhinav Moudgil, Sean Spinney 等ICML 2022 · 被引用 49 次
- Layer Collaboration in the Forward-Forward AlgorithmGuy Lorberbom, Itai Gat, Yossi Adi, Alexander G. Schwing 等AAAI 2024 · 被引用 22 次
相关 Paper
- Dictionary Contrastive Learning for Efficient Local Supervision without Auxiliary NetworksSuhwan Choi, Myeongho Jeon, Yeonjung Hwang, Jeonglyul Oh 等ICLR 2024
- Convolutional Channel-Wise Competitive Learning for the Forward-Forward AlgorithmAndreas Papachristodoulou, Christos Kyrkou, Stelios Timotheou, Theocharis TheocharidesAAAI 2024 · 被引用 27 次
- DeeperForward: Enhanced Forward-Forward Training for Deeper and Better PerformanceLiang Sun, Yang Zhang, Weizhao He, Jiajun Wen 等ICLR 2025
- Forward Learning of Graph Neural NetworksNamyong Park, Xing Wang, Antoine Simoulin, Shuai Yang 等ICLR 2024 · 被引用 1 次
- LoCo: Local Contrastive Representation LearningYuwen Xiong, Mengye Ren, Raquel UrtasunNeurIPS 2020 · 被引用 87 次
