The larger the fairer?: small neural networks can achieve fairness for edge devices
Yi Sheng, Junhuan Yang, Yawen Wu, Kevin Mao, Yiyu Shi, Jingtong Hu, Weiwen Jiang, Lei Yang
摘要
Along with the progress of AI democratization, neural networks are being deployed more frequently in edge devices for a wide range of applications. Fairness concerns gradually emerge in many applications, such as face recognition and mobile medical. One fundamental question arises: what will be the fairest neural architecture for edge devices? By examining the existing neural networks, we observe that larger networks typically are fairer. But, edge devices call for smaller neural architectures to meet hardware specifications. To address this challenge, this work proposes a novel Fairness- and Hardware-aware Neural architecture search framework, namely FaHaNa. Coupled with a model freezing approach, FaHaNa can efficiently search for neural networks with balanced fairness and accuracy, while guaranteed to meet hardware specifications. Results show that FaHaNa can identify a series of neural networks with higher fairness and accuracy on a dermatology dataset. Target edge devices, FaHaNa finds a neural architecture with slightly higher accuracy, 5.28X smaller size, 15.14% higher fairness score, compared with MobileNetV2; meanwhile, on Raspberry PI and Odroid XU-4, it achieves 5.75X and 5.79X speedup.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper7
- LinGCN: Structural Linearized Graph Convolutional Network for Homomorphically Encrypted InferenceHongwu Peng, Ran Ran, Yukui Luo, Jiahui Zhao 等NeurIPS 2023 · 被引用 57 次
- AutoReP: Automatic ReLU Replacement for Fast Private Network InferenceHongwu Peng, Shaoyi Huang, Tong Zhou, Yukui Luo 等ICCV 2023 · 被引用 44 次
- On-Device Unsupervised Image SegmentationJunhuan Yang, Yi Sheng, Yuzhou Zhang, Weiwen Jiang 等DAC 2023 · 被引用 15 次
- Hardware-Aware Graph Neural Network Automated Design for Edge Computing PlatformsAo Zhou, Jianlei Yang, Yingjie Qi, Yumeng Shi 等DAC 2023 · 被引用 15 次
- PASNet: Polynomial Architecture Search Framework for Two-party Computation-based Secure Neural Network DeploymentHongwu Peng, Shanglin Zhou, Yukui Luo, Nuo Xu 等DAC 2023 · 被引用 5 次
它引用的顶会 Paper4
- Searching for MobileNetV3Andrew Howard, Ruoming Pang, Hartwig Adam, Quoc V. Le 等ICCV 2019 · 被引用 9,163 次
- Fair Generative Modeling via Weak SupervisionKristy Choi, Aditya Grover, Trisha Singh, Rui Shu 等ICML 2020 · 被引用 160 次
- Co-Exploration of Neural Architectures and Heterogeneous ASIC Accelerator Designs Targeting Multiple TasksLei Yang, Zheyu Yan, Meng Li, Hyoukjun Kwon 等DAC 2020 · 被引用 115 次
- Dancing along Battery: Enabling Transformer with Run-time Reconfigurability on Mobile DevicesYuhong Song, Weiwen Jiang, Bingbing Li, Panjie Qi 等DAC 2021 · 被引用 16 次
相关 Paper
- Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face RecognitionSamuel Dooley, Rhea Sanjay Sukthanker, John P. Dickerson, Colin White 等NeurIPS 2023 · 被引用 41 次
- End-to-End Model Generation with Large Language Models for Adaptive IoT Application DeploymentZhenyu Wen, Jintao Feng, Nanjie Yao, Di Wu 等ICSE 2026
- Once-for-All: Train One Network and Specialize it for Efficient DeploymentHan Cai, Chuang Gan, Tianzhe Wang, Zhekai Zhang 等ICLR 2020 · 被引用 1,522 次
- HAT: Hardware-Aware Transformers for Efficient Natural Language ProcessingHanrui Wang, Zhanghao Wu, Zhijian Liu, Han Cai 等ACL 2020 · 被引用 215 次
- LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture SearchChengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu 等NSDI 2024 · 被引用 7 次
