详细信息

Sustainable Computing Optimization in Large-Scale Machine Learning Training  ( SCI-EXPANDED收录 EI收录)  

文献类型:期刊文献

英文题名:Sustainable Computing Optimization in Large-Scale Machine Learning Training

作者:Zhu, Yanqiu[1];Chen, Hongan[1];Ma, Jun[2];Pan, Fei[3]

机构:[1]East China Univ Sci & Technol, Sch Business, Shanghai 200237, Peoples R China;[2]Shanghai Univ, Sch Management, Shanghai 200444, Peoples R China;[3]Univ Shanghai Sci & Technol, Sch Management, Shanghai 200093, Peoples R China

年份:2025

卷号:39

期号:16

外文期刊名:INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE

收录:;EI(收录号:20254519447079);WOS:【SCI-EXPANDED(收录号:WOS:001611312900001)】;

基金:This work was supported by the National Natural Science Foundation of China. (Grant Number: 72202137).

语种:英文

外文关键词:Federated learning; dynamic sparsification; runtime scheduling feedback; comple mentary pruning; client chain update; communication efficiency

摘要:The rapid growth of large-scale machine learning (ML) models has led to unprecedented computational demands, raising critical concerns about energy consumption, and environmental sustainability. To address these challenges, it is imperative to develop innovative approaches that reduce resource usage without sacrificing model performance. In this paper, we propose sustainable adaptive green engine (SAGE), a comprehensive framework designed to optimize computational efficiency during large-scale ML training. SAGE integrates multiple key techniques, including dynamic model sparsification that adaptively prunes redundant parameters to reduce computational overhead; resource-aware training scheduling that flexibly adjusts training processes based on real-time energy consumption; and communication-efficient distributed learning strategies to minimize overhead in multi-node environments. By combining these modules, SAGE dynamically adapts model complexity and computation pathways according to workload characteristics and energy constraints. This adaptive approach enables the system to maintain high accuracy even under stringent resource limitations, making it particularly suitable for deployment on energy-sensitive platforms such as mobile and edge devices. Furthermore, the framework significantly reduces overall energy consumption during training, promoting sustainable AI development while preserving scalability and generalization capabilities. Extensive evaluations on diverse benchmark datasets demonstrate that SAGE achieves a balanced and effective solution across performance, computational cost, and sustainability metrics. Our work represents a practical step toward environmentally friendly AI, providing a valuable blueprint for future research on green and efficient ML systems.

参考文献:

正在载入数据...

版权所有©华东理工大学 重庆维普资讯有限公司 渝B2-20050021-7 
渝公网安备 50019002500408号 违法和不良信息举报中心