文献类型：期刊文献

中文题名：A deep reinforcement learning approach to gasoline blending real-time optimization under uncertainty

作者：Zhiwei Zhu[1];Minglei Yang[1];Wangli He[1];Renchu He[1];Yunmeng Zhao[1];Feng Qian[1]

机构：[1]Key Laboratory of Smart Manufacturing in Energy Chemical Process,Ministry of Education,East China University of Science and Technology,Shanghai 200237,China

年份：2024

卷号：71

期号：7

起止页码：183

中文期刊名：Chinese Journal of Chemical Engineering

外文期刊名：中国化学工程学报（英文版）

收录：CSTPCD;;Scopus;CSCD:【CSCD2023_2024】；PubMed;

基金：supported by National Key Research & Development Program-Intergovernmental International Science and Technology Innovation Cooperation Project (2021YFE0112800);National Natural Science Foundation of China (Key Program: 62136003);National Natural Science Foundation of China (62073142);Fundamental Research Funds for the Central Universities (222202417006);Shanghai Al Lab

语种：英文

中文关键词：Deep reinforcement learning;Gasoline blending;Real-time optimization;Petroleum;Computer simulation;Neural networks

摘要：The gasoline inline blending process has widely used real-time optimization techniques to achieve optimization objectives,such as minimizing the cost of production.However,the effectiveness of real-time optimization in gasoline blending relies on accurate blending models and is challenged by stochastic disturbances.Thus,we propose a real-time optimization algorithm based on the soft actor-critic(SAC)deep reinforcement learning strategy to optimize gasoline blending without relying on a single blending model and to be robust against disturbances.Our approach constructs the environment using nonlinear blending models and feedstocks with disturbances.The algorithm incorporates the Lagrange multiplier and path constraints in reward design to manage sparse product constraints.Carefully abstracted states facilitate algorithm convergence,and the normalized action vector in each optimization period allows the agent to generalize to some extent across different target production scenarios.Through these well-designed components,the algorithm based on the SAC outperforms real-time optimization methods based on either nonlinear or linear programming.It even demonstrates comparable performance with the time-horizon based real-time optimization method,which requires knowledge of uncertainty models,confirming its capability to handle uncertainty without accurate models.Our simulation illustrates a promising approach to free real-time optimization of the gasoline blending process from uncertainty models that are difficult to acquire in practice.