Optimized incremental random vector functional-link networks and its application

JIANG Yue; ZHOU Ping

doi:10.11949/0438-1157.20190635

您当前的位置：

首页 >

文章列表页 >

Optimized incremental random vector functional-link networks and its application

Process system engineering | 更新时间：2026-07-24

- Optimized incremental random vector functional-link networks and its application
- CIESC Journal Vol. 70, Issue 12, Pages: 4710-4721(2019)
- 作者机构：
  
  东北大学流程工业综合自动化国家重点实验室，辽宁沈阳 110819
- 作者简介：
- 基金信息：
- DOI：10.11949/0438-1157.20190635
  CLC： TQ 028.8
- Received：10 June 2019，
  
  Revised：2019-08-12，
  
  Online First：09 June 2020，
  
  Published：05 December 2019
- 稿件说明：
移动端阅览
姜乐, 周平. 优化增量型随机权神经网络及应用[J]. 化工学报, 2019, 70(12): 4710-4721

JIANG Yue, ZHOU Ping. Optimized incremental random vector functional-link networks and its application[J]. CIESC Journal, 2019, 70(12): 4710-4721
姜乐, 周平. 优化增量型随机权神经网络及应用[J]. 化工学报, 2019, 70(12): 4710-4721 DOI： 10.11949/0438-1157.20190635.

JIANG Yue, ZHOU Ping. Optimized incremental random vector functional-link networks and its application[J]. CIESC Journal, 2019, 70(12): 4710-4721 DOI： 10.11949/0438-1157.20190635.

摘要

针对传统增量型随机权神经网络(I-RVFLNs)存在网络参数难以优化确定、模型收敛速度慢和结构复杂的问题，提出一种优化增量型随机权神经网络算法，即O-I-RVFLNs。与传统I-RVFLNs不同，所提O-I-RVFLNs算法首先设定了一个期望的建模残差向量，然后在每次新增隐层节点时，选择可以达到或小于此节点期望残差的输入权值和偏置作为该节点的输入参数，进而提高网络的收敛速度。除此之外，考虑到算法在不断迭代更新过程中建模误差越来越小，下降趋势越来越不明显的问题，将各指标参数相邻两次迭代均方根误差的差值考虑在算法终止条件内，并借鉴统计过程控制中的西电规则制定了相应的算法收敛判定准则。最后，基于UCI能效数据和实际高炉工业数据，对所提O-I-RVFLNs算法进行了验证和应用。结果表明，相对于其他RVFLNs算法，所提算法建立的数据模型能够获得更紧凑的网络结构以及更好的泛化性能和预测精度。

Abstract

Aiming at the problem that network parameters are difficult to be optimally determined

the model convergence speed is slow and the structure is complex in the traditional incremental random vector functional-link networks (I-RVFLNs)

an optimized incremental random vector functional-link networks algorithm

namely O-I-RVFLNs

is proposed. Different from the traditional I-RVFLNs

the proposed O-I-RVFLNs algorithm sets a desired residual error vector

and then selects the input weights and biases that can reach or less than the expected residual error as the input parameters of the node each time a hiddennode is added

thereby improving the convergence rate of the network. In addition

considering that the modeling error of the algorithm is smaller and smaller and the downward trend is less obvious in the process of continuous iteration updating

the RMSE difference between adjacent iterations of each index parameter is considered in the termination condition of the algorithm

and the corresponding convergence criteria are formulated by referring to the Western Electricity Rules in statistical process control. Finally

based on UCI energy efficiency data and actual blast furnace industrial data

the proposed O-I-RVFLNs algorithm is verified and applied. The results show that compared with other RVFLNs algorithms

the data model built by the proposed algorithm can obtain more compact network structure

better generalization performance and prediction accuracy.

关键词

Keywords

references

Igelnik B , Pao Y H . Stochastic choice of basis functions in adaptive function approximation and the functional-link net [J ] . IEEE Trans . Neural Networks , 1995 , 6 ( 6 ): 1320 - 1329 .

Pao Y H , Takefuji Y . Functional-link net computing: theory, system, architecture, and functionalities [J ] . Computer , 1992 , 25 ( 2 ): 76 - 79 .

Suganthan P N . On non-iterative learning algorithms with closed-form solution [J ] . Applied Soft Computing , 2018 , 70 : 1078 - 1082 .

Ren Y , Suganthan P N , Srikanth N , et al . Random vector functional link network for short-term electricity load demand forecasting [J ] . Information Sciences , 2016 , 367 : 1078 - 1093 .

Zhou P , Lv Y B , Wang H , et al . Data-driven robust RVFLNs modeling of blast furnace ironmaking process using Cauchy distribution weighted M-estimation [J ] . IEEE Trans . Industrial Electronics , 2017 , 64 ( 9 ): 7141 - 7151 .

Dai W , Chen Q X , Chu F . Robust regularized random vector functional link network and its industrial application [J ] . IEEE Access , 2017 , 5 : 16162 - 16172 .

Pratama M , Angelov P P , Lughofer E , et al . Parsimonious random vector functional link network for data streams [J ] . Information Science , 2018 , 430 / 431 : 519 - 537 .

Zhang L , Suganthan P N . Visual tracking with convolutional random vector functional link network [J ] . IEEE Trans . Cybernetics , 2017 , 47 ( 10 ): 3243 - 3253 .

Dai W , Liu Q , Chai T Y . Particle size estimate of grinding processes using random vector functional link networks with improved robustness [J ] . Neurocomputing , 2015 , 169 : 361 - 372 .

Huang G B , Zhu Q Y , Siew C K . Extreme learning machine: theory and applications [J ] . Neurocomputing , 2006 , 70 ( 1 ): 489 - 501 .

Huang G B , Zhou H , Ding X , et al . Extreme learning machine for regression and multiclass classification [J ] . IEEE Trans . Syst ., Man , Cybern . Syst ., 2012 , 42 ( 2 ): 513 - 529 .

Oneto L , Fumeo E , Clerico G . Dynamic delay predictions for large-scale railway networks: deep and shallow extreme learning machines tuned via thresholdout [J ] . IEEE Trans . Syst ., Man , Cybern . Syst ., 2017 , 47 ( 10 ): 2754 - 2767 .

贺敏 , 汤健 , 郭旭琦 , 等 . 基于流形正则化域适应随机权神经网络的湿式球磨机负荷参数软测量 [J ] . 自动化学报 , 2019 , 45 ( 2 ): 398 - 406 .

He M , Tang J , Guo X Q , et al . Soft sensor for ball mill load using DAMRRWNN model [J ] . Acta Automatica Sinica , 2019 , 45 ( 2 ): 398 - 406 .

Huang G B , Lei C , Siew C K . Universal approximation using incremental constructive feedforward networks with random hidden node [J ] . IEEE Trans . Neural Networks , 2006 , 17 ( 4 ): 879 - 892 .

Zhang L , Zhou P , Song H D , et al . Multivariable dynamic modeling for molten iron quality using incremental random vector functional-link networks [J ] . Journal of Iron and Steel Research International , 2016 , 23 ( 11 ): 1151 - 1159 .

Ying L . Orthogonal incremental extreme learning machine for regression and multiclass classification [J ] . Neural Computing and Applications . 2016 , 27 ( 1 ): 111 - 120 .

Huang G , Chen L . Enhanced random search based incremental extreme learning machine [J ] . Neurocomputing , 2008 , 71 ( 16 ): 3460 - 3468 .

Huang G , Chen L . Convex incremental extreme learning machine [J ] . Neurocomputing , 2007 , 70 ( 16 ): 16 - 18 .

Barron A R . Universal approximation bounds for superpositions of a sigmoidal function [J ] . IEEE Trans . Information Theory , 1993 , 39 ( 3 ): 930 - 945 .

Jian L , Gao C H , Xia Z H . Constructing multiple kernel learning framework for blast furnace automation [J ] . IEEE Trans . Automation Science and Engineering , 2012 , 9 ( 4 ): 763 - 777 .

宋贺达 , 周平 , 王宏 , 等 . 高炉炼铁过程多元铁水质量非线性子空间建模及应用 [J ] . 自动化学报 , 2016 , 42 ( 21 ): 1664 - 1679 .

Song H D , Zhou P , Wang H , et al . Nonlinear subspace modeling of multivariate molten iron quality in blast furnace ironmaking and its application [J ] . Acta Automatica Sinica , 2016 , 42 ( 21 ): 1664 - 1679 .

Zhou P , Guo D , Wang H , et al . Data-driven robust M-LS-SVR-based NARX modeling for estimation and control of molten iron quality indices in blast furnace ironmaking [J ] . IEEE Trans . Neural Networks & Learning Systems , 2018 , 29 ( 9 ): 4007 - 4021 .

宋菁华 , 杨春节 , 周哲 , 等 . 改进型EMD-Elman神经网络在铁水硅含量预测中的应用 [J ] . 化工学报 , 2016 , 67 ( 3 ): 729 - 735 .

Song J H , Yang C J , Zhou Z , et al . Application of improved EMD-Elman neural network to predict silicon content in hot metal [J ] . CIESC Journal , 2016 , 67 ( 3 ): 729 - 735 .

李泽龙 , 杨春节 , 刘文辉 , 等 . 基于LSTM-RNN模型的铁水硅含量预测 [J ] . 化工学报 , 2018 , 69 ( 3 ): 992 - 997 .

Li Z L , Yang C J , Liu W H , et al . Research on hot metal Si-content prediction based on LSTM-RNN [J ] . CIESC Journal , 2018 , 69 ( 3 ): 992 - 997 .

蒋朝辉 , 董梦林 , 桂卫华 , 等 . 基于Bootstrap 的高炉铁水硅含量二维预报 [J ] . 自动化学报 , 2016 , 42 ( 5 ): 715 - 723 .

Jiang Z H , Dong M L , Gui W H , et al . Two-dimensional prediction for silicon content of hot metal of blast furnace based on bootstrap [J ] . Acta Automatica Sinica , 2016 , 42 ( 5 ): 715 - 723 .

Zhou P , Yuan M , Wang H , et al . Multivariable dynamic modeling for molten iron quality using online sequential random vector functional-link networks with self-feedback connections [J ] . Information Sciences , 2015 , 325 : 237 - 255 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Physics-informed spatio-temporal graph convolutional network for fermentation processes

A dual-stream multirate GRU soft sensor modeling based on data chunk strategy

ESO-based action dependent heuristic dynamic programming control and its application in a four-stage CSTR process

Soft sensor development based on deep extended variational autoencoder with just-in-time learning

TTPA-LSTM soft sensor modeling for multi-sampling rate data

Related Author

DING Zhuo

LIU Fei

WANG Zhiguo

ZHANG Zhen

SHI Xudong

WANG Fazheng

XIONG Weili

CHEN Xun

Related Institution

Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Jiangnan University

School of Internet of Things Engineering, Jiangnan University

Key Laboratory of Advanced Process Control for Industry (Ministry of Education), Jiangnan University

College of Information Science and Technology, Beijing University of Chemical Technology

Wuxi Advance Technologies

⁰