针对极速学习机(ELM)性能过分依赖于隐层节点稠密的单隐层前馈神经网络(SLFN)问题,提出了适用于多类分类的精简型ELM,即SVM-ELM(基于支持向量机优化的ELM).该方法大幅削减隐层节点数为类别数,同时通过SVM技术优化每个节点的线性决策函数,显著提高单个节点的决策水平,为ELM的宏观决策提供有利条件.在HCL2000,MNIST和USPS等公共数据集上的实验表明:该方法能够减少节点数目而不损害学习精度,当类别数为10时,基于SVM-ELM方法构造的10节点SLFN泛化性能即可超越基于原始ELM方法构造的包含成千上万个隐层节点SLFN的泛化性能.
A reduced extreme learning machine(ELM)for multi-classification called SVM-ELM(ELM optimized with support vector machine)was proposed for tackling the problem that the single hidden layer feedforward neural networks(SLFN)used by ELM is too large for its applications.The proposed algorithm used only k hidden layer nodes for k-class problem to build the SLFN.Each node was optimized with the SVM technique with a high decision level for the SLFN.Experimental results on HCL2000,MNIST and USPS benchmark datasets show that SVM-ELM could get an excellent generalization performance with fewer nodes.The classification performance of SVM-ELM with 10 hidden layer nodes outperforms that of ELM with thousands of hidden layer nodes.