现有的大多数孤立点检测算法都需要预先设定孤立点个数,并且还缺乏对不均匀数据集的检测能力。针对以上问题,提出了基于聚类的两段式孤立点检测算法,该算法首先用DBSCAN聚类算法产生可疑孤立点集合,然后利用剪枝策略对数据集进行剪枝,并用基于改进距离的孤立点检测算法产生最可能孤立点排序集合,最终由两个集合的交集确定孤立点集合。该算法不必预先设定孤立点个数,具有较高的准确率与检测效率,并且对数据集的分布状况不敏感。数据集上的实验结果表明,该算法能够高效、准确地识别孤立点。
Most of the existing outlier detection algorithms need to preset the number of outliers, and also lack of detectioncapability of non-uniform data set. In view of the above problems, it puts forward the two-part outlier detection algorithmbased on clustering, this algorithm first uses DBSCAN clustering algorithm to produce suspected outlier set, then pruningstrategy is used for pruning data set, and the outlier detection algorithm based on improved distance is used to produce thesorting set of the points which most likely to be outliers. Eventually the isolated point set is determined by the intersectionof the two sets. The algorithm doesn’t need to preset the number of outliers, with the higher accuracy and detection efficiency,and is not sensitive to the distribution of the data set. The experimental results on data set show that the algorithm can effectivelyand accurately identify the outliers.