摘要:聚类分析是统计学、模式识别和机器学习等领域的研究热点.通过有效的聚类分析，数据集的内在结构与特征可以被很好地发掘出来.然而，无监督学习的特性使得当前已有的聚类方法依旧面临着聚类效果不稳定、无法对多种结构的数据集进行正确聚类等问题.针对这些问题，首先将K-means算法和层次聚类算法的聚类思想相结合，提出了一种混合聚类算法K-means-AHC；其次，采用拐点检测的思想，提出了一个基于平均综合度的新聚类有效性指标DAS（平均综合度之差，difference of average synthesis degree），以此来评估K-means-AHC算法聚类结果的质量；最后，将K-means-AHC算法和DAS指标相结合，设计了一种寻找数据集最佳类簇数和最优划分的有效方法.实验将K-means-AHC算法用于测试多种结构的数据集，结果表明：该算法在不过多增加时间开销的同时，提高了聚类分析的准确性.与此同时，新的DAS指标在聚类结果的评价上要优于当前已有的常用聚类有效性指标.



Abstract:Clustering analysis is a hot research topic in the fields of statistics, pattern recognition, and machine learning. Through effective clustering analysis, the intrinsic structure and characteristics of datasets can be well discovered. However, due to the unsupervised learning feature, the existing clustering methods are still facing the problems of unstable and inaccurate on processing different types of datasets. In order to solve these problems, a hybrid clustering algorithm, K-means-AHC, is firstly proposed based on the combination of the K-means algorithm and the hierarchical clustering algorithm. Then, based on the inflexion point detection, a new clustering validity index, DAS (difference of average synthesis degree), is proposed to evaluate the results of the K-means-AHC clustering algorithm. Finally, through the combination of the K-means-AHC algorithm and the DAS index, an effective method of finding the optimal clustering numbers and optimal partitions of datasets is designed. The K-means-AHC algorithm is used to test many kinds of datasets. The experimental results have shown that the proposed algorithm improves the accuracy of clustering analysis while without too much time overhead. At the same time, the new DAS index is superior to the current commonly used clustering validity indexes in the evaluation of clustering results.



PDF全文下载地址:

http://jos.org.cn/jos/article/pdf/6016