Book Image

Rapid - Apache Mahout Clustering designs

Book Image

Rapid - Apache Mahout Clustering designs

Overview of this book

Table of Contents (16 chapters)
Apache Mahout Clustering Designs
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

Evaluating clusters


Cluster evaluation involves cluster validation. We can apply multiple algorithms to get the clustering results, and we wish to know how one result is better than the other.

Two types of methods are available to evaluate clusters:

  • Extrinsic methods

  • Intrinsic methods

Let's take a look at each of these types.

Extrinsic methods

Extrinsic methods are the methods in which data that is not used for clustering is used for evaluation. This data consists of known class labels and external benchmarks. These benchmarks are thought of as gold standards and are often created by experts. A measure on clustering quality is effective if it satisfies the following four criteria (A comparison of Extrinsic Clustering Evaluation Metrics based on Formal constraints, Enrique Amigó, Julio Gonzalo, Javier Artiles, and FelisaVerdejo):

  • Cluster Homogeneity: Clusters should not mix items belonging to different categories. Look at the following diagram:

    Cluster 1 has all six data points in one cluster, while...