With k-means, we will need to specify the exact number of clusters that we want. The algorithm will then iterate until each observation belongs to just one of the k-clusters. The algorithm's goal is to minimize the within-cluster variation as defined by the squared Euclidean distances. So, the kth-cluster variation is the sum of the squared Euclidean distances for all the pairwise observations divided by the number of observations in the cluster.
Due to the iteration process that is involved, one k-means result can differ greatly from another result even if you specify the same number of clusters. Let's see how this plays out for a situation where we will specify three clusters:
Each observation is randomly assigned by the algorithm to one of the three clusters.
Each cluster has a centroid calculated by the algorithm, which is a vector of the variable means for the observations. For example, if you have five input variables, your centroid would be a vector of five values...