In this section, we will cover the planning of your distributed cluster. We have already studied the sizing of clusters and estimation and data load aspects of clusters. When you explore different hardware alternatives, it is found that rack servers are the most suitable option available. Although Hadoop claims to support commodity hardware, the nodes still require server-class machines, and you should not consider setting up desktop-lass machines. However, unlike high-end databases, Hadoop does not require high-end server configuration; it can easily work on Intel-based processors, along with standard hard drives. This is where you save the cost.
Reliability is a major aspect to consider while working with any production system. Disk drives use Mean Time Between Failure (MTBF). It varies based on disk type. Hadoop is designed to work with hardware...