All of the most visited websites in the world are built over carefully planned server architectures: fast page loads and download speeds are significant requirements for long-term traffic growth. The concept of load balancing has the potential to solve problems pertaining to scalability, availability, and performance. After a rapid description of the concept, we will elaborate on how Nginx offers to implement such an architecture.
To put it simply, the concept of load balancing consists of distributing the workload (CPU load, hard disk load, or other forms) across several servers in a manner that is completely transparent to your visitors.
In the case of a single server architecture, client requests are received and processed by one machine. A machine has a limited capacity of operation. For example, suppose a web server is able to respond to 1,000 HTTP requests per second. If the server were to receive more than...