Network Load Balancing in Data Centers: An Overview

Modern data centres are integral to managing a significant portion of data traffic and application operations on the contemporary internet. Ideally, these data centres should deliver differentiated services characterized by high throughput and low latency tailored to various application traffic demands from multiple users. The performance of a data centre's network transmission capacity plays a critical role in determining its overall service capabilities. Consequently, effective traffic management within the data centre can enhance the overall utilization of network links, mitigate congestion, and reduce the need for retransmissions. Therefore, the design of a well-structured and efficient network load-balancing solution is essential for the development of innovative data centre infrastructures.

Challenges of Network Load Balancing

Designing an effective network load-balancing solution for contemporary data centres presents several challenges due to the inherent complexities involved. 1. Traffic Dynamics: Data centre networks experience dynamic traffic patterns, where a limited number of substantial flows can dominate the network load, while numerous smaller flows may induce significant fluctuations in the network state. The latency associated with flow scheduling complicates the problem of load balancing in these environments. 2. Congestion Perception Difficulty: The high level of dynamism in data centre network traffic results in a temporal delay in the perception of network congestion. The congestion information available at any given moment reflects the previous state of the network. Consequently, the accuracy and timeliness of this congestion perception directly influence the efficacy of load-balancing strategies. 3. Packet Out of Order Issues: Traditional load balancing techniques within data centre networks typically rely on flow scheduling and hash calculations to select a single path for communication. When two data streams conflict on the same link, the transmission time can effectively double. Moreover, utilizing packet-level scheduling can lead to packet out-of-order problems due to the acknowledgement mechanisms inherent in transport layer protocols. 4. Abnormal Traffic Scheduling: In the event of a network device or link failures, the uplink and downlink may exhibit asymmetry, thereby contributing to network congestion and significantly diminishing data transmission efficiency. It is imperative for load-balancing solutions to promptly address such failure conditions and to redistribute affected traffic within the network to optimize overall transmission performance.

The challenge of multi-link load balancing within data centre networks

It is a critical consideration for optimizing performance. Data centre network topologies typically employ a CLOS structure, resulting in multiple paths between hosts. In order to accommodate the demands of throughput-sensitive traffic, data streams are distributed across various paths for effective data transmission. To mitigate congestion and enhance resource utilization within data centres, Equal Cost Multi-Path (ECMP) technology is frequently utilized as the primary network load-balancing solution. ECMP refers to the practice of equivalent multi-path routing, which involves the availability of multiple paths with equivalent costs leading to the same destination address. In environments that support equivalent routing, Layer 3 forwarding traffic directed towards a specific destination IP or network segment is capable of being shared across different paths, thereby facilitating network link load balancing. Several methods exist to implement a path selection strategy that allows for prompt switching of ECMP in the event of a link failure: 1. HASH: This method employs a calculation based on IP quintuples to determine and select a specific path for the data flow.

2. Polling: In this approach, each data stream actively polls to transmit over multiple paths.

3. Path Weighting: Flows are allocated based on the weights assigned to the paths, where greater flow capacity is assigned to paths with higher weights. By utilizing these strategies, data centres can achieve more efficient load balancing and overall improved network performance.

ECMP (Equal-Cost Multi-Path) is a relatively straightforward load-balancing strategy. However, it presents several challenges in practical application: 1. HASH Polarization Issue

The issue of HASH polarization frequently occurs in multi-stage load-balancing scenarios, particularly when multiple interconnected devices adopt the same load-balancing pattern. In such cases, the algorithm may be prone to exhibiting the HASH polarization phenomenon.
2. HASH Consistency Issue

The implementation of an elastic HASH function is designed to maintain consistency by redistributing data flows within the ECMP group following a single link failure. This approach enables the switch to rebalance traffic across the remaining operational links, thereby preserving the integrity of the original HASH traffic. Nonetheless, the elastic HASH function is effective only in circumstances involving a singular port or link failure; it does not facilitate load balancing in instances of multiple simultaneous port or link failures.

from ： https://www.ruijienetworks.com/support/tech-gallery/ruijie-ralb-technology-revolutionizing-data-center-network-congestion-with-advanced-load-balancing