No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FusionServer G5500 Server G560 V5 Compute Node User Guide 03

Rate and give feedback:
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
DIMM

DIMM

The server does not support mixed use of different types of DIMMs. Mixed use of the DIMMs may cause the BIOS initialization of the G560 V5 to fail.

The memory subsystem supports LRDIMMs or RDIMMs.

  • RDIMMs support memory address parity check.
  • LRDIMMs support a higher density than single-rank and dual-rank RDIMMs. This increases system memory capacity and bandwidth.

DIMM and CPU Compatibility

Observe the following rules when configuring DIMMs:
  • The G560 V5 supports 8 GB, 16 GB, 32 GB, or 64 GB DIMMs. A G560 V5 that is fully configured with DIMMs provides a maximum capacity of 1536 GB.
  • The maximum number of DIMMs supported by a G560 V5 varies depending on the CPU type, DIMM type, and number of ranks. For details, see Table 5-1.
NOTE:
  • The DIMM slots of CPU 1 must be configured with DIMMs. If DIMMs are configured only in the DIMM slots of CPU 2, the compute node cannot be powered on.
  • Number of DIMMs per channel ≤ Number of ranks per channel/Number of ranks per DIMM.
  • DIMMs of different types (RDIMMs and LRDIMMs) and specifications (such as capacity, bit width, rank, and height) cannot be installed in one G560 V5. That is, one G560 V5 must use DIMMs with the same BOM number. Use the Huawei Server Compatibility Checker to query BOM numbers.
  • All DIMMs in the G560 V5 operate at the same speed, which is the smaller value of the following:
    • Memory speed supported by a specific CPU.
    • Lowest maximum operating speed for the selected memory configuration. For details, see Maximum Operating Speed in Table 5-1.
Table 5-1 DIMM configuration parameters for Intel® Xeon® Scalable CPUs

Item

Specifications

Rank

Dual Rank

Quad Rank

Rated speed (MT/s)

2666

2666

Rated voltage (V)

1.2

1.2

Operating voltage (V)

1.2

1.2

Maximum number of DIMMs

24

24

Maximum capacity per DIMM (GB)

32

64

Maximum memory capacity (GB)

768

1536

Maximum memory capacity at the maximum operating speed (GB)

768

1536

Maximum operating frequency (MHz)

One DIMM per channel

2666

2666

Two DIMMs per channel

2666

2666

Note: This table is for reference only. For details about the components that can be purchased, consult your local Huawei sales representatives.

Memory Subsystem Architecture

The G560 V5 provides 24 DDR4 DIMM slots. Each CPU integrates six memory channels. The memory channels for CPU 1 are 1A, 1B, 1C, 1D, 1E, and 1F, and those for CPU 2 are 2A, 2B, 2C, 2D, 2E, and 2F. Table 5-2 lists channels for each CPU.

Table 5-2 Memory channels

CPU Socket

Channel

DIMM

CPU 1

1A

DIMM000(1A1)

DIMM001(1A2)

1B

DIMM010(1B1)

DIMM011(1B2)

1C

DIMM020(1C1)

DIMM021(1C2)

1D

DIMM030(1D1)

DIMM031(1D2)

1E

DIMM040(1E1)

DIMM041(1E2)

1F

DIMM050(1F1)

DIMM051(1F2)

CPU 2

2A

DIMM100(2A1)

DIMM101(2A2)

2B

DIMM110(2B1)

DIMM111(2B2)

2C

DIMM120(2C1)

DIMM121(2C2)

2D

DIMM130(2D1)

DIMM131(2D2)

2E

DIMM140(2E1)

DIMM141(2E2)

2F

DIMM150(2F1)

DIMM151(2F2)

Slots 1A1, 1B1, 1C1, 1D1, 1E1, 1F1, 2A1, 2B1, 2C1, 2D1, 2E1, and 2F1 are the primary slots of channels 1A, 1B, 1C, 1D, 1E, 1F, 2A, 2B, 2C, 2D, 2E, and 2F, respectively. Install DIMMs in primary DIMM slots first.

For details about DIMM slot locations, see DIMM Slots.

DIMM Ranks

To understand and configure memory protection modes properly, it is helpful to learn about single-rank, dual-rank, and quad-rank DIMMs. Some DIMM configuration requirements are based on these classifications.

  • A single-rank DIMM has one set of memory chips that are accessed while data is written to or read from the memory.
  • A dual-rank DIMM is, effectively, two single-rank DIMMs on the same module, with only one rank accessible at a time.
  • A quad-rank DIMM is, effectively, two dual-rank DIMMs on the same module, with only one rank accessible at a time.

The server memory control subsystem selects a proper rank within the DIMM when writing to or reading from the DIMM.

Dual- and quad-rank DIMMs provide the greatest capacity with the existing memory technology. For example, if the current DRAM technology supports 8 GB single-rank DIMMs, a dual-rank DIMM can offer a capacity of 16 GB and a quad-rank DIMM can offer a capacity of 32 GB.

LRDIMMs are labeled as quad-rank DIMMs. There are four ranks of DRAM on the DIMM, but the LRDIMM buffer creates an abstraction that allows the DIMM to appear as a logical dual-rank DIMM to the system. The LRDIMM buffer also isolates the electrical loading of the DRAM from the system to allow faster operating. These two changes enable LRDIMMs to provide a higher memory operating speed compared with quad-rank RDIMMs.

DIMM Identification

To determine DIMM characteristics, see the label attached to the DIMM and refer to the following figure and table.

Figure 5-18 DIMM identification

No.

Description

Definition

1

Capacity

  • 8 GB
  • 16 GB
  • 32 GB
  • 64 GB
  • 128 GB

2

Rank

  • 1R: single-rank
  • 2R: dual-rank
  • 4R: quad-rank

3

Data width on DRAM

  • X4: 4-bit
  • X8: 8-bit

4

Memory generation

  • PC3: DDR3
  • PC4: DDR4

5

Maximum memory speed

  • 2133 MT/s
  • 2400 MT/s
  • 2666 MT/s

6

CAS latency

  • P: 15
  • T: 17

7

DIMM type

  • R: RDIMM
  • L: LRDIMM

Memory Configuration

The G560 V5 supports the following memory protection modes to increase its availability:
  • Online spare memory: provides protection against failing or degraded DIMMs. Certain memory is reserved as spare, and automatic failover to spare memory occurs when the system detects a DIMM that is degrading. This prevents the system from running on DIMMs prone to uncorrectable errors, which will cause system breakdown.
  • Mirrored memory: provides maximum protection against failed DIMMs. Uncorrectable errors in one channel are corrected by the mirror channel.
  • Memory patrol: corrects errors upon detection. If these errors are not corrected promptly, uncorrectable errors may occur.

To configure memory protection modes, access the BIOS and choose Advanced > Memory Configuration. For details, see the Huawei Server Purley Platform BIOS Parameter Reference.

Online Spare Memory Configuration

Online spare memory provides protection against degraded DIMMs by reducing the likelihood of uncorrected memory errors. This protection is available without any operating system support.

Online spare memory protection dedicates one rank of each memory channel for use as spare memory. The remaining ranks are available for OS and application use. If correctable memory errors occur at a rate higher than a specific threshold on any of the non-spare ranks, the server automatically copies the memory contents of the degraded rank to the online spare rank.

Mirrored Memory Configuration

Mirroring provides protection against uncorrected memory errors that would otherwise result in server downtime. Mirroring is performed at the channel level to one memory channel pair that can be either:

  • Channel 1 data being mirrored in channel 2
  • Channel 3 data being mirrored in channel 4

If an uncorrectable error is detected in the active memory channel, data is retrieved from the mirror channel. This channel becomes the new active channel, and the system disables the channel with the failed DIMM.

Memory Patrol Configuration

The memory engine corrects correctable errors upon detection. If these errors are not corrected promptly, uncorrectable errors may occur.

DIMM Installation Rules

  • General DIMM Installation Rules
    • CPU sockets connected to the installed DIMMs cannot be empty.
    • Do not mix LRDIMMs and RDIMMs in the same compute node.
    • Check the DIMM installation sequence in DIMM Slots.
    • When installing DIMMs in a memory channel, install DIMMs with more ranks and then DIMMs with fewer ranks (starting from the slot farthest from the CPU in the channel). For example, install quad-rank DIMMs, then dual-rank DIMMs, and then sing-rank DIMMs.
  • DIMM Installation Rules for Specific Modes
    • Installation Rules for the Memory Sparing Mode
      • Follow the general DIMM installation rules.
      • The spare configuration of each channel must be valid.
      • Different channels can have different spare configurations.
      • Each channel with DIMMs installed must have a spare rank.
    • Installation Rules for the Memory Mirroring Mode
      • Follow the general DIMM installation rules.
      • Install DIMMs in either channels 1 and 2, or channels 3 and 4. The installed DIMMs must be of the same size and organization.
      • For a multi-CPU configuration, each CPU must have a valid memory mirroring configuration.
    • Installation Rules for the Memory Patrol Mode

      See the general DIMM installation rules.

Installing a DIMM

  1. Power off the G560 V5. For details, see Powering Off the Compute Node.
  2. Remove the G560 V5. For details, see Removing the G560 V5.
  3. Place the G560 V5 on the ESD floor.
  4. Remove the cover. For details, see Removing the Cover of the G560 V5.
  5. Take a spare DIMM out of its ESD bag.
  6. Simultaneously press the ejectors outwards. See Figure 5-19.

    Figure 5-19 Opening the fixing clips on the DIMM slot

  7. Align the DIMM with the DIMM slot, and insert the DIMM into the slot by gently pressing it down until it sits flush with the slot. See Figure 5-20.

    The two fixing clips pop up into place automatically.

    Figure 5-20 Installing a DIMM

  8. Vertically place the air duct downwards. See Figure 5-21.

    Figure 5-21 Installing air ducts

  9. Install the cover. For details, see Installing the Cover of the G560 V5.
  10. Install the G560 V5. For details, see Installing the G560 V5.
  11. Power on the G560 V5. For details, see Powering On the Compute Node.

Translation
Download
Updated: 2018-12-14

Document ID: EDOC1100031433

Views: 39859

Downloads: 107

Average rating:
This Document Applies to these Products
Related Version
Related Documents
Share
Previous Next