No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FusionInsight HD V100R002C60SPC200 Product Description 06

Rate and give feedback:
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
System Specifications

System Specifications

Table 5-1 lists the FusionInsight HD system specifications.

Table 5-1 System specifications

Type

Indicator

Specifications

Description

Cluster

Maximum number of nodes in the system

5000

Universal x86 servers (not limited to Huawei servers)

Huawei ARM1616 servers

Number of tenants

512

Maximum number of tenants

Number of peer clusters with mutual trust in multiple clusters

1

Number of peer clusters that support mutual trust with each cluster

HDFS

Maximum number of files for each NameNode pair

100,000,000

-

Maximum number of blocks on a DataNode

5,000,000

-

Maximum number of blocks on a DataNode disk

500,000

-

Maximum number of file directories in a directory (excluding recursion)

1,000,000

Configuration parameter:

dfs.namenode.fs-limits.max-directory-items

Maximum number of blocks in each file

1,000,000

Configuration parameter:

dfs.namenode.fs-limits.max-blocks-per-file

Maximum length of a file path

8000

Configuration parameter:

dfs.namenode.fs-limits.max-component-length

Minimum block size

1,048,576

Configuration parameter:

dfs.namenode.fs-limits.min-block-size

Minimum number of normal disks allowed by a DataNode

1

Configuration parameter:

dfs.datanode.failed.volumes.tolerated

Yarn

Maximum memory allocated to a single NodeManager

Physical memory x 0.8

-

Maximum virtual cores allocated to a single NodeManager

Logic CPU x 0.6 to 1.5

-

HBase

Number of HBase RegionServers

512

Number of RegionServer instances of a single HBase service

Number of regions of a RegionServer instance

2000

Maximum number of regions supported by each RegionServer instance

Number of active regions supported by a single RegionServer instance

200

Maximum number of active regions supported by each RegionServer instance

Hive

Number of partitions supported by a single Hive table

10,000

Maximum number of partitions recommended for a single Hive table

Maximum number of files in a single table

1,000,000

Maximum number of files that can be stored in the HDFS for a single Hive table

Maximum number of partitions

3,000,000

Maximum number of partitions recommended for each Hive service table

Maximum number of concurrent requests of a single HiveServer

500

Maximum number of concurrent requests supported by a HiveServer instance

Storm

Number of nodes in a Storm cluster

128

Universal x86 servers (not limited to Huawei servers)

Huawei ARM1616 servers

Kafka

Number of nodes in a Kafka cluster

64

Universal x86 servers (not limited to Huawei servers)

Huawei ARM1616 servers

Redis

Number of instances in a single Redis cluster

512

Number of Redis processes

Number of Redis clusters

512

Maximum number of Redis clusters

Solr

Number of instances in a Solr cluster

500

Number of Solr processes

Number of cores supported by a single SolrServer

200

-

Number of records supported by a single core

1 to 400,000,000

-

Maximum memory configuration of a single SolrServer

31 GB

-

Maximum memory and disk ratio of a single SolrServer

1:20

-

ZooKeeper

Number of ZooKeeper instances in a single cluster

5

Maximum number of ZooKeeper instances

Maximum number of connections of a single IP address for each ZooKeeper instance

2000

-

Maximum number of connections for each ZooKeeper instance

20,000

-

Maximum number of ZNodes under the default parameter configurations

400,000

-

Size of a single ZNode

4 MB

-

Flume

Maximum number of Flume instances in a cluster

128

Maximum number of Flume instances

Translation
Download
Updated: 2019-04-10

Document ID: EDOC1000104139

Views: 6027

Downloads: 64

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next