No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FusionInsight HD V100R002C60SPC200 Product Description 06

Rate and give feedback :
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
Redis

Redis

Comprehensive Cluster Management Functions

FusionInsight HD provides comprehensive Redis cluster management. On FusionInsight Manager, users can create Redis clusters from Redis instance groups to improve system processing capabilities and reliability.
  • Creation of Redis clusters using the wizard
    Figure 4-22 Creating Redis clusters

    FusionInsight HD supports creation of Redis clusters in master/slave mode. The system automatically calculates the number of Redis instances to be installed on nodes and determines the master/slave relationship.

  • Cluster capacity expansion or reduction

    When required, a user can add one or multiple master/slave instances by simply clicking the mouse. The system automatically completes data migration and balancing for capacity expansion.

  • Balance

    Data in Redis clusters may not be evenly distributed if an expansion fails or some instances are offline. FusionInsight Manager provides the Balance function to implement automatic balancing of cluster data, ensuring stable operation of clusters.

  • Performance monitoring and alarming

    The system provides performance monitoring of Redis clusters and intuitive curves to help users learn Redis cluster status and TPS of instances.

    The system provides diverse alarms, such as alarms for cluster offline, persistence failures, uneven slot distribution, active/standby switchover events, cluster HA deterioration, and inconsistent memory size between master and slave instances, for Redis clusters. Diverse alarms facilitate Redis cluster monitoring and management.

Cluster Reliability Guarantee

The cluster management tool redis-trib.rb provided by the Redis community cannot ensure HA of clusters because the master and slave clusters can only be created in fixed sequence. If the master and slave instances are created on the same machine, a failure of one host may cause unavailability of the entire cluster.

During the deployment, expansion, and capacity reduction of Redis clusters, FusionInsight HD calculates the number of instances to be deployed on each node based on the number of specified instances and deploys clusters based on the host-class HA principle. If any host in a cluster is faulty, a master/slave instance switchover is performed, ensuring continuous operation of the cluster.

If the cluster HA cannot be guaranteed when some nodes or instances are faulty at the same time, alarms will be generated prompting the O&M personnel to take measures immediately.

Data Import and Export Tool

A Redis cluster has 16384 slots. The crc16 code of different keys is calculated to determine the slots for storing the keys. This mechanism ensures load balancing of master instances. As a result, different slots store different key values. If two clusters have different topology structure, the keys for different instances are different. This makes data migration or data restoration from backup extremely difficult.

FusionInsight HD provides a dedicated data import and export tool, which facilitates export of Redis cluster data and supports data restoration in the original or new cluster or heterogeneous clusters (clusters with different number of nodes).

Comprehensive Security Features

The community Redis provides the simple password authentication mechanism, and the password in the configuration file is not encrypted. This security mechanism is insecure for enterprise-class applications. FusionInsight HD provides comprehensive security features, including authentication, rights management, and audit.

A client can send data to or request data from a server only after the authentication is successful. Authentication is also performed between the servers in a cluster to prevent requests from forged instances. In addition, Redis commands are classified into read, write, and management commands. Users are assigned different rights to prevent unauthorized operations.

Log audit is performed for Redis critical operations, such as changing the cluster topology and clearing Redis data.

Performance Enhancement

Redis is a high-performance distributed database. However, deployment of Redis instances on a command OS causes limited TPS when the number of concurrent requests from clients increases even if the server has sufficient resources. In addition, the Redis cluster performance cannot be linearly improved with the cluster capacity expansion. FusionInsight HD has incorporated OS enhancement, including CPU binding, NIC queue binding, and OS parameter optimization, ensuring high Redis performance, especially linear performance improvement of Redis clusters.
Figure 4-23 Performance comparison of a single instance
Figure 4-24 Performance comparison of clusters

Enhanced Elimination Algorithm

Redis is a cache system. When the Redis memory reaches the maximum configuration, data elimination is triggered. Native Redis has the LRU, Random, and TTL elimination policies. However, such policies cannot eliminate cold data and reserve hot data in actual server usage.

The elimination algorithm is enhanced for the Redis component on FusionInsight HD by introducing the Smart elimination policy. The Smart elimination policy eliminates data based on key hot statistics, ensuring that only the coldest data is eliminated each time as possible. In simulated service tests, the hot data hit rate of the Smart elimination policy is always greater than 99%, and the hot data elimination rate is about 3% to the maximum (the hot data hit rate and elimination rate of the native LRU policy are 85% and 35% respectively). Thanks to the high hot data hit rate, the service request TPS is increased.

Cluster Pipeline

The Redis server supports pipeline commands sent back clients. That is, the Redis server can receive and process multiple commands at one time, shortening the network transmission duration and increasing the TPS of the Redis server. The Jedis community provides only the single-instance pipeline mode. Huawei clients encapsulate Jedis to ensure that the pipeline mode can also be applied in clusters and the use method of such pipeline mode is the same as that of the single-instance pipeline mode.
Translation
Download
Updated: 2019-04-10

Document ID: EDOC1000104139

Views: 5931

Downloads: 64

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next