No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

OceanStor 9000 V300R005C00 File System Feature Guide 11

Rate and give feedback :
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
Restrictions

Restrictions

This section describes the restrictions on the HDFS feature.

Function Restrictions on FusionInsight Hadoop

This section describes the function restrictions on FusionInsight Hadoop after FusionInsight Hadoop is interconnected with the OceanStor 9000.

Table 14-6 shows FusionInsight Hadoop components supported by HDFS Plugin and component instances.

Table 14-6  FusionInsight Hadoop components supported by HDFS Plugin and component instances

Component

Instance

HDFS

DataNode

JournalNode

NameNode

Zkfc

Hive

HiveServer

MetaStore

WebHCat

HBase

HMaster

RegionServer

ThriftServer

Mapreduce

JobHistoryServer

Yarn

NodeManager

ResourceManager

Spark

JDBCServer

JobHistory

SparkResource

Solr

SolrServer

SolrServerAdmin

HDFS Plugin supports Shell and Java APIs and does not support C and HTTP REST APIs.

The following restrictions are placed on data migration and capacity expansion:

  • If there is data in the HBase and Hive tables before the OceanStor 9000 is interconnected with the FusionInsight Hadoop cluster, manually process the data after the interconnection.

    If the data needs to be retained, migrate the data to save it. If the data does not need to be retained, delete it and then restart the FusionInsight Hadoop cluster. For details, see (Optional) Migrating Service Data.

  • During HDFS data migration, metadata in NameNode, including directory permissions and owning groups of files, cannot be migrated.

    For a Kerberos-authenticated FusionInsight Hadoop cluster, the original permission of data becomes invalid after the data is being migrated and is uniformly changed to 777 (that is, rwxrwxrwx).

  • A newly-added Hadoop node cannot immediately take effect. For details on how to make it take effect, see Adding a Hadoop Node.

  • After OceanStor 9000 is interconnected with the FusionInsight Hadoop cluster, when using Hive to create tables, an error message will display, which does not affect normal use of Hive.

Function Restrictions on Cloudera Hadoop

This section describes the function restrictions on Cloudera Hadoop after Cloudera Hadoop is interconnected with the OceanStor 9000.

Table 14-7 shows Cloudera Hadoop components supported by HDFS Plugin and component instances.

Table 14-7  Cloudera Hadoop components supported by HDFS Plugin and component instances

Component

Instance

HDFS

DataNode

NameNode

SeconaryNameNode

Hive

Hive Metastore Server

HiveServer

WebHCat Server

HBase

HBase Thrift Server

RegionServer

Master

MapReduce

JobTracker

TaskTracker

Yarn

JobHistory Server

ResourceManager

NodeManager

Spark

History Server

Solr

Solr Server

HDFS Plugin supports Shell and Java APIs and does not support C and HTTP REST APIs.

The following restrictions are placed on data migration and capacity expansion:

  • If there is data in the HBase and Hive tables before the OceanStor 9000 is interconnected with the Hadoop cluster, manually process the data after the interconnection.

    If the data needs to be retained, migrate the data to save it. If the data does not need to be retained, delete it and then restart the Hadoop cluster. For details, see (Optional) Migrating Service Data.

  • During HDFS data migration, metadata in NameNode, including directory permissions and owning groups of files, cannot be migrated.

    For a Kerberos-authenticated Hadoop cluster, the original permission of data becomes invalid after being migrated and is uniformly transformed to 777 (that is, rwxrwxrwx).

  • A newly-added Hadoop node cannot immediately take effect. For details on how to make it take effect, see Adding a Hadoop Node.

Translation
Download
Updated: 2019-03-30

Document ID: EDOC1000101823

Views: 20576

Downloads: 99

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next