No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

OceanStor 9000 V300R005C00 File System Feature Guide 11

Rate and give feedback :
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
(Optional) Migrating Service Data

(Optional) Migrating Service Data

If FusionInsight Hadoop has HDFS service data before it is interconnected with the OceanStor 9000, the service data needs to be migrated to the OceanStor 9000. If FusionInsight Hadoop has no HDFS service data before it is interconnected with the OceanStor 9000, skip this operation.

Prerequisites

FusionInsight Hadoop has interconnected with the OceanStor 9000.

To ensure successful data migration, related service personnel are advised to confirm data correctness and integrity during verification.

If one or more HDFS, HBase, and Hive components have no service data, there is no need to perform data migration for the components.

Procedure

  1. Log in to a Hadoop client.
    1. Log in to any Hadoop client as user root.
    2. Go to the installation path of Hadoop client (for example: /opt/client), run cd /opt/client.
    3. Run source bigdata_env to configure environmental variables of the client.
    4. When FusionInsight Hadoop adopts the security mode, run kinit admin and enter the login password of the client user.

      When FusionInsight Hadoop adopts the non-security mode, skip this step.

  2. Run the following command to migrate HDFS data.

    Migrate all HDFS data. The following uses migrating data in hdfs://hacluseter/hdfs as an example.

    hadoop fs -get hdfs://hacluseter/hdfs /mnt/nfsdata0

  3. Stop the HBase and Hive services.
    1. Log in to FusionInsight Hadoop Manager and choose Services > HBase > Status > Stop Service. Enter the password of the admin account and click OK.
    2. Choose Services > Hive > Status > Stop Service. Enter the password of the admin account and click OK.
  4. Run the following command to migrate HBase data.

    Migrate all HBase data. The following uses migrating data in hdfs://hacluseter/hbase as an example.

    hadoop fs -get hdfs://hacluseter/hbase /mnt/nfsdata0

  5. Run the following command to migrate Hive data.

    Migrate all Hive data. The following uses migrating data in hdfs://hacluseter/user/hive/warehouse as an example.

    hadoop fs -get hdfs://hacluseter/user/hive/warehouse /mnt/nfsdata0

  6. (Optional) Change the parameter values of the Hive database.

    If the Hadoop cluster has not been started, skip this step.

    1. Record the IP address of Active DBService.

      Log in to FusionInsight Hadoop Manager and choose Services > DBService > Instances. Record the business IP addresses in the rows where Active resides.

    2. Log in as user root to the node to which the Active DBService IP address belongs.
    3. Run the following command to log in to the database:

      node1:~ # su - omm
      omm@node1:~> gsql -d HIVEMETA -U omm -p 20051 -W password

      password is the user omm's password of the database.

    4. Execute the following SQL statements:

      update DBS set DB_LOCATION_URI='nas:/user/hive/warehouse';
      update SDS set LOCATION='nas:/user/hive/warehouse/lineitem';
      \q

  7. Start the HBase and Hive services.
    1. Log in to FusionInsight Hadoop Manager and choose Services > HBase > Status > Start Service. Click OK.
    2. Choose Services > Hive > Status > Start Service. Click OK.

Verification Procedure

Log in to any Hadoop client as user root and run hadoop fs -ls / to verify data correctness and integrity.

Translation
Download
Updated: 2019-03-30

Document ID: EDOC1000101823

Views: 19574

Downloads: 99

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next