No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FAQ – Data Volume Increases After Data in the HBase Table Is Exported

Publication Date:  2019-04-12 Views:  282 Downloads:  0

Issue Description

A customer runs the following command to export the HBase table data: hbase org.apache.hadoop.hbase.mapreduce.Export -Dhbase.mapreduce.include.deleted.rows=true tbl_tran_detail /tmp/tbl_tran_detail.

It is found that the volume of the exported data is much larger than that in the original file, as shown in the following figure.


Solution

The HBase table is compressed, and the compression algorithm is not specified during the export. As a result, the data volume increases.

In hbase shell, sort the table names in descending order to check whether the compression function can be enabled.

The parameters in the following figure can be used to specify the compression algorithm.

END