No relevant resource is found in the selected language.

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy>Search

Reminder

To have a better experience, please upgrade your IE browser.

upgrade

FusionInsight HD 6.5.0 Product Description 02

Rate and give feedback:
Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document. Note: Even the most advanced machine translation cannot match the quality of professional translators. Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
SQL-based Unified Search

SQL-based Unified Search

Overview

Currently, Spark accesses data in HBase through Hive on HBase interfaces, but the Filter is not pushed down. SQL-based unified search is implemented to achieve the unified use of Solr and HBase, and to improve the HBase query performance with the help of Solr's high-speed search function. The SQL-based unified search is implemented based on the datasource API, with SQL being used as the entry and Solr storing indexes. The rowKeys which returned by Solr query are used to search in HBase tables.

Architecture

Spark SQL provides a uniform datasource API to access diverse data sources. To access a specified data source, implement the datasource and relation. To ensure design consistency, SQL-based unified search also serves a data source to interconnect with Spark. HBase is responsible for storing lower-layer data, and Solr is responsible for storing indexes. SQL-based unified search implements an API to search the indexes and return rowKeys of HBase, and then search HBase for the data by the rowKeys and return the data to Spark for processing.

Figure 4-33 Architecture
Download
Updated: 2019-05-17

Document ID: EDOC1100074548

Views: 3982

Downloads: 37

Average rating:
This Document Applies to these Products
Related Documents
Related Version
Share
Previous Next