Meta Integration® Model Bridge (MIMB)
"Metadata Integration" Solution

MIMB Bridge Documentation

MIMB Import Bridge from Apache Hadoop Hive Database (Hive Metastore via JDBC)

Bridge Specifications

Vendor Apache
Tool Name Hadoop Hive Database
Tool Version 0.13
Tool Web Site http://hive.apache.org/
Supported Methodology [Database] Data Store (Physical Data Model) via JDBC API

Import tool: Apache Hadoop Hive Database 0.13 (http://hive.apache.org/)
Import interface: [Database] Data Store (Physical Data Model) via JDBC API from Apache Hadoop Hive Database (Hive Metastore via JDBC)
Import bridge: 'ApacheHiveMetastore' 10.0.0

IMPORTING FROM HIVE METASTORE DATABASE USING JDBC.

This bridge establishes a JDBC connection to the hive metastore database server in order to extract the physical metadata. It is critical that the parameters are filled correctly to satisfy the local connection requirements on the client workstation that runs the bridge. Please refer to the individual parameter's tool tips for more detailed examples.



Bridge Parameters

Parameter Name Description Type Values Default Scope
Driver location
It's very important to specify valid JARs folder location. All JARs will be added to the CLASSPATH from this folder.

DIRECTORY     Mandatory
Driver class Please copy/paste here 'javax.jdo.option.ConnectionDriverName' value from your hive-site.xml
Usually, this file is located in '/etc/alternatives/hive-conf'
or in an another place depends on you Hadoop/Hive configuration

Examples:
com.mysql.jdbc.Driver
STRING   com.mysql.jdbc.Driver Mandatory
URL Please find 'javax.jdo.option.ConnectionURL' value from your hive-site.xml
and define connection to DB server (mySQL, PostgreSQL,.. etc.) URL

(Example:jdbc:mysql://127.0.0.1)

Usually, this file is located in '/etc/alternatives/hive-conf'
or in an another place depends on you Hadoop/Hive configuration
STRING   jdbc:mysql://127.0.0.1 Mandatory
Metastore Database name Please check 'javax.jdo.option.ConnectionURL' value from your hive-site.xml to determine Hive Metastore Database name
Usually, this file is located in '/etc/alternatives/hive-conf'
or in an another place depends on you Hadoop/Hive configuration

STRING     Mandatory
User The Hive username on whose behalf the connection is being made.

STRING      
Password The Hive user's password on whose behalf the connection is being made PASSWORD      
Schema Description: you can specify a list of Hive schemas to import.
When the list is empty, all available schemas are imported.
The list can have one or more schema names separated by semicolons (e.g. schema1; schema2).

You can specify schema name patterns using '%' wilcard symbol or 'NOT' keyword.

Patterns support inclusions and exclusions.
Here is an example of inclusion syntax, "A%; %B; %C%; D" that tries to get schema names that:
- start with A or
- end with B or
- contain C or
- equal D

To exclude a pattern, prefix it with 'NOT'. Here is an example of exclusion syntax, "A%; NOT %def"
that imports schemas with name started with 'A' and not ended with 'def'
REPOSITORY_SUBSET      
Table This option may be used to specify a specific hive table to import.

Otherwise, when the table name is empty, all available tables are imported.
STRING      
Miscellaneous Specify miscellaneous options identified with a -letter and value.

For example, -m 4G -t 6 -f 100 -j -Dname=value -Xms1G

-f the database driver fetch size in number of rows (e.g. -f 100)

-m the maximum Java memory size whole number (e.g. -m 4G or -m 2500M ).

-v set environment variable(s) (e.g. -v var1=value -v var2="value with spaces").

-j the last option that is followed by Java command line options (e.g. -j -Dname=value -Xms1G).

-i specify this flag to import Indexes.

-zip exportFolder folder to store DDL create tables statements as one zip file (e.g -zip c:/temp/ddl)

-d enables the Kerberos debugging mode that allows you to follow the bridge execution of the Kerberos V5 protocol.
The bridge sets the system property sun.security.krb5.debug to "true".
When you have a Kerberos configuration issue please enable the -d option and send the execution log to support.
STRING      

 

Bridge Mapping

Mapping information is not available

Last updated on Tue, 10 Jul 2018 18:37:05

Copyright © Meta Integration Technology, Inc. 1997-2018 All Rights Reserved.

Meta Integration® is a registered trademark of Meta Integration Technology, Inc.
All other trademarks, trade names, service marks, and logos referenced herein belong to their respective companies.