# Connect Cloudera Impala to dbt Core Local development * **Maintained by**: Cloudera * **Authors**: Cloudera * **GitHub repo**: [cloudera/dbt-impala](https://github.com/cloudera/dbt-impala) [![](https://img.shields.io/github/stars/cloudera/dbt-impala?style=for-the-badge)](https://github.com/cloudera/dbt-impala) * **PyPI package**: `dbt-impala` [![](https://badge.fury.io/py/dbt-impala.svg)](https://badge.fury.io/py/dbt-impala) * **Slack channel**: [#db-impala](https://getdbt.slack.com/archives/C01PWAH41A5) * **Supported dbt Core version**: v1.1.0 and newer * **dbt support**: Not Supported * **Minimum data platform version**: n/a ## Installing dbt-impala Use `pip` to install the adapter. Use the following command for installation: `python -m pip install dbt-impala` ## Configuring dbt-impala For Impala-specific configuration, please refer to [Impala configs.](../../../reference/resource-configs/impala-configs.md) ## Connection Methods dbt-impala can connect to Apache Impala and Cloudera Data Platform clusters. The [Impyla](https://github.com/cloudera/impyla/) library is used to establish connections to Impala. Two transport mechanisms are supported: * binary * HTTP(S) The default mechanism is `binary`. To use HTTP transport, use the boolean option `use_http_transport: [true / false]`. ## Authentication Methods dbt-impala supports three authentication mechanisms: * [`insecure`](#Insecure) No authentication is used, only recommended for testing. * [`ldap`](#ldap) Authentication via LDAP * [`kerbros`](#kerbros) Authentication via Kerberos (GSSAPI) ### Insecure This method is only recommended if you have a local install of Impala and want to test out the dbt-impala adapter. \~/.dbt/profiles.yml ```yaml your_profile_name: target: dev outputs: dev: type: impala host: [host] # default value: localhost port: [port] # default value: 21050 dbname: [db name] # this should be same as schema name provided below, starting with 1.1.2 this parameter is optional schema: [schema name] ``` ### LDAP LDAP allows you to authenticate with a username & password when Impala is [configured with LDAP Auth](https://impala.apache.org/docs/build/html/topics/impala_ldap.html). LDAP is supported over Binary & HTTP connection mechanisms. This is the recommended authentication mechanism to use with Cloudera Data Platform (CDP). \~/.dbt/profiles.yml ```yaml your_profile_name: target: dev outputs: dev: type: impala host: [host name] http_path: [optional, http path to Impala] port: [port] # default value: 21050 auth_type: ldap use_http_transport: [true / false] # default value: true use_ssl: [true / false] # TLS should always be used with LDAP to ensure secure transmission of credentials, default value: true user: [username] password: [password] dbname: [db name] # this should be same as schema name provided below, starting with 1.1.2 this parameter is optional schema: [schema name] retries: [retries] # number of times Impala attempts retry connection to warehouse, default value: 3 ``` Note: When creating workload user in CDP ensure that the user has CREATE, SELECT, ALTER, INSERT, UPDATE, DROP, INDEX, READ, and WRITE permissions. If the user is required to execute GRANT statements, see for instance (/reference/resource-configs/grants) or (/reference/project-configs/on-run-start-on-run-end) appropriate GRANT permissions should be configured. When using Apache Ranger, permissions for allowing GRANT are typically set using "Delegate Admin" option. ### Kerberos The Kerberos authentication mechanism uses GSSAPI to share Kerberos credentials when Impala is [configured with Kerberos Auth](https://impala.apache.org/docs/build/html/topics/impala_kerberos.html). \~/.dbt/profiles.yml ```yaml your_profile_name: target: dev outputs: dev: type: impala host: [hostname] port: [port] # default value: 21050 auth_type: [GSSAPI] kerberos_service_name: [kerberos service name] # default value: None use_http_transport: true # default value: true use_ssl: true # TLS should always be used with LDAP to ensure secure transmission of credentials, default value: true dbname: [db name] # this should be same as schema name provided below, starting with 1.1.2 this parameter is optional schema: [schema name] retries: [retries] # number of times Impala attempts retry connection to warehouse, default value: 3 ``` Note: A typical setup of Cloudera EDH will involve the following steps to setup Kerberos before one can execute dbt commands: * Get the correct realm config file for your installation (krb5.conf) * Set environment variable to point to the config file (export KRB5\_CONFIG=/path/to/krb5.conf) * Set correct permissions for config file (sudo chmod 644 /path/to/krb5.conf) * Obtain keytab using kinit (kinit ) * The keytab is valid for certain period after which you will need to run kinit again to renew validity of the keytab. ### Instrumentation By default, the adapter will send instrumentation events to Cloudera to help improve functionality and understand bugs. If you want to specifically switch this off, for instance, in a production environment, you can explicitly set the flag `usage_tracking: false` in your `profiles.yml` file. To turn off dbt Labs anonymous usage tracking, refer to [Anonymous usage stats](../../../reference/global-configs/usage-stats.md) for more details. ### Supported Functionality | Name | Supported | | ----------------------------------------------- | --------- | | Materialization: Table | Yes | | Materialization: View | Yes | | Materialization: Incremental - Append | Yes | | Materialization: Incremental - Insert+Overwrite | Yes | | Materialization: Incremental - Merge | No | | Materialization: Ephemeral | No | | Seeds | Yes | | Tests | Yes | | Snapshots | Yes | | Documentation | Yes | | Authentication: LDAP | Yes | | Authentication: Kerberos | Yes | ## Was this page helpful? YesNo [Privacy policy](https://www.getdbt.com/cloud/privacy-policy)[Create a GitHub issue](https://github.com/dbt-labs/docs.getdbt.com/issues) This site is protected by reCAPTCHA and the Google [Privacy Policy](https://policies.google.com/privacy) and [Terms of Service](https://policies.google.com/terms) apply.