Certain core functionality may vary. If you would like to report a bug, request a feature, or contribute, you can check out the linked repository and open an issue.
Overview of dbt-rockset
- Maintained by: Rockset, Inc.
- Authors: Rockset, Inc.
- GitHub repo: rockset/dbt-rockset
- PyPI package:
- Slack channel: #dbt-rockset
- Supported dbt Core version: v0.19.2 and newer
- dbt Cloud support: Not Supported
- Minimum data platform version: ?
pip is the easiest way to install the adapter:
pip install dbt-rockset
dbt-rockset will also install
dbt-core and any other dependencies.
For Rockset-specifc configuration please refer to Rockset Configuration
For further info, refer to the GitHub repository: rockset/dbt-rockset
Connecting to Rockset with dbt-rockset
The dbt profile for Rockset is very simple and contains the following fields:
api_server: [api_server] # (Default is api.rs2.usw2.rockset.com)
|view||YES||Creates a view.|
|table||YES||Creates a collection.|
|ephemeral||YES||Executes queries using CTEs.|
|incremental||YES||Creates a collection if it doesn't exist, and then writes results to it.|
unique_keyis not supported with incremental, unless it is set to _id, which acts as a natural
unique_keyin Rockset anyway.
tablematerialization is slower in Rockset than most due to Rockset's architecture as a low-latency, real-time database. Creating new collections requires provisioning hot storage to index and serve fresh data, which takes about a minute.
- Rockset queries have a two-minute timeout. Any model which runs a query that takes longer to execute than two minutes will fail.