dbt Explorer FAQs
dbt Explorer is dbt Cloud’s new knowledge base and lineage visualization experience. It offers an interactive and high-level view of your company’s entire data estate, where you can dive deep into the context you need to understand and improve lineage so your teams can trust the data they’re using to make decisions.
Overview
dbt Explorer makes it easy and intuitive to understand your entire lineage — from data source to the reporting layer — so you can troubleshoot, improve, and optimize your pipelines. With built-in features like project recommendations and model performance analysis, you can be sure you have appropriate test and documentation coverage across your estate and quickly spot and remediate slow-running models. With column-level lineage, you can quickly identify the potential downstream impacts of table changes or work backwards to quickly understand the root cause of an incident. dbt Explorer gives teams the insights they need to improve data quality proactively, ensuring pipelines stay performant and data trust remains solid.
With the current Preview, dbt Explorer is available to everyone on the dbt Cloud Enterprise and Team plans. Certain features within dbt Explorer, such as multi-project lineage and column-level lineage, are only available on the Enterprise plan. dbt Explorer can be accessed by users with developer and read-only seats during the Preview period.
dbt Explorer is the default documentation experience for dbt Cloud customers. dbt Docs is still available but doesn't offer the same speed, metadata, or visibility as dbt Explorer and will become a legacy feature.
How dbt Explorer works
No. dbt Explorer and all of its features are only available as a dbt Cloud user experience. dbt Explorer reflects the metadata from your dbt Cloud project(s) and their runs.
dbt Explorer defaults to the latest production state of a project. Support for staging is now in beta.
development (Cloud CLI and IDE) environments is coming soon. Users can only assign one production and one staging environment per dbt Cloud project.
Simply select Explore from the dbt Cloud top navigation bar. dbt Explorer automatically updates after each dbt Cloud run in the given project’s environment (production, by default). The dbt commands you run within the environment will generate and update the metadata in dbt Explorer, so make sure to run the correct combination of commands within the jobs of the environment; for more details, refer to Generate metadata.
Yes. The lineage that powers dbt Explorer is also available through the Discovery API.
dbt Explorer reflects all the lineage defined within the dbt project. Our vision for dbt Explorer is to incorporate additional metadata from external tools like data loaders (sources) and BI/analytics tools (exposures) integrated with dbt Cloud, all seamlessly incorporated into the lineage of the dbt Cloud project.
Key features
Yes. Refer to Explore multiple projects to learn more.
Resource search capabilities include using keywords, partial strings (fuzzy search), and set operators like OR. Meanwhile, lineage search supports using dbt selectors. For details, refer to Keyword search.
dbt Cloud updates the performance charts and metrics after a job run.
A chart of models built by month is available in the dbt Cloud dashboard.
Yes. Today, you can edit descriptions in the dbt Cloud IDE or CLI by changing the YAML files within the dbt project. In the future, dbt Explorer will support more ways of editing descriptions.
Recommendations largely mirror the best practice rules from the dbt_project_evaluator package. At this time, recommendations can’t be customized. In the future, dbt Explorer will likely support recommendation customization capabilities (for example, in project code).
Column-level lineage
Column-level lineage in dbt Explorer can be used to improve many data development workflows, including:
- Audit — Visualize how data moves through and is used in your dbt project
- Root cause — Improve time to detect and resolve data quality issues, tracking back to the source
- Impact analysis — Trace transformations and usage to avoid introducing issues for consumers
- Efficiency — Prune unnecessary columns to reduce costs and data team overhead
Yes. Column-level lineage can handle name changes across instances of the column in the dbt project.
No. Cross-project column lineage is supported in the sense of viewing how a public model is used across projects, but not on a column-level.
Yes. Column-level lineage is available through a beta endpoint using the Discovery API to dbt Cloud Enterprise plan customers.
Not currently, but this type of functionality is planned for future releases.
Not currently, but we plan to incorporate column-level awareness across features in dbt Cloud in the future.
Availability, access, and permissions
Read-only users can consume metadata in dbt Explorer. More bespoke experiences and exploration avenues for analysts and less-technical contributors will be provided in the future.
dbt Explorer is available on the dbt Cloud Team and Enterprise plans. Certain features within dbt Explorer, like multi-project lineage and column-level lineage, are only available on the Enterprise plan.
No. dbt Explorer is a dbt Cloud-only product experience.
Yes, during the current Preview period.
The ability to embed and share views is being evaluated as a potential future capability.