Skip to main content

Sources

Current schema: v2

Produced by: dbt source freshness

This file contains information about sources with freshness checks. Today, dbt Cloud uses this file to power its Source Freshness visualization.

Top-level keys#

  • metadata
  • elapsed_time: Total invocation time in seconds.
  • results: Array of freshness-check execution details.

Each entry in results is a dictionary with the following keys:

  • unique_id: Unique source node identifier, which map results to sources in the manifest
  • max_loaded_at: Max value of loaded_at_field timestamp in the source table when queried.
  • snapshotted_at: Current timestamp when querying.
  • max_loaded_at_time_ago_in_s: Interval between max_loaded_at and snapshotted_at, calculated in python to handle timezone complexity.
  • criteria: The freshness threshold(s) for this source, defined in the project.
  • status: The freshness status of this source, based on max_loaded_at_time_ago_in_s + criteria, reported on the CLI. One of pass, warn, or error if the query succeeds, runtime error if the query fails.
  • adapter_response: Dictionary of information returned from the database, which varies by adapter. Not populated by source freshness checks, as of v0.19.0; we plan to fix in a future release (dbt#2580).
  • execution_time: Total time spent checking freshness for this source
  • timing: Array that breaks down execution time into steps (compile + execute)