dbt Cloud

dbt is a data transformation tool that enables data analysts and engineers to transform, test and document data in the cloud data warehouse.

Metaplane can access your dbt cloud metadata to extract metadata about job runs metadata such as run durations, models generated by dbt, and lineage relationships between models. Metaplane is able to match tables in your warehouse with dbt models to determine the causality and consequences of table failure.

🚧

Paid dbt plans only

The dbt Cloud API is only available to Team and Enterprise customers.

Retrieving Service Account Token

  1. Click on your profile icon > Account Settings

  1. Click Service Tokens. Then click New Token

  1. Enter a token name, like Metaplane. Then click + Add and select the Job Admin permission set for All Projects. Lastly, click Save in the bottom right hand corner to create the service token.

  1. Once you click Save, you will be provided a service token. This is what Metaplane will use to start monitoring your dbt projects.

Add Service Token to Metaplane

  1. Navigate to https://app.metaplane.dev/connections
  2. Click on the Add connection button

  1. Select the dbt card

  1. Add the dbt API token into the modal and save
1116

The historical run time data for dbt jobs will immediately start syncing after creating a monitor. You can see the historical runtime of jobs by clicking through to the Duration monitor that you've set up.

Downstream/upstream lineage from dbt will be available within monitors and alerts within 24 hours.