BigQuery

BigQuery is a data warehouse from Google Cloud optimized for analytics workloads. Metaplane monitors the data within your BigQuery instance so you can be the first to know if potential data bugs.

Adding BigQuery source

To add a source, navigate to the Connections page and click the BigQuery button. A modal will prompt you for a nickname (e.g. BigQuery Prod), your project_id, and region:

Granting permissions

Metaplane will automatically create a service account and generate commands to access the three following read-only roles to monitor your BigQuery: bigquery.dataViewer (read data and metadata from dataset's tables), bigquery.jobUser (run queries), and bigquery.readSessionUser create and use read sessions).

The commands are in the following format, replaced with your project_id and a metaplane_service_account generated by Metaplane.

gcloud projects add-iam-policy-binding [[project_id]] \
--member [[metaplane_service_account]] \
--role roles/bigquery.dataViewer

gcloud projects add-iam-policy-binding [[project_id]] \
--member [[metaplane_service_account]] \
--role roles/bigquery.jobUser

gcloud projects add-iam-policy-binding [[project_id]] \
--member [[metaplane_service_account]] \
--role roles/bigquery.readSessionUser

The easiest way to run those commands is through the Google Cloud Shell.


Whitelisted IPs

Metaplane will always connect to your data warehouse from these static IP addresses:

  • 52.22.202.169/32
  • 34.199.237.80/32
  • 54.227.153.130/32
  • 34.230.219.122/32
  • 44.197.96.121/32
  • 34.206.79.174/32
  • 107.22.42.246/32

What’s Next
Did this page help you?