An overview of the Dataform integration with Secoda
Dataform is a secondary integration that adds additional metadata on to your data warehouse or relational database tables. Before connecting Dataform make sure to connect a data warehouse or relational database first. These include BigQuery, Redshift, etc.
There are three steps to connect Dataform with Secoda:
Enable Dataform API
Create a service account for Secoda
Connect Dataform to Secoda
Go to Google Cloud Console and login.
Make sure you’re working in the project where you want to connect Dataform to Secoda.
Navigate to the APIs & Services page:
In the left-hand menu, go to APIs & Services > Dashboard.
Go to Enable APIs & Services at the top and search for Dataform
Navigate back to APIs & Services page:
In the list of APIs, check if “Dataform API” appears. If it’s listed and says Enabled, it’s active
To provide least privilege to Secoda for extracting Big Query metadata, you can create a new service account following the steps below. Refer to Google Cloud’s documentation about service accounts for more information.
From the Navigation panel on the left, go to IAM & admin > Service accounts
Click Create Service Account along the top
Enter a name (for example: “secoda”) and click Create
When assigning permissions, make sure to grant the following permissions:
a) If you're creating the service account via the GCP console add the following roles:
b) If you're programatically creating the service account add the following roles:
5. Create a JSON key. The downloaded file will be used to create your warehouse in the next section.
Log into your Secoda profile at https://app.secoda.co
From the Navigation panel on the left go Integrations > Add new integration
Select Dataform
Enter in the project name and project location and paste the JSON key file contents that was downloaded
Click "Connect"
Last updated
Was this helpful?
Was this helpful?
Dataform Viewer roles/dataform.viewer