Airflow
An overview of the Airflow integration with Secoda
There are three steps to get started using Airflow with Secoda:
- 1.Enable the Airflow REST API
- 2.Connect Airflow to Secoda
- 3.Whitelist Secoda IP Address
Secoda uses the Airflow stable REST API, which is only available on Airflow v2.0+. For Secoda to retrieve metadata from Airflow, you need to enable your Airflow's REST API. To do this, edit your
airflow.cfg
file and change the line below to airflow.api.auth.backend.basic_auth
\[api] auth_backend = airflow.api.auth.backend.deny_all
After changing this is what the line should look like:
[api] auth_backend = airflow.api.auth.backend.basic_auth
After enabling the Airflow REST API, the next step is to connect Secoda:
- 1.In the Secoda App, select ‘Add Integration’ on the Integrations tab
- 2.Search for and select ‘Airflow’
- 3.Enter your Airflow user and password. This information is kept encrypted.
- 4.Click 'Connect'
VPCs keep servers inaccessible to traffic from the internet. With VPC, you’re able to designate specific web servers access to your servers. In this case, you will be whitelisting the Secoda IPs to read from your Airflow instance.
Allow Secoda to access your Airflow API from the IP address
35.175.75.15/32
Last modified 1mo ago