CSV File Format
CSV File Uploads only work for custom integrations that can map their resources to Tables and Columns. Lineage is not support for CSV File Upload at this time.
Generate a CSV of your data that contains a list of all of your columns in the database in the following format.
col_name -> The name of the column (ex.
event_name
)col_description -> The description of the column
Column descriptions can be made up of numbers, letters, and any special characters.
col_type -> The type of data in the column (ex.
character varying(25)
)Column types can be made up of numbers, letters, and any special characters.
col_sort_order -> The default order that the columns should be sorted in
Sort order must be an integer.
name -> The name of the table the column belongs to
Table names can be made up of numbers, letters, and any special characters except periods.
description -> The description for the table the column belongs to.
Table descriptions can be made up of numbers, letters, and any special characters.
database -> The name of the database the column and table belong to.
Column names can be made up of numbers, letters, and any special characters except periods.
schema -> The name of the schema the column and table belong to.
Column names can be made up of numbers, letters, and any special characters except periods.
is_view -> Indicates whether the table is a view (generated from a query).
Is View is a boolean value expecting either
true
orfalse
.
last_updated_time -> The timestamp of when the table was last updated.
Last updated time is a timestamp that expects an integer value of the Unix Epoch time.
For rows which contain columns belonging to the same table, the is_view
, last_updated_time
, name
, and description
fields should all be identical.
Ex. If there are 5 columns all belonging to the table TestTable
, each row for the columns in the CSV would have a name of TestTable
and an identical description.
For example with Snowflake, this CSV can be generated with a SQL statement like this.
Feel free to reach out to us for more guidance on how to generate CSVs.
At this point, you cannot add custom properties or tags using the CSV upload. However, you can add custom properties and tags after the initial extraction has been done using the Import/Export feature.
Last updated