Redshift

You can leverage our full data stack approach to obtain a complete view of your lineage, from your data warehouse to your BI tool.

You can integrate with Redshift in a few steps.
Follow these steps:

1. Create a dedicated user

2. Grant it the minimal permissions required for Sifflet to operate

3. Connect to Sifflet

1- Create a user

To create the user, you will need to run the following SQL queries.
Please choose a "username" (for instance, "sifflet_user") and a secure password. Store them carefully as you will need them to connect to Sifflet later.

-- Create a user for Sifflet
CREATE USER <username> PASSWORD '<password_to_replace>' SYSLOG ACCESS UNRESTRICTED;

2- Grant the permissions

You can now assign the permissions to the newly created user ("sifflet_user" for instance).
<schema_name> corresponds to the schema you will want Sifflet to monitor.

-- Grant permission to the Sifflet user to read all available schemas
GRANT SELECT ON svv_all_schemas to <username>

-- Grant permission to the Sifflet user to read query history
GRANT SELECT ON TABLE SVL_STATEMENTTEXT to <username>

-- Grant permissions to the Sifflet user
GRANT SELECT ON svv_table_info to <username>

-- Repeat this per schema
GRANT SELECT ON ALL TABLES IN SCHEMA <schema_name> to <username>
GRANT USAGE ON SCHEMA <schema_name> to <username>
ALTER DEFAULT PRIVILEGES IN SCHEMA <schema_name>  GRANT SELECT ON TABLES to <username>

📘

The permission on table SVL_STATEMENTTEXT enables our field-level lineage feature (see here for more details).
AWS official documentation is here.

3- Connect to Sifflet

To connect to Redshift on Sifflet, you will need the information below:

• the connection details: your Host, Port, Database and Schema
• Connect using SSL or not: Sifflet currently accepts certificates from all certificate authorities. More information here.
• the secret which corresponds to the username and password you previously chose
• the frequency: how often you want the information to be refreshed

To create the Redshift secret, follow the below steps:

• In "Integration" --> submenu "Secrets", create a new secret
• In the "Secret" area, copy-paste the below text and replace it with the correct username and password:

{
  "user": "<username>",
  "password": "<password>"
}

You can also refer to this page on how to add a data source in Sifflet