Redshift
You can leverage our full data stack approach to obtain a complete view of your lineage, from your data warehouse to your BI tool.
You can integrate with Redshift in a few steps.
Follow these steps:
-
Create a dedicated user
-
Grant it the minimal permissions required for Sifflet to operate
-
Connect to Sifflet
1- Create a user
To create the user, you will need to run the following SQL queries.
Please choose a "username" (for instance, "sifflet_user") and a secure password. Store them carefully as you will need them to connect to Sifflet later.
-- Create a user for Sifflet
CREATE USER <username> PASSWORD '<password_to_replace>' SYSLOG ACCESS UNRESTRICTED;
2- Grant the permissions
You can now assign the permissions to the newly created user ("sifflet_user" for instance).
<schema_name> corresponds to the schema you will want Sifflet to monitor.
-- Grant permission to the Sifflet user to read all available schemas
GRANT SELECT ON svv_all_schemas to <username>
-- Grant permission to the Sifflet user to read query history
GRANT SELECT ON TABLE SVL_STATEMENTTEXT to <username>
-- Grant permissions to the Sifflet user
GRANT SELECT ON svv_table_info to <username>
-- Repeat this per schema
GRANT SELECT ON ALL TABLES IN SCHEMA <schema_name> to <username>
GRANT USAGE ON SCHEMA <schema_name> to <username>
ALTER DEFAULT PRIVILEGES IN SCHEMA <schema_name> GRANT SELECT ON TABLES to <username>
The permission on table
SVL_STATEMENTTEXT
enables our field-level lineage feature (see here for more details).
AWS official documentation is here.
3- Connect to Sifflet
To connect to Redshift on Sifflet, you will need the information below:
- the connection details: your Host, Port, Database and Schema
- Connect using SSL or not: Sifflet currently accepts certificates from all certificate authorities. More information here.
- the secret which corresponds to the username and password you previously chose
- the frequency: how often you want the information to be refreshed
To create the Redshift secret, follow the below steps:
- In "Integration" --> submenu "Secrets", create a new secret
- In the "Secret" area, copy-paste the below text and replace it with the correct username and password:
{
"user": "<username>",
"password": "<password>"
}
You can also refer to this page on how to add a data source in Sifflet
Updated 11 months ago