Crawl Snowflake datasource using JDBC(v2) connector

Goal

Ingest data into Fusion from a Snowflake database using the JDBC (v2) connector

Environment

Fusion 5.x.x (Any Fusion version that supports a JDBC v2 connector)

Guide

Requirements

1. Get appropriate snowflake driver from: https://repo1.maven.org/maven2/net/snowflake/snowflake-jdbc/ (latest stable version is recommended)

2. Credentials to Snowflake

3. Classname of the JDBC driver: net.snowflake.client.jdbc.SnowflakeDriver

Steps

1. Create a JDBC (v2) datasource by navigating to Indexing → Datasources → Add → JDBC (v2).
2. Provide details such as configuration ID, Pipeline ID & Parser ID

3. Configure the JDBC URL using the following details:

   
   a. Obtain details such as the Account identifier and Login name from the Snowflake Account Details UI.

   
    

   b. Use the following JDBC format and the collected information to prepare the JDBC connection string for the connector. The connection parameters allow you to specify the database and schema to use from Snowflake.

   "jdbc:snowflake://<account-identifier>.snowflakecomputing.com/?&warehouse=<name>&db=<name>&schema=<name>"
   e.g. jdbc:snowflake://GOFDOLA-LZ08008.snowflakecomputing.com/?warehouse=COMPUTE_WH&db=SNOWFLAKE_SAMPLE_DATA&schema=TPCH_SF1

    

4. Enter the Snowflake instance credentials in the Username and Password fields.
5. Provide appropriate values for SQL Query and Primary Key based on the dataset being retrieved.
6. Under JDBC classname, enter the following value: net.snowflake.client.jdbc.SnowflakeDriver
7. A sample datasource screenshot is given below.
   
8. Save the datasource. 
9. Open System → Blobs.
10. Select Add → JDBC Driver, and upload the appropriate driver downloaded as instructed under the requirements.
11. Run the newly created datasource to complete the crawling process.