Enterprise Scale | |
Permissions |
|
Platform(s) |
|
Related reading |
Snowflake integration for HyperDB in Airtable overview
The Snowflake HyperDB integration allows you to sync the contents of a Snowflake view (saved query) or table into Airtable. Because HyperDB is the destination for this integration, you can now also sync much larger datasets than our standard Snowflake sync. One HyperDB Table can contain up to 100M records.
The Snowflake integration is a one-way sync into HyperDB, so changes made in Airtable or HyperDB cannot be synced back to the external application from which you are syncing.
Understanding the Snowflake integration for HyperDB
The HyperDB integration is configured to run once every 24 hours—nightly, at 9PM Pacific time. Admins can also manually trigger data imports via the admin panel.
The integration uses either OAuth authentication or Key Pair Authentication to access data in Snowflake. Configuring this for a Snowflake account/instance requires a one-time setup with account admin access to Snowflake and organization admin access in Airtable.
Snowflake integration for HyperDB admin configuration (OAuth)
The Snowflake integration requires the same admin setup as the in-base integration, using OAuth authentication. Configuration requires:
One-time setup with account admin access to Snowflake and organization admin access in Airtable
After setup, all users within your organization can connect their Snowflake account to Airtable
Follow the steps at Airtable Sync Integration: Snowflake to complete the admin setup.
Connecting to Snowflake
Option 1: Using Key pair:
Open your admin panel.
Click HyperDB.
Click Add table.
Click Snowflake, then Next.
Click Key pair.
Follow the Snowflake Key Pair Authentication instructions to generate the specific private key.
Option 1: Using OAuth:
Open your admin panel.
Click HyperDB.
Click Add table.
Click OAuth, then Next.
Select an account to use.
Note
By Default, Snowflake OAuth authorizations last for only 90 days and then expire, which causes your syncs to stop working.
To reconnect your Snowflake connection after being disconnected:
Open your Airtable homepage.
Click on your profile picture in the top-right corner.
Click Integrations.
Click the … icon next to Snowflake.
Choosing Snowflake data to sync
After authenticating, you're asked to select the data source for your HyperDB table and specify the following information:
Warehouse - Snowflake's virtual warehouse used for SQL queries
Database
Schema
Whether you want to sync from a table or view
Source - the specific model in Snowflake to sync
Note
Airtable prepopulates the possible options in the dropdown shown below based on the permissions your connected account has within Snowflake.
Finalizing the Snowflake data connection
To finalize your Snowflake connection:
Choose a unique primary ID for the data set (text type required).
Make schema modifications to the import, like converting fields to single selects.
Choose a secondary search column for human-readable searches.
Optionally customize data types (though we recommend doing most type definitions within Snowflake)
Name your HyperDB table and provide a description.
FAQs
What immediately happens after creating a HyperDB table:
After creating a HyperDB tabe, you should:
Your data preview is available.
Your initial data import may take some time to complete based on its size.
Your data will automatically refresh nightly