Snowflake is a highly, secure automated cloud data warehouse with awesome computational power that does not require installation of hardware or software. Snowflake’s big data architecture is shared and multi-cluster with each cluster accessing data and running independently without conflict. This is ideal for running large queries and operations simultaneously.
The easiest way to get your SQL Server data to Snowflake is with BryteFlow
BryteFlow is a suite of automated, self-service data integration software that is completely codeless and extremely fast. The easy – to – use user interface lets you connect to your SQL Server data sources and replicate data to Snowflake continually with log-based Change Data Capture, after the initial data sync. Data replication proceeds in parallel with data reconciliation. This ensures your data is always updated and in sync with data at source.
Read more on SQL Server CDC for real-time SQL Server replication
Let’s get started with ingesting the SQL Server data
Use the BryteFlow Ingest software and follow these steps:
Please ensure that all pre-requisites have been met and all security and firewalls have been opened between all the components.
Set up the source connection details, assuming the source is SQL Server.
Set up the source connection details. The source can be on the cloud or on-premises.
Set up destination as Snowflake
Set up the table(s) to be replicated, select, the primary key and the transfer type. Primary key with history automatically keeps SCD Type2 history on Snowflake. Primary key transfer type keeps a mirror of the source, without history.
Schedule your data replication time and get your data flowing to Snowflake near real-time.
Initial sync for really large tables
Use theBryteFlow XL-Ingest software and follow these steps:
The tables can be any size, as terabytes of data can be brought across efficiently.
Configure the large table to be brought across.
Monitor the process, as the table is brought across. The table is replicated on Snowflake and is ready to use with SCD Type2 history, if configured. Overall status is displayed on the dashboard.
To experience BryteFlow with Snowflake, start with the free trial and a free training course for setting your replication.
Summing up, we hope you have realized how easy it can be to get your SQL Server data replicated to Snowflake with BryteFlow. Just 4 easy steps and a few clicks, no coding and no waiting required. Any business user can set it up in minutes. If you would like to know more about how BryteFlow works with Snowflake this is recommended reading: