Snowflake Syllabus for Data Engineer
What is Snowflake and why it is the Next Gen of Big Data
Advantages and Disadvantages of Snowflake
On-Premises Vs Cloud
Quick introduction to AWS cloud products
Demo of creating an AWS EC2 Instance
How to upgrade and Downgrade an EC2 Instance
Cost metrics of Storage and Compute cost
Snowflake Architecture
Cloud Services/Metadata Layer
Optimizer
Metadata Manager
Security
Compute/Local/Warehouse Layer
Remote / Permanent Storage Layer How Snowflake Charges its customer
Storage Costs
Compute Costs
Creating a Trial Account
Impact of choosing the Regions (Sharing , Data Transfer Cost )
Exploring the Web UI
Exploring the "Database" , “Shares” ,” Data Market Place” ,” Worksheets Tab”
Exploring the " History " , “Partner Connect” ,””
Help Downloads
SnowSQL
Connectors
Common types of objects in snowflake
Account level objects User , Role , Warehouse , Resource Monitor , Integration ,
Database
Database level objects Schema , Procedures, functions, View, stage, Format ,
Pipe, Stream, Sequence, Tables
Exploring the "Accounts" Tab
Data Transfer
Average Storages Used
Types of Users
Regular User
Read only User
Hands on and Use Cases
Exploring the “Ware houses” tab
Shared Disk Vs Shared Nothing Architecture
Scale UP
Scale OUT
Scaling Policy
In-Built ware houses
AUTOMATIC_CLUSTERING
MATERIALIZED_VIEW_MAINTENANCE
CLOUD_SERVICES_ONLY
Resource Monitor
In-Built Schema
INFORMATION_SCHEMA
PUBLIC
In-Built Databases
SNOWFLAKE_SAMPLE_DATA
SNOWFLAKE
ACCOUNT_USAGE
ORGANIZATION_USAGE
READER_ACCOUNT_USAGE
Access Control ( Roles )
Super User Role
Other Default Roles
Custom Roles
Hands on
Micro Partitions
Immutable
Versioning
Features derived using Micro Partitions
Zero copy Cloning
Streams
Time Travel
Data Backups and Retention
Time Travel
Fail Safe
Data Replication within Cloud Provider
Data Replication across Cloud Provider
Clustering
Clustering Keys
Clustering Information
Overlapping
Overlap Depth
Constant Partition
Average Overlapping
Average Depth
Hands on and Use Cases
Types of Tables
Temporary Table
Transcient Table
Permanent Table
External Tables
Hands on and Use Cases
Views
Normal View
Materialized View
Secured Views
Hands on and Use Cases
Tunning
Query Profiling
Using the Cache
Types of Cache
Results Cache
Local Cache
Enabling and Disabling the Cache
Query tunning hands on using the cache
Shares
In Bound Data
Out Bound Data
Readonly User
Full User
Command Prompt Interface
SnowSQL
Format Objects
Pre-Built/Public Formats
Explicit format objects
Stages
Internal ( User Stage )
Internal ( Table Stage )
Internal ( Named Stage )
External Stage ( AWS, Azure, GCP )
Data movement
PUT Command Hands on
COPY Command Hands on
LIST, GET, REMOVE Command Hands on
Continuous Data Pipelines
Snowpipe
Snowpipe hands on
Snowflake connector for Kakfa ( Introduction only)
Zero copy cloning
Cloning tables
Cloning schema
Cloning database
Custom functions
User Defined Functions (SQL based Functions)
Normal functions
Table functions
User Defined Procedures (JavaScript based Procedures)
Normal procedure
Table procedure
SQL Functions and Procedure Hands on
Tasks
Tasks hands on
Streams
Normal streams
Append only streams
Insert only streams
Preview Feature
Search Optimization
External Table
Organizational Accounts
Snowflake release management
Weekly release
Staged release
Miscellaneous Hands on
Demo on session level lock
Constraint Enforcement in Snowflake
Multi Table Insert
Introduction to VARIANT column
ELT ( Extract Load and Transform )
Quick Introduction
Data Vault
Tri-Secret
Snowflake Editions
Organizational Accounts
Federated Authentication
Batch Loading vs Live Streaming
Data Warehouse vs Data Lake
External Functions
Fetching the Information Schema using TABLE function
Generate
UUID data
Sequence number
Fetch random data from a table
Fetch limited data from a table
Certification Questionnaire(Not Dumps ) Walk Through