SF#5 Snowflake - Stream Introduction - Tamil Cloudguy - தமிழ்
Snowflake is the only data platform built for the cloud for all your data and all your users. Mobilize your data to advance your business.
Introduction to Stream:
---------------------------------------
A stream is a new Snowflake object type that provides change data capture (CDC) capabilities to track the delta of changes in a table, including inserts and data manipulation language (DML) changes, so action can be taken using the changed data.
A stream is basically a pointer that will let us know the status of the DML operation that was recorded on the defined table. Stream will hold the data until you perform a read operation on the stream. In order to refresh the stream after each delta load you need to read the data from the stream which will clear the data for the next delta. To do this you need to have another table created that can read data from the stream and write it into the other table. Let us name this table as StreamRead. Now all we need to do is to modify our tsk_master. Instead of alter tasks we can now insert records into StreamRead after which our process clears the stream for next load.
Reference data:
https://community.snowflake.com/s/art...
Reference UR: https://pypi.org/project/qrcode/
Tamil Cloudguy Python GitHub: https://github.com/shenbagasundar/Pyt...
Download Python: https://www.python.org/downloads/
Download Visual Studio code IDE: https://code.visualstudio.com/
Thanks and Regards,
Shenbaga Sundar - Tamil Cloudguy
Whatsapp chat group: https://chat.whatsapp.com/GhC0hAKNHsw...
Copyright © 2021 Tamil Cloudguy. All rights reserved.
Contacts:
Email ID: [email protected]
Whatsapp chat group : https://chat.whatsapp.com/GhC0hAKNHsw...
Tamil Cloudguy Facebook : / tamilcloudguy
Tamil Cloudguy LinkedIn : / shenbagasundar
Tamil Cloudguy GitHub : https://github.com/shenbagasundar/
Tamil Cloudguy Youtube : / tamilcloudguy
Tamil Cloudguy G-drive : https://drive.google.com/open?id=1fuW...
#தமிழ் #Snowflake #Streams_and_Tasks