Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I need to load hundreds of zipped files which are in csv format from S3 into Snowflake.
I guess I can use tS3list and tS3Get. I am guessing tS3Get will copy the file locally that I can unzip and load to Snowflake.
However copying file locally to load to Snowflake may not be an optimal approach from performance perspective.
Following post mentions using tDBBulkExec to load from S3 to Snowflake directly. However can I unzip the files as they get loaded to Snowflake?
Would love to see the job design if you have done something similar.
Thanks