Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to load a Parquet file into Snowflake using tSnowflakeBulkExec component

I want to load data into Snowflake data warehouse. My data is in the form of Parquet files residing in AWS S3 bucket. I am trying to use the component - tSnowflakeBulkExec to do this task. Talend is giving an error saying - PARQUET cannot be resolved to a variable. I am using the following command in the Copy command options (Manual) of advanced settings :

 

"ON_ERROR='continue' FILE_FORMAT=(type=parquet compression=gzip)"

 

What am i supposed to do to resolve this error. Is tSnowflakeBulkExec the right component to load Parquet file residing in S3 into Snowflake. If not, then which component should i use to do the same.

 

Screenshots of Talend error are attached.

 

Thanks.

 

Labels (5)
1 Reply
Anonymous
Not applicable
Author

Hello,

Talend 7.1.1 version does provide bulk component from which you can load data from s3 to Snowflake by using

tSnowflakeBulkExec componen. With the form of Parquet files,  is it gzip compression file?

Best regards

Sabrina