topic Re: File loading to Snowflake using Qlik Replicate in Qlik Replicate

File loading to Snowflake using Qlik Replicate

gvkiranreddy325 — Fri, 18 Nov 2022 02:05:47 GMT

Hi Everyone,

Here i am trying to loading to load the data from CSV file to Snowflake.

I have created the Source(File) and Target(Snowflake) end points in Qlik Replicate.

I am confused when i am creating the Source end point, when it is asking me to create the table, and in table selection it is showing nothing in it.

Can anyone of you provide me any reference or steps to follow/ complete this activity? would be really helpful.

I have searched in youtube and help document, everywhere it is having a reference to create Source end point connection but not having full info.

Quick help would be really appreciated.

Thanks

Venkata

Re: File loading to Snowflake using Qlik Replicate

SachinB — Fri, 18 Nov 2022 04:14:44 GMT

Hello @gvkiranreddy325,

Could you please follow the below link in order to define source endpoint as file?

https://help.qlik.com/en-US/replicate/November2022/Content/Replicate/Main/File/define_table_and_full_load_data.htm#Defining%20tables%20and%20full%20load%20data

Creating a Table

The source table definition must match the column data values in the Full Load file(s). So, for example, if the Full Load data file contains the following delimited columns:

22,January,2014,male,5463565

12,May,2011,female,3236776

9,March,2009,male,9648675

30,June,2002,female,3458795

Boolean values must be expressed as the digits 1 (TRUE) or 0 (FALSE) and not TRUE or FALSE.

Then the table definitions would look something like this:

Regards,

Sachin B

Re: File loading to Snowflake using Qlik Replicate

gvkiranreddy325 — Fri, 18 Nov 2022 06:59:34 GMT

Hi Sachin,

Thank you for your solution,

I can definitely follow that approach, and i did create the sample file with 5 columns, with respective 5 columns added in Source end point while creating source end point.

I have followed the help document to create the source table while creating the Source end point, after creating the source end point how to load the file into snowflake?

Should i create the table in target? or Qlik Replicate itself would create the table and load the data into target?

Should i create the table for the file which i am processing? My file contains 250+ columns in it, and multi headers in the same csv file.

In case of multi headers, data should be filtered and routed to the different tables via Qlik to Snowflake? Can it be achivable via Qlik?

FYI, I am providing source file example as below with sample data, kindly assist me, how to complete this scenario.

CSV file:

Sample data as follows:

type, name, id, org_name, org_id, trans_id, addr1, addr2

type, checktype, trasnsid, addr, location

type, tip_trans, dealer_name

values:

invoice header, person1, 1234, Discover, Disc123, k676887090, Houston Texas, Conroe

invoice line, Checking, j909889009, Conroe, Woodlands, Houston

invoice allocation, l999890087, Discover

Thanks

Venkata Kiran

Re: File loading to Snowflake using Qlik Replicate

gvkiranreddy325 — Fri, 18 Nov 2022 07:27:40 GMT

Hi SachinB,

For your reference, I have attached few screenshots.

Please go through them, and can u suggest me some solution.

How to load a file via qlik and populate the single file data into multiple tables in snowflake.

If you're comfortable, can you send me a whatsapp text to connect offline? to below number

Thanks

Venkata

+1 (936)-777-9402

Re: File loading to Snowflake using Qlik Replicate

SachinB — Fri, 18 Nov 2022 08:11:52 GMT

Hello @gvkiranreddy325 ,

From the error which you have highlighted, it appears you don't have a licence to use file type as source. You need to be in touch with your account manager to get new licence for this endpoint. If you're required further information, I would suggest create support case, we will provide required information.

Regards,

Sachin B