topic Re: Loading .csv data from Amazon S3 cloud in Connectivity & Data Prep

Loading .csv data from Amazon S3 cloud

Barefooter — Fri, 03 Jan 2020 12:12:06 GMT

Hey to All,

I have a problem with loading data out of the Amazon S3 Cloud. I want to load .csv files out of the S3 Cloud and avoidloading data twice. Right now my script is looking like this:

for each vFile in filelist('.csv data from Amazon S3 Cloud')

Load

...

FROM [$(vFile)](txt, utf8, embedded labels, delimiter is ';', msq, header is 10 lines);

next vFile;

Can someone help me? Im still new in Qlik, so I would appreciate every help I get.

Thank you!

Re: Loading .csv data from Amazon S3 cloud

Anil_Babu_Samineni — Fri, 03 Jan 2020 12:29:23 GMT

1) Did you load at least single CSV file initially? If so, we can help for loop

2) Are they CSV storing in one monitor?

3) Or You want to load from Amazon S3 Cloud format source to CSV?

Re: Loading .csv data from Amazon S3 cloud

Barefooter — Fri, 03 Jan 2020 12:46:44 GMT

Hello,

1. I did already load multiple files (at least one) successfully

2. the files are stored as .csv files in the S3 cloud in a subfolder. They are all structured identically (each contains log-data for 1 week, timestamp is the key). So I want to avoid loading old log data again and again).

Re: Loading .csv data from Amazon S3 cloud

Anil_Babu_Samineni — Fri, 03 Jan 2020 13:49:11 GMT

Ok, If that is the case. Is there any structured date on the filename or any Date field in your source? If so, May be this will help you incremental-load