topic Re: How to load multiple CSV files (80000+ files) to Qlik Sense Desktop in Connectivity & Data Prep

How to load multiple CSV files (80000+ files) to Qlik Sense Desktop

Anonymous — Fri, 25 May 2018 06:44:01 GMT

I'm very new to Qlik sense desktop,

Please guide me in detail how to load multiple Csv files to Qlik Sense Desktop & after that i need to prepare Graphs/Charts based on data available in these sheets data/Time wise to check statistics of Network

These 80000+ files are classified in to

1. 20 different csv files

2. Each csv file has different content

3. These 20 different csv files are of 15 min Interval starting from 01052018 to 23052018 which is mentioned clearly in two columns of every sheet with Start time & End time

I need to check statistics of my nodes for entire May month.

Please let me know how to go ahead with this task.. It will be more helpful if it is guided step by step.

I have formulas to calculate statistics

Re: How to load multiple CSV files (80000+ files) to Qlik Sense Desktop

bme — Fri, 25 May 2018 18:12:26 GMT

You're going to need to learn Qlik Script pretty fast. This is too much to put into a great level of detail. However, here are the basic steps I'd follow:

Hopefully each of the 20 types of CSV are in the same place or at least follow the same naming convention. Then you can use wildcards to load a bunch. That will look something like the following with one for each file version.

Type1:

LOAD

Date,

Value

FROM [lib://Folder/Type1FileName*.csv]

(txt, codepage is 28591, embedded labels, delimiter is ',', msq);

Then you'll need to transform it to link or concatenate all your data as appropriate. This would at least need to link based on the interval range fields.

Finally you'll use interval match with your interval ranges to attach a calendar dimension.

Re: How to load multiple CSV files (80000+ files) to Qlik Sense Desktop

Anonymous — Mon, 28 May 2018 05:59:20 GMT

Thanks for the update

It was really helpful. I'm just looking to create Graphs by using formulas & the formulas numerator & denominator content is available in sheets. I have created connection & imported data of following columns in to Qlik sense desktop.

Can you share any sample how to create graphs with following data? Thanks

Type1:

LOAD

DateAndTimeStart,

DateAndTimeEnd,

NumberOfXXXX,

InitialSuccessfullyXXXXXX,

AdditionalSuccessfullyXXXXX

FROM [lib://Suresh/vLte*.csv]

(txt, codepage is 28591, embedded labels, delimiter is ',', msq);

Re: How to load multiple CSV files (80000+ files) to Qlik Sense Desktop

Anonymous — Mon, 04 Jun 2018 11:15:21 GMT

Thanks it was really helpful & i was succeeded with the script