Add Data with same fields when excel rows limit(10 Million rows) expires

[amanjain57]

Hi,

I am manually uploading the excel files in the QlikSense script to update the data in my QlikSense app.

One of the excel files has reached its maximum rows: 10 million rows beyond which no data could be added.

Still i want to add data to this table and show it up in qlik sense app.

Example : A table created out of my excel file has data from January to March month 2017 with 10 M rows.

Now I have data from April 2017 which i could not upload on the existing excel file as the data rows have reached the limit.

So, I created a new excel file with similar fields(column values) but only difference is the data is added from April month.

How can i combine these two excel files into into one in QlikSense script so that the rows from new excel file adds to rows in old excel file ???

[hector_munoz]

Hi Aman,

You can create a variable with a mask and use it on FROM sentence:

SET vsFile = 'SALES_????_??_??.xlsx';

LOAD *

FROM $(vsFile) (file_parameters) ;

Hope it serves!

Regards,

H

[amanjain57]

Hi Munoz,

But I have two files.

File 1 - data from January- March

File 2- April and beyond

1. Can you explain what do you mean by mask and why do we need to do that?

2. When Loading you are loading only the (vsFile), what about the other file i need to ??

So basically how are we combining the tables so that first all the rows from File 1 appears with same columns and then all the rows from File 2 appears with same columns.

[hector_munoz]

Hi Aman,

Then you would have to use an alternative way to name the files: eg SALES_2017_01.xlsx (january-march), SALES_2017_02.xlsx (for april and may), ...

Regards,

H

[aarkay29]

you can try like this;

Load *

From File1;

Concatenate

Load *

From File 2;

[amanjain57]

Yes, that's understood.

But how do i combine this two files ??

[amanjain57]

Hi Aar Kay,

This seems easy, I will try out this.

[hector_munoz]

Hi,

What Aar Kay proposes is a solution but ou have to touch script every time a new file exists... I attach you a sample with the solution I proposed... Another solutiong would pass using FOR EACH loop...

Regards,

H

[amanjain57]

Thanks Munoz,

I will try both of the suggestions and let you and Aar Kay know the results I am getting

You are right that i need to concatenate every time their is a new file.

Probably a for loop or anything else would work better for future.