topic Re: Joining two large data tables in QlikView

Joining two large data tables

mattphillip — Wed, 25 Nov 2020 16:16:04 GMT

Dear Sir/Madam,

I have an extremely large data table loaded into Qlikview (14.5 million rows and 20+ columns - 4 years worth). We recently received this past year's data (2 million rows approx). Both are stored in Excel (.xlsx) and feature the same column names (with the odd exception). My problem is this, whilst typically I would open one of the excel table and simply add the data to the bottom, these tables are too large to open. Is there some way in the load script to join the content of the new table to the existing table's data?

Any help would be most appreciated.

Yours,

Matt

Re: Joining two large data tables

marcus_sommer — Mon, 11 Jul 2016 14:58:13 GMT

Have you tried to load these xlsx direct in qlikview and then storing them as txt-files or just using them as qvd which you then concatenate to your previous data.

- Marcus

Re: Joining two large data tables

jeckstein — Mon, 11 Jul 2016 15:22:41 GMT

If you want to merge 2 tables use a join condition.

So the syntax looks like

Table:

Load ...

From excelFile1 ;

Join(Table)

Load ...

From excelFile2 ;

In your case you would just use

Join("YOUR TABLE NAME HERE") and then add the fields you want.