More than one incremental load in same QV-file

[#1]

Hi,

I've developed two separate scripts loading data from different sources. One text file source ( named TEXT) and one Excel scource (EXCEL). The two separate apps works perfectly.

Problem is, these two have to be merged into one QV-file.

And when I try this nothing works.

Not even the initial load.

Pls find attached folder systems with example data.

One for the separate and fully functional apps, and the other one for the merged version (the one not working).

Any clues?

Thanks in advance,

Olle

[kuba_michalik]

If by nothing working for the initial load you mean no QVD for text data appears, the reason is autoconcatenation. If you try loading data into a table with exactly same fields as already existing table, they will get concatenated to the first table, no questions asked. The new table will not be created.

To avoid that, add "NoConcatenate" prefix:

FINAL_TABLE_TEXT:

NoConcatenate

LOAD RIGHT(ACC,7) as ACC,

...

or just drop the table with Excel data right after you store it.

[#3]

Thanks Jakub!

That explains the intial load issues!

However, the incremental parts do still not work. Any clues?

Best Regards,

Olle

[kuba_michalik · Accepted solution]

After you store the Excel data into QVD after incremental load, you keep it in memory and load data from txt which has exact same fields, so the same thing will happen. Just drop all the Excel data after you are done with incremental load and storing.

[#5]

This is great stuff Michalik!

But how do I display all of the data, both Excel and Text?

Since im dropping the EXCEL I end up with TEXT only in my app.

What would you suggest?

Adding another tab loading all of the data in the QVD's?

Or something similar?

Regards,

Olle

[kuba_michalik]

I'd do precisely what you suggested, that is after storing and dropping everything simply load the data from the QVDs at the end just for viewing. It's a bit redundant, but hey, QVDs load so fast it hardly matters

If I wanted to keep things super tidy, I'd create another QVW and use it just for loading QVDs and viewing the data, and the original one just for the reloads.

[#7]

Works like a charm, thanks a lot for your help Jakub!