Generic Tables - JOIN and DROP consumes lot time and RAM- Help?

[dmohanty]

Hi All,

QVW File and Source attached.

• I have a requirement, where I have to create fields from the values in BookmarkFieldName andBookmarkFieldValue to be converted to Field Names.
• I am able to convert them into fields using GENERIC LOAD.
• But as there are lot of Tables and Data Models are being created (no Synthetic Keys), we need to Join those to the Main table and finally drop the Generic Tables.
• For this I have a script to JOIN and DROP. But this takes a pretty lot of time to do the job and consumes the full RAM of the system making the system dead slow.
• Here is the script suggested by rwunderlich‌ in his Cookbook (Use cases for Generic Load | Qlikview Cookbook).

//////   JOIN & DROP loop to consolidate the Generic tables

FOR i = NoOfTables()-1 to 0 STEP -1
LET vTable=TableName($(i));
IF WildMatch('$(vTable)', 'Generic.*') THEN
LEFT JOIN (BM) LOAD * RESIDENT    [$(vTable)];
DROP TABLE  [$(vTable)];
ENDIF
NEXT i

Could someone please help here in the attached Model, to resolve the issue?

Regards!

[Gysbert_Wassenaar]

• But as there are lot of Tables and Data Models are being created (no Synthetic Keys), we need to Join those to the Main table and finally drop the Generic Tables.

No, you don't actually.

The Generic Load:

The result is one big table that contains all attributes; a table that often is sparse (containing many NULL values) and much largerthan the initial tables. And no performance has been gained… So I can only say:

You should not do this - unless you have a specific reason to.

[dmohanty]

Thank you gwassenaar‌ for sharing the link on this.

Now I see a better picture of the Generic Load concept. Earlier I was wondering the huge bunch of tables don't looks good in the Table Viewer, I wanted to get rid of those!