topic Re: Script Execution Progress Freeze in QlikView

Script Execution Progress Freeze

Thu, 08 Aug 2013 08:32:02 GMT

Hello,

We are trying to insert 3 new databases in our qlikview file but script freeze each time.

There is no error message appearing, it's just stopped but the window is not closed.

Is that because there is too much lines. It was working with 4 first database but it's not since we have integrated the last three one.

Thanks for your help.

Benjamin.

Re: Script Execution Progress Freeze

Gysbert_Wassenaar — Thu, 08 Aug 2013 10:20:41 GMT

The number of records shouldn't be any problem. You're loading only about 4 million records. The problem is likely an issue in the data model. If your tables have fields in common then synthetic keys will be created. Those can take a long time to generate. Perhaps you need to concatenate some tables or rename some fields. See this blog post: Synthetic Keys

Re: Script Execution Progress Freeze

Thu, 08 Aug 2013 10:25:04 GMT

Indeed, there 6 tables with the exact sames name fields. I will modify the name and try if it works.

Thanks a lot Gysbert.

Benjamin.

Re: Script Execution Progress Freeze

Gysbert_Wassenaar — Thu, 08 Aug 2013 11:40:47 GMT

If the names of these 6 tables are exactly the same then QV would automatically concatenate them. My guess is that they are not exactly the same. Or some tables have some extra fields that are not in the other tables. If the tables contain the same kind of information (just from a different source, e.g. from different divisions) then you ought to concatenate the tables. If necessary you can force concatenations:

CombinedTable:

Load * , 'FromSource1' as Source

from sourcetable1;

concatenate(CombinedTable)

Load * , 'FromSource2' as Source

from sourcetable2;

concatenate(CombinedTable)

Load * , 'FromSource3' as Source

from sourcetable3;

...etc

Re: Script Execution Progress Freeze

Thu, 08 Aug 2013 16:01:26 GMT

There is 3 tables with exactly the same and 3 others too.

We will concatenate them and see if it works. Keep you posted.

Thanks a lot.

Benjamin

Re: Script Execution Progress Freeze

Fri, 09 Aug 2013 15:13:58 GMT

Hi Gysbert,

I'm working with ben.will on this issue, I tried to concatenate by following your method and I failed to reload.

We have 3 tables to concatenate, here is our script:

I simplified the script, initially we had 52 lines for each tables (same labels), table 1 (189,000 lines), table 2( 442,000 lines) and table 3 (1,500,000lines)

CombinedTable:

LOAD [Sub BL],
     [Author BusinessUnit Name],
     [Author Desk Name],
     [Author Team Name],
     [Elementary Sales Credit (EUR)]FROM

(txt, codepage is 1252, embedded labels, delimiter is '\t', msq);

concatenate(CombinedTable)

Do you know why it's not working?

Thanks, Helene

Re: Script Execution Progress Freeze

Gysbert_Wassenaar — Sat, 10 Aug 2013 17:17:03 GMT

Hard to say from a distance. Ben stated that the first four tables load ok, but the last three give a problem. Are those last three the ones in the script you posted? It's possible that the problem isn't these three, but fields common between this set of three and some of the other four. Try loading just a few records first instead of the complete set. You can add a line FIRST 100 on the line before the load statement to limit the number of records loaded to 100:

MyTable:

FIRST 100

Load * from ...somewhere...;

If you do that for all the load statements then the reload will probably finish and you can check in the table viewer where synthetic tables are created. Perhaps you can post a screenshot of that and of the complete load script. Or better yet an example document: Preparing examples for Upload - Reduction and Data Scrambling

Re: Script Execution Progress Freeze

rbecher — Mon, 12 Aug 2013 19:51:33 GMT

Hi Helene,

this could be related to one wrong data record in the TSV file (.txt), maybe some strange characters or wrong column format. You should take a look at the record where it's stopping.. Are the files loading as a single load?

- Ralf