Phantom Table that I don't load and can't erase fr... - Qlik Community

optiknerd · ‎2016-01-23

I am getting a bizarre result from my load script.

A table that is not connected to any other table and which is not mentioned/loaded in my script, is appearing in Table Viewer.

A table of that name did exist in a previous version of the script but I have searched the entire script multiple times and am 100% sure that there is no table loaded with the name Data_Updates in my current version of the script. ( I am ticking the search all tabs check box! when I search using Find/Replace)

I do have a QVD called Data_Updates.qvd but I do not have any table loaded with the name Data_Updates.

I have reloaded the script multiple times and the Data_Updates table never goes away.

My script is executing perfectly except for the last part where I am concatenating a table that contains the files that have

already been processed Data_Log.qvd with the files that have just been processed Data_Updates.qvd.

If ScriptErrorCount = 0 then

Load_Register:

LOAD Name, Extention, FileName, Size, FileTime

FROM Data\Data_Log.qvd (qvd);

Concatenate (Load_Register)

LOAD Name, Extention, FileName, Size, FileTime

FROM Data\Data_Updates.qvd (qvd);

Store Load_Register into Data\Data_Log.qvd (qvd);

Drop Table Load_Register;

End If

The script log file gives the following

2016-01-23 11:42:57 AM: 0993 If ScriptErrorCount = 0 then

2016-01-23 11:42:57 AM: 0995 Load_Register:

2016-01-23 11:42:57 AM: 0996 LOAD Name, Extention, FileName, Size, FileTime

2016-01-23 11:42:57 AM: 0997 FROM Data\Data_Log.qvd (qvd)

2016-01-23 11:42:57 AM: 5 fields found: Name, Extention, FileName, Size, FileTime, 3 lines fetched

2016-01-23 11:42:57 AM: 1000 Concatenate (Load_Register)

2016-01-23 11:42:57 AM: 1001 LOAD Name, Extention, FileName, Size, FileTime

2016-01-23 11:42:57 AM: 1002 FROM Data\Data_Updates.qvd (qvd)

2016-01-23 11:42:57 AM: Error: Table not found

2016-01-23 12:00:47 PM: 1004 Store Load_Register into Data\Data_Log.qvd (qvd)

2016-01-23 12:00:47 PM: Error: Table not found

2016-01-23 12:00:48 PM: 1006 Drop Table Load_Register

2016-01-23 12:00:48 PM: Error: Table not found

2016-01-23 12:00:49 PM: 1008 End If

I have tried changing the name of the Load_Register table so that it is recognized on the concatenation. Even with this error, there is no explanation for the phantom table.

I have created an load inline table then commented it out to see if I have some weird memory cache issue going on but it appears and then disappears when I reload after commenting it out of the script.

Has anyone experienced anything like this this?

I am using Personal Edition - 11.20 64bit on Windows 8

swuehl · ‎2016-01-23

Could you post your complete log file?

I assume you are loading a table Data_Updates before the table Load_Register, with same number and names of fields. Hence Load_Register will be auto-concatenated to Data_Updates.

optiknerd · ‎2016-01-23

Hi. Thanks for the rapid response.

I am attaching the log file. I have checked it and the script and as far as I can tell I have never loaded a table called Data_Updates.

Just an FYI on the script and log. It is an incremental load that deals with a recurring text file that has 6 tables embedded in it. The text file changes length so it runs a routine to determine length to do the conditional deletes, then loads the tables in to QVDs with text string keys. The QVDs are then loaded with the master keys converted using Autonumber.

The piece that is not working is supposed to concatenate the file with the list of text files that were already loaded before running the script with the file that has the list of text files that were new (ie updates).

Cheers,

Kevin

Peter_Cammaert · ‎2016-01-23

Ah, some QlikView weirdness! In your Table View screenshot, have you found a table called Load_Register? It should exist, shouldn't it?

A table that has an obvious similarity to a previously loaded table will be autoconcatenated anyway, whether you specify a new label or not (one of my biggest long-time gripes with QlikView - the inconsequential part of it, that is - grrrr). As a result, the second table refuses to be concatenated to a non-existing table and - depending on the mood of QlikView and your actions - the to-be-concatenated table may be orphaned.

No big deal; life is what it is. Add the NOCONCATENATE prefix to the LOAD statement for Load_Register, reload and check your Table Viewer layout again.

Best,

Peter

swuehl · ‎2016-01-23

What about this part in your script:

NoConcatenate

2016-01-23 11:41:46 AM: 0912 Updates:

2016-01-23 11:41:46 AM: 0913 LOAD Name, Extention, FileName, Size, FileTime

2016-01-23 11:41:46 AM: 0914 FROM Data\Updated_Files_List.qvd (qvd) Where Not Exists(Name)

2016-01-23 11:41:46 AM: 5 fields found: Name, Extention, FileName, Size, FileTime, 3 lines fetched

2016-01-23 11:41:46 AM: 0916 Store Updates into Data\Data_Updates.qvd (qvd)

2016-01-23 11:41:46 AM: 0935 Let vNoOfUpdates = NoOfRows('Updates')

2016-01-23 11:41:46 AM: 0936 Set vUpdateSourceTable = 'Data\Data_Updates.qvd (qvd)'

2016-01-23 11:41:46 AM: 0938 Drop Tables Updates, Already_Loaded

2016-01-23 11:41:46 AM: 0940 end sub

2016-01-23 11:41:46 AM: 0979 If 3 > 0 then

2016-01-23 11:41:46 AM: 0981 Set vExecute = 'Yes'

2016-01-23 11:41:46 AM: 0983 Call LoadTextFiles (vUpdateSourceTable, vNoOfUpdates)

2016-01-23 11:41:46 AM: 0037 Load

2016-01-23 11:41:46 AM: 0038 *

2016-01-23 11:41:46 AM: 0039 From Data\Data_Updates.qvd (qvd)

2016-01-23 11:41:46 AM: 5 fields found: Name, Extention, FileName, Size, FileTime, 3 lines fetched

I think the last load of an unlabeled table will result in autolabeled table using the file name.

( I might be wrong, just enter an

Exit Script;

statement after the last load and check the resulting data model.)

optiknerd · ‎2016-01-24

Thanks Peter - I used your suggestion and swuehl's and together they worked. At first I had some wacky results of the concatenation of the second file contents because for some reason it was qualifying both loads so I got a concatenated table that had 10 fields instead of 5. I could not find the Qualify statement to spark this result but I added Unqualify just above the NoConcatenate you suggested I add and now it works like a charm.

Is the unrequested Qualify an undocumented feature you have run into, or do I not understand how Qualify works. I had assumed that you needed to Qualify before each load statement but now am wondering if you turn Qualify on and have to put in an unqualify to stop it from qualifying subsequent tables. Can you clarify??

Thanks again for your help!!!

optiknerd · ‎2016-01-24

Hi swuehl,

I implemented both your and Peter's suggestion (see above) and it now works.

Thanks for your help!!

Cheers

KH

swuehl · ‎2016-01-25

QUALIFY statement is like a switch, it's affecting all subsequent LOAD or SELECT statements.

Peter_Cammaert · ‎2016-01-25

And a QUALIFY never happens out-of-the-blue or by default. You really have to enable it.

[Edit] And yes, qualification is never switched off, except by you with a subsequent (in execution order) UNQUALIFY. If you leave it at the first QUALIFY *, all tables that follow will be quailified.

optiknerd · ‎2016-01-26

Peter - and Swuehl

Thanks for clarification on Qualify. I had moved stuff into a subroutine and there was a hanging Qualifier as a result. Working like a charm now!

Phantom Table that I don't load and can't erase from memory