I am doing a multiple file upload but it is removing some lines as QlikView does not recognize these files being the 'same', creating a Syntax. Below is my LOAD Script.
I believe it is using my first data as the 'main' data and then trying to consolidate data.
I believe the error is somewhere at the top (in bold).
Please help!!!
LOAD*,
if(index('.jpg.ico.gif.png',Extension) > 0, 'Yes', 'No') as IsImage;
The preceding loads are only applied to the first .txt file. You first want to load the data from all the files into one table and then create the other fields in another load statement using a resident load (or store the intermediate table to a qvd first and load from that qvd).
Loading all files into a single temporary table before doing the preceding loads on a resident load (as Gysbert suggests) will work.
I tend to avoid the issue though by not using * to load from multiple files, if you change the code to load each file at a time using a loop then the preceding load does not cause problems:
for each vFile in FileList('.\ProcessedData_oAuth_*.txt')
LOAD
*,
if(index('.jpg.ico.gif.png',Extension) > 0, 'Yes', 'No') as IsImage
;
[rest of your load here]
@11 as ResponseTimeinMS
FROM
$(vFile)
(txt, codepage is 1252, no labels, delimiter is spaces, msq);
next
There are other advantages of this approach, including the fact you can add extra logic inside the loop - perhaps a trace statement to say which file is being loaded or an if statement to avoid some files (eg. ~ prefixed files when loading from XLS).
