topic Re: Load data from specific files from specific folders in the script in QlikView

Load data from specific files from specific folders in the script

sagarkharpude — Fri, 05 Mar 2021 13:48:49 GMT

Hi Guys,

I want to load data from specific log files(*system*) from multiple specific folders like Folder 1, Folder 4, Folder 6. Could you please tell me the efficient/best way?

For e.g.

Load *

from Path\Folder N/*system*.log

(txt, utf8, embedded labels, delimiter is '\t', msq);

Thanks,

Sagar

Re: Load data from specific files from specific folders in the script

edwin — Sun, 07 Mar 2021 13:51:03 GMT

you can use the for next loop:
For..next ‒ QlikView

For vCounter = 1 to 5 Load * from Path\Folder $(vCounter)/*system*.log (txt, utf8, embedded labels, delimiter is '\t', msq); Next

Re: Load data from specific files from specific folders in the script

manoranjan_d — Sun, 07 Mar 2021 13:56:10 GMT

How to make vcounter = 1 to 5 static to dynamic?

Re: Load data from specific files from specific folders in the script

edwin — Sun, 07 Mar 2021 15:13:22 GMT

what is your business rule to determine N in your original code? if the folders are finite then its a finite number. if not then you need a different approach. so it depends you need to define that so others can advise you

Re: Load data from specific files from specific folders in the script

edwin — Sun, 07 Mar 2021 15:20:12 GMT

if you dont know the number of subfolders then you will need a nested loop:
List folders within a directory - Qlik Community - 88811

your outer loop will give you the folder name so you don't need to use folder$(vcount). you will have a variable that stores the folder name so use that in your inner loop

For each vSubDir in dirlist( 'D:\Backup\*' ) for each vFile in [$(vSubDir)\*system*.log] Load * from [$(vSubDir)\$(File)] (txt, utf8, embedded labels, delimiter is '\t', msq); next vFile Next vSubDir //you just need to experiment with this part: // from [$(vSubDir)\$(File)] //you will see this in your log

Re: Load data from specific files from specific folders in the script

sagarkharpude — Sun, 07 Mar 2021 15:20:36 GMT

Folder numbers are not sequential. It’s like Folder 1, 4 and 6.
can I maintain one inline table of required folders name only? So it will be easier to maintain.

Re: Load data from specific files from specific folders in the script

edwin — Sun, 07 Mar 2021 15:21:42 GMT

you can conrol which folder to be processed in the phrase

in dirlist( 'D:\Backup\*' )

you can use relative paths

Re: Load data from specific files from specific folders in the script

sagarkharpude — Sun, 07 Mar 2021 15:24:13 GMT

Can you please tell me how to pick up certain folders?

Re: Load data from specific files from specific folders in the script

edwin — Sun, 07 Mar 2021 17:36:29 GMT

use your pattern:

'c:\path\folder *'

from your sample this is what you were using so just use that in the directory list function