topic Re: loop through to load all files from a folder and its subfolders? in QlikView

loop through to load all files from a folder and its subfolders?

Wed, 04 Feb 2015 20:13:44 GMT

Hi all,

This is my folder structure

MainFolder

20150102

File1a.txt

File2ab.txt

File3.txt

20150103

File1ab.txt

File2a.txt

File3ab.txt

File4.txt

20150104

File3a.txt

File5.txt

File6.txt

I'm trying to use a Loop function but each text file has a different parameter (comma, space, dash, etc. ). I'm also trying to use a wildcard.

FROM

(txt, codepage is 1252, no labels, delimiter is '|', msq);

my loop statement is written similar to this one but fot TXT file instead of CSV.

http://community.qlik.com/message/262748#262748

how do I combine different parameter, scan folders and subfolder, HELP!!

Thanks in advance

Re: loop through to load all files from a folder and its subfolders?

Wed, 04 Feb 2015 20:36:44 GMT

See if this helps

> loop through to load all files from a folder and its subfolders?

Re: loop through to load all files from a folder and its subfolders?

Wed, 04 Feb 2015 20:44:32 GMT

I used that post as a guide but I have specific folder name that I need to search by.

set Concatenate=;
// subroutine
sub ScanFolder(Root)
for each Ext in 'File1a.txt' // use this to identify file names to load but I can't use the wildcard to pull all File1*
for each FoundFile in filelist(Root & '\*' & Ext)
FileList:
$(Concatenate)
load *
from [$(FoundFile)](txt, utf8, no labels, delimiter is '\t', msq, no eof); // my load has different parameters depending on the file name.

set Concatenate = concatenate;
next FoundFile
next Ext

for each SubDirectory in dirlist(Root&'\*')
call ScanFolder(SubDirectory)
next SubDirectory
end Sub

Call ScanFolder('C:\');

Re: loop through to load all files from a folder and its subfolders?

simospa — Wed, 04 Feb 2015 20:53:27 GMT

But do you know which file has a specific separator? For example: *1*.txt has comma, *2* has slash, etc...?

You could try make several loop, one for type of separator

sub ScanFolder_2(Root)
for each Ext in 'File1a.txt' // use this to identify file names to load but I can't use the wildcard to pull all File1*
for each FoundFile in filelist(Root & '\*' & Ext)
FileList:
$(Concatenate)
load *
from [$(FoundFile)](txt, utf8, no labels, delimiter is ',', msq, no eof); // my load has different parameters depending on the file name.

set Concatenate = concatenate;
next FoundFile
next Ext

for each SubDirectory in dirlist(Root&'\*')
call ScanFolder(SubDirectory)
next SubDirectory
end Sub

Call ScanFolder('C:\');

Call ScanFolder_2('C:\');

etc...

Re: loop through to load all files from a folder and its subfolders?

Wed, 04 Feb 2015 21:36:44 GMT

Yes.
I'm trying this but only one Loop is working.

Re: loop through to load all files from a folder and its subfolders?

simospa — Wed, 04 Feb 2015 22:24:35 GMT

But do you know which files have a specific separator? Can you identify them by the filename?

Re: loop through to load all files from a folder and its subfolders?

Thu, 05 Feb 2015 15:01:47 GMT

yes. I have all specific separator.