topic Re: Loading multiple files in QlikView

Loading multiple files

Thu, 22 Aug 2013 17:17:04 GMT

Hi All,

Need some help with loading multiple files form a remote system.

There is a base folder and it has many sub folders.

I need to conditionally load all the files from the lowest level

Ex. C:\CAMP_BASE

C:\CAMP_BASE\OCT-10

C:\CAMP_BASE\NOV-10

C:CAMP_BASE\ARCH <------------------------ Skip folder

C:CAMP_BASE\ARCH\\NOV-10\FILE_FOLD1 <- Skip

C:CAMP_BASE\SOMEOTHER <-------------------Skip folder

C:\CAMP_BASE\OCT-10\FILE_FOLD1

C:\CAMP_BASE\OCT-10\FILE_FOLD2

C:\CAMP_BASE\NOV-10\FILE_FOLD1

C:\CAMP_BASE\OCT-10\FILE_FOLD1_REDO_T <-------------------Skip folder

C:\CAMP_BASE\OCT-10\FILE_FOLD1_REDO_T\OCT-10\FILE_FOLD1 <--- Skip

Condition 1 : skip all the folders that do NOT have "-" in the name

Condition 2 : In the next level skip any folder with a name contains word "REDO"

So that I will end up with the following folders

	C:\CAMP_BASE\OCT-10\FILE_FOLD1
	C:\CAMP_BASE\OCT-10\FILE_FOLD2
	C:\CAMP_BASE\NOV-10\FILE_FOLD1

Any Idea?

Thanks,

Aji Paul.

Re: Loading multiple files

Thu, 22 Aug 2013 17:19:09 GMT

Additional info

These folders may contain many text files and need to load all of them *.txt

C:\CAMP_BASE\OCT-10\FILE_FOLD1

C:\CAMP_BASE\OCT-10\FILE_FOLD2

C:\CAMP_BASE\NOV-10\FILE_FOLD1

Re: Loading multiple files

Gysbert_Wassenaar — Thu, 22 Aug 2013 18:14:34 GMT

Maybe something like the script below (adapted from Henric's code here😞

Set vConcatenate = ;

sub ScanFolder(Root)

for each FileExtension in 'txt'

for each FoundFile in filelist( Root & '\*.' & FileExtension)

FileList:

$(vConcatenate)

LOAD *, '$(FoundFile)' as SourceFile

FROM [$(FoundFile)] (txt, codepage is 1252, embedded labels, delimiter is ',', msq, header is 2 lines);

Set vConcatenate = Concatenate;

next FoundFile

next FileExtension

for each SubDirectory in dirlist( Root & '\*' )

if (substringcount('$(SubDirectory)','-')) then

call ScanFolder(SubDirectory)

end if

next SubDirectory

end sub

Call ScanFolder(' C:\CAMP_BASE') ;

Re: Loading multiple files

Thu, 22 Aug 2013 18:28:53 GMT

Hi,

How do I exclude name that contain REDO?

Thanks,

Aji Paul

Re: Loading multiple files

Gysbert_Wassenaar — Thu, 22 Aug 2013 18:58:02 GMT

Replace

if (substringcount('$(SubDirectory)','-')) then

with

if (substringcount('$(SubDirectory)','-') and substringcount('$(SubDirectory)','REDO')=0 ) then

Re: Loading multiple files

Fri, 23 Aug 2013 21:22:27 GMT

Thanks for the update! Will update you soon

Re: Loading multiple files

Fri, 23 Aug 2013 21:57:47 GMT

Hi Thank you very much!

It worked awesome!