Skip to main content
Woohoo! Qlik Community has won “Best in Class Community” in the 2024 Khoros Kudos awards!
Announcements
Join us at Qlik Connect for 3 magical days of learning, networking,and inspiration! REGISTER TODAY and save!
cancel
Showing results for 
Search instead for 
Did you mean: 
prayner
Contributor III
Contributor III

List files in S3 bucket folder using wildmatch operator

I am trying to get a list of files from an S3 bucket using string matching operations. I tried using FileList(), but it doesn't work with the S3 bucket.

for each vFile in filelist('lib://S3Dir/'&'*'&'.qvd')

  Load id from [vFile](qvd)
  ;

next vFile

Using absolute file paths works so I know it is not an issue with the connection. I found some Qlik forum articles discussing the use of tS3List, which seems to be a Talend data integration function that I cannot use it in Qlik load editor.

As a Qlik SaaS developer, how do I get this list of files from the S3 bucket using string matching operations or regex in the data load editor?

Labels (2)
1 Solution

Accepted Solutions
prayner
Contributor III
Contributor III
Author

Found the solution here: https://community.qlik.com/t5/New-to-Qlik-Analytics/Use-of-for-files-in-Amazon-S3/td-p/1718740

My final solution was:

SUB ConcatenateFiles(table_type)

for each vFile in filelist('$(vS3Dir)')

IF WildMatch('$(vFile)', '*$(table_type).qvd') THEN
Load * from [$(vFile)](qvd)
;
END IF

next vFile

END SUB

Call ConcatenateFiles('table_pattern');

View solution in original post

1 Reply
prayner
Contributor III
Contributor III
Author

Found the solution here: https://community.qlik.com/t5/New-to-Qlik-Analytics/Use-of-for-files-in-Amazon-S3/td-p/1718740

My final solution was:

SUB ConcatenateFiles(table_type)

for each vFile in filelist('$(vS3Dir)')

IF WildMatch('$(vFile)', '*$(table_type).qvd') THEN
Load * from [$(vFile)](qvd)
;
END IF

next vFile

END SUB

Call ConcatenateFiles('table_pattern');