How to load data from multiple subfolders of AWS S3 bucket to Qlik

[Vish35]

Hi Team,

I have this structure of subfolders in AWS S3 bucket. I need to load all CSV files subfolders. How can i do this?

---Development

-------------YearFolder

------------------2025Folder

---------------------03

--------------------------01

---------------------------------------List of csvs

--------------------------02

---------------------------------------List of csvs

--------------------------03

---------------------------------------List of csvs

--------------------------04

---------------------------------------List of csvs

---------------------04

--------------------------01

---------------------------------------List of csvs

--------------------------02

---------------------------------------List of csvs

--------------------------03

---------------------------------------List of csvs

--------------------------04

---------------------------------------List of csvs

---------------------05

--------------------------01

---------------------------------------List of csvs

--------------------------02

---------------------------------------List of csvs

--------------------------03

---------------------------------------List of csvs

--------------------------04

Please suggest ..

[TheLazyDeveloper]

Are you using the amazon s3 v2 connector? if so then use the list table to grab all the folders in the s3 bucket into a new table. You can then create a loop using the folder paths in the table to loop through all the files you need.

https://help.qlik.com/en-US/connectors/Subsystems/Web_Connectors_help/Content/Connectors_QWC/Data-So...

[Vish35]

Hi @TheLazyDeveloper ,

Thanks for your reply. Yes I am using AWS S3 V2 connector. Its direct connection to S3 Bucket via Qlik. How to use ListObjects or other methods at all??  If you can give some insights on this , it will be really helpful.

Thanks

Vishnu

[TheLazyDeveloper · Accepted solution]

Check out the aws metadata connection, it should give you the list folders options you're looking for:

https://help.qlik.com/en-US/connectors/Subsystems/Integrated_Web_Connectors_help/Content/Connectors_...

[Vish35]

Hi @TheLazyDeveloper ,

Thanks. I think this is helpful. Let me give a try. 

Thanks

Vish