Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

AWS S3 - How to read a files from folder and transfer to S3 bucket

Hi there,

I am writing a Talend job to read a file from shared folder and upload it to AWS S3. I have created a job but couldnt figure it out the properties in tS3Put.

I have seen few post before and use following tFileList --> iterator --> tS3Put. 

I couldnt figure it out the use of File or Stream Properties as I want to use tFileList to access files from shared folder.

 

Also I need a dynamic path on S3 folder for the files to upload. eg: it should be based on some reference number. How can I define path based on some variable?

 

0683p000009M96P.png

 

 

0683p000009M96U.png

Labels (4)
2 Replies
Anonymous
Not applicable
Author

There are several global variables defined on tFileList, you can use these global variables on other component. for example:
current file name:
((String)globalMap.get("tFileList_1_CURRENT_FILE"))
current file path:
((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))

so, you can set the File or stream field on tS3Put with global vairable:
((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))

Let me know if you still have any questions.

Regards
Shong
Anonymous
Not applicable
Author

Hi,

I am able to upload the files, but I need a folder to create in side bucket based on some reference number. Currently it is hardcoded. "bucket/TestAWS".

 

Also After upload I need a link of uploaded file and send to Rest API. How to get the file link from S3?

0683p000009M96t.png

Thanks,

Zain