Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

AWS S3 - How to read a files from folder and transfer to S3 bucket

Hi there,

I am writing a Talend job to read a file from shared folder and upload it to AWS S3. I have created a job but couldnt figure it out the properties in tS3Put.

I have seen few post before and use following tFileList --> iterator --> tS3Put. 

I couldnt figure it out the use of File or Stream Properties as I want to use tFileList to access files from shared folder.

 

Also I need a dynamic path on S3 folder for the files to upload. eg: it should be based on some reference number. How can I define path based on some variable?

 

0683p000009M96P.png

 

 

0683p000009M96U.png

Labels (4)
2 Replies
Anonymous
Not applicable
Author

There are several global variables defined on tFileList, you can use these global variables on other component. for example:
current file name:
((String)globalMap.get("tFileList_1_CURRENT_FILE"))
current file path:
((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))

so, you can set the File or stream field on tS3Put with global vairable:
((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))

Let me know if you still have any questions.

Regards
Shong
Anonymous
Not applicable
Author

Hi,

I am able to upload the files, but I need a folder to create in side bucket based on some reference number. Currently it is hardcoded. "bucket/TestAWS".

 

Also After upload I need a link of uploaded file and send to Rest API. How to get the file link from S3?

0683p000009M96t.png

Thanks,

Zain