topic Re: issue getting Json files from s3 to local machine in Talend Studio

issue getting Json files from s3 to local machine

nivedhitha — Sat, 16 Nov 2024 05:11:30 GMT

Hi everyone,

I trying to do a simple tS3List and ts3Get which iterates through multiple files and also copies it to my local machine but each json file copied has just {}... doesn't have the actual actual from s3.

There are 2 json files in my "controlfiles" bucket wth the same json data(shown below).

tS3List and tS3Get

2 files are copied to my local dir. but the data in the files is wrong

Can someone help me out?

Thanks in advance

Re: issue getting Json files from s3 to local machine

Anonymous — Tue, 23 Jul 2019 21:44:27 GMT

Hi,

What is the data present in the JSON files? Is it blank or some other data. Did you double check whether you are pointing to the right bucket in S3?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: issue getting Json files from s3 to local machine

nivedhitha — Fri, 26 Jul 2019 15:21:38 GMT

Hi @nthampi ,

thanks for your response.

the json file on s3 has data. I used a different approach and it is resolved now.

Re: issue getting Json files from s3 to local machine

Anonymous — Fri, 26 Jul 2019 16:00:51 GMT

@nivedhitha

Could you please explain the solution for the awareness of other Talend Community members?

Please also mark your post containing answer as the solution for the topic.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: issue getting Json files from s3 to local machine

nivedhitha — Fri, 26 Jul 2019 16:33:06 GMT

oh I enabled notification on my s3 bucket and passed it to SQS and then used SQSInput in my Talend job, parsed the JSON message from the queue to get the file name and used just tS3Get with the filename and it worked fine(without ts3List it works fine).