Issue on JSON files copy on Hadoop

Anonymous — Sat, 16 Nov 2024 08:32:04 GMT

Hi I am trying to extract JSON files from one HDFS location to another HDFS location. I Have followed the proper component and properties set up but yet not see it is functioning although job runs fine. I don't see the put component putting files to destination folder. Can somebody please help me on this?

Re: Issue on JSON files copy on Hadoop

Anonymous — Tue, 10 Apr 2018 11:31:28 GMT

Hello,

Are your HDFS cluster running with or without kerberos authentication? If your HDFS cluster running without kerberos authentication, you can extract JSON files from one HDFS location to another HDFS location.

In tHDFSPut component, you have to define local directory where are stored the files to be loaded in to HDFS.

The workflow looks like:tHDFSConnection-->tHDFSList-->tHDFSGet(load your json files into local)-->tHDFSPut(copies files from an user-defined directory, pastes them into a given Hadoop distributed file system)

Best regards

Sabrina

topic Re: Issue on JSON files copy on Hadoop in Talend Studio

Issue on JSON files copy on Hadoop

Re: Issue on JSON files copy on Hadoop