Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi I am trying to extract JSON files from one HDFS location to another HDFS location. I Have followed the proper component and properties set up but yet not see it is functioning although job runs fine. I don't see the put component putting files to destination folder. Can somebody please help me on this?
Hello,
Are your HDFS cluster running with or without kerberos authentication? If your HDFS cluster running without kerberos authentication, you can extract JSON files from one HDFS location to another HDFS location.
In tHDFSPut component, you have to define local directory where are stored the files to be loaded in to HDFS.
The workflow looks like:tHDFSConnection-->tHDFSList-->tHDFSGet(load your json files into local)-->tHDFSPut(copies files from an user-defined directory, pastes them into a given Hadoop distributed file system)
Best regards
Sabrina