I have to pick these files from a specific directory using Talend and load it into hdfs. There will be no transformation involved. Also, as there will be more than 50 xml format I don't want to go through creating the metadata schema individually for each file format.Is there any way to automate this task?
If you want to load the whole xml file to HDFS, you can use tHDFSPut component, set the filemask as "*.xml", it will put all the files in the local folder where you specified to HDFS server.