topic Re: tfilelist on multiple file in Talend Studio

tfilelist on multiple file

lmit — Thu, 12 Jul 2018 11:54:56 GMT

Hi All,

i have a requirement where i need to move files from one location to another and need to rename the file and make a single file out of multiple files

so i was using tfilelist and tfilecopy , but am not able to merge all files to single file, i can see only data from the lastfile is got processed , how can append all files into one using these 2 components(tfilelist & tfiecopy)

Thanks,

Lmit

Re: tfilelist on multiple file

Aukema — Thu, 12 Jul 2018 12:08:05 GMT

How about:

tFileList --iterate--> tFileInput (current File) --> tFileOutput (Mergedfile) (enable Append checkbox)

Re: tfilelist on multiple file

lmit — Thu, 12 Jul 2018 13:32:12 GMT

Thanks @saukema for you reply but these files are parquet files and we cant use parquet components in standard jobs

Thanks,

Lmit

Re: tfilelist on multiple file

fdenis — Thu, 12 Jul 2018 14:14:03 GMT

what is a parket file how do you want to merge file?
ascii file + ascii file
xml nodes to group
other like zipped ascii file
Regards,

Re: tfilelist on multiple file

lmit — Thu, 12 Jul 2018 16:19:33 GMT

Parquet file is a one of file format , its kind of .dat files

thanks,

lmit

Re: tfilelist on multiple file

fdenis — Fri, 13 Jul 2018 10:50:18 GMT

if it's like a .dat file (binary, ascii or what you want... data file) it cannot be open or merged easily you need have the corresponding soft who know data format of this file.
Did you know this format?