get ftp files meta and childs files (isolate process for each meta file)

[martel]

Hello
I would like to set up a process for recovering ftp files with the certainty that on the remote ftp there are all the sub files of each meta file.

a meta file is an xml file consisting of a list of data file names
example:
d20200505_metafile_0001.xml

<root>
-<responses>
--<filename>d20200505_filedata_0001.xml</filename>
--<filename>d20200505_filedata_0002.xml</filename>
--<filename>d20200505_filedata_0003.xml</filename>
-</responses>

d20200505_metafile_0002.xml

<root>
-<responses>
--<filename>d20200505_filedata_0004.xml</filename>
--<filename>d20200505_filedata_0005.xml</filename>
-</responses>

I have already managed the ftp connection part, the list of meta files (tFTPFileList), recover a local copy (tFTPGet) meta files, list local meta files (tFileList).

then I wanted to extract each xml element "/ root / responses / filename" (tFileInputXML) by meta file, and do a
(tFTPFileExist) on each file name mentioned in the meta file, and if all the files are present in this meta file we download them. otherwise if one xml data file is not present then we stop this process and we delete the meta file which refers to it locally. and do this for each meta file.

I get stuck on how to isolate the process from each meta file. Is it possible to do it with Talend components without having to do tJava and do everything in java.

thank you

[martel]

Hey,

how use tFTPFileExist with multiple files without nullpointerException.

an iterate join with parameter name of file, have an error nullPointerException.

Thanks you

[Anonymous · Accepted solution]

@martel
If you use an existing FTP connection on tFTPFileExist, make sure the connection is created before it is used, so change the job to:

tFTPConnection

 |onsubjobok

other subjobs.