topic Re: Best way to move multi HDFS files in Talend Studio

Best way to move multi HDFS files

Anonymous — Sat, 16 Nov 2024 09:35:34 GMT

Hi,

I am trying to achieve the same functionality of "hdfs dfs -mv /source/*.done /target/" in Talend.

I tried tHDFSCopy, which seems not support wildcard in file name.
I am using Talend Open Studio 6.3.1, Big Data Edition. Please advise.

Anonymous — Fri, 23 Jun 2017 19:52:31 GMT

I am currently using 2 components: tHDFSList -> tHDFSCopy to achieve it, which ideally should be handled by one component.

Anonymous — Sat, 24 Jun 2017 01:59:03 GMT

I have not tried it, but maybe you can try tSystem and just put the command in it.