topic Re: [resolved] How to delete multiple files in HDFS? in Talend Studio

[resolved] How to delete multiple files in HDFS?

Anonymous — Sat, 16 Nov 2024 11:22:27 GMT

Hi,
I was trying to delete multiple files using tHDFSDelete by specifying multiple file path seperated by comma(,). but it was not working. Later I saw generated code for tHDFSDelete then I came to know that I can't enter multiple file paths.
Is there any way in Talend to delete multiple files (may be in same or in different directory ) from HDFS?

Thanks,
Bhavesh

Re: [resolved] How to delete multiple files in HDFS?

Anonymous — Fri, 02 Jan 2015 05:47:38 GMT

Hi
Try to use tHDFSList to literate each file that you want to delete. For example:
tHDFSList--iterate--tHDFSDelete
There is a global variable that stores the current file path on tHDFSList:
(String)globalMap.get("tHDFSList_1_CURRENT_FILEPATH")
Set the file path of tHDFSdDelete with this variable.
Best regards
Shong