Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Streamlining user types in Qlik Cloud capacity-based subscriptions: Read the Details
cancel
Showing results for 
Search instead for 
Did you mean: 
stephanie_scott
Contributor
Contributor

Delete HDFS File Based on Creation Date

Good morning,
I'm attempting to delete files from a HDFS directory based on creation date.  I'm using something similar to the solution found here: 
My problem is rather than using tFileList/tFileDelete, I need to use tHDFSList/tHDFSDelete.  However tFilterRow does not connect to tHDFSDelete.
I'm somewhat of a novice in Talend, teaching myself little by little.  Any help or ideas on how I can change this flow to work is greatly appreciated!
0683p000009MDRd.png
Labels (2)
2 Replies
Anonymous
Not applicable

Hi,
The tfilterrow component requires an output component. Could you please try this work flow to see if it is Ok with you?
tHDFSConnection-->tHDFSList-->tHDFSProperties-->tMap-->tFilterRow-->tfileoutputxxx-->tHDFSDelete
Best regards
Sabrina
cterenzi
Specialist
Specialist

If the output of tFilterRow is the list of files to delete, inserting a tFlowToIterate between it and tHDFSDelete should let you loop over the files and delete each one.