topic Re: How to delete files older than 48 hours in Talend Studio

How to delete files older than 48 hours

prasanthkesana — Mon, 17 Aug 2020 04:32:02 GMT

I have a requirement to delete old files based on date timestamp,

I found the component tFileProperties to fetch file properties

below is the sample job i have created by using the talend components

tFileList---iterate-- > tFileProperties ---main--->tMap-------main--->tfileDelte

On tMap schema editor i have used condition to check mtime in expression

((TalendDate.getCurrentDate()).getTime() - (Long)row1.mtime) > (8 * 24 * 3600000) to delete files based on above condition.

Can you please suggest any solution as per my requirement.

Thanks,

Prasanth

Re: How to delete files older than 48 hours

Anonymous — Mon, 17 Aug 2020 05:01:58 GMT

What is the problem with your current job design? Is the file deleted?

Regards

Shong

Re: How to delete files older than 48 hours

prasanthkesana — Mon, 17 Aug 2020 05:06:37 GMT

No, Job is running successfully but not deleting files based on condition. I'm not sure about the condition which i have applied.

Re: How to delete files older than 48 hours

Anonymous — Mon, 17 Aug 2020 06:57:57 GMT

if you just want to delete the files older than 48 hours, change the expression to

((TalendDate.getCurrentDate()).getTime() - (Long)row1.mtime) > (2 * 24 * 3600000)

Re: How to delete files older than 48 hours

prasanthkesana — Mon, 17 Aug 2020 07:09:15 GMT

Hi Shong I have tried the above condition already but not working.

Is there any issue in the work flow of my job?

Below is the attached schema for tMap.

please suggest me any other alternative solution.

Thanks Prasanth

Re: How to delete files older than 48 hours

Anonymous — Mon, 17 Aug 2020 07:16:53 GMT

The file name of tFileDelete component should be:

((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))

Can you check it?

Re: How to delete files older than 48 hours

prasanthkesana — Mon, 17 Aug 2020 08:31:12 GMT

It was not configured, but now i have added it in file name of tFileDelete and tested still not working.

Re: How to delete files older than 48 hours

Anonymous — Mon, 17 Aug 2020 09:53:46 GMT

I have tested your work flow and I am sure it works. Any error do you have? Try to output the filename on tMap to check if the filter condition is working.

Re: How to delete files older than 48 hours

prasanthkesana — Mon, 17 Aug 2020 10:38:45 GMT

Hi,

I have tested the work flow now all files are deleting even the condition is set to before 2 days files has to be delete from current date .

Re: How to delete files older than 48 hours

Anonymous — Mon, 17 Aug 2020 15:49:25 GMT

Just create a new file for testing, if the new file is deleted also, there must be something wrong in your job.

Re: How to delete files older than 48 hours

prasanthkesana — Tue, 18 Aug 2020 01:51:49 GMT

i have created new file and run the job,

If i used this expression ((TalendDate.getCurrentDate()).getTime() - (Long)row1.mtime) > (2 * 24 * 3600000) files are not deleting.

For this expression ((TalendDate.getCurrentDate()).getTime() - (Long)row1.mtime)+86400000 > (31* 24 * 3600000) all files are deleting at once. I found this while searching for the suitable expression it will delete before 31 days old files but deleting all.

Thanks,

Prasanth

Re: How to delete files older than 48 hours

cmills — Mon, 04 Oct 2021 21:35:29 GMT

I had to replace the math with:

Long.valueOf(2) * Long.valueOf(24) * Long.valueOf(3600000)

As the int values kept going negative due to size.

Re: How to delete files older than 48 hours

ykuwar — Mon, 20 Dec 2021 10:44:38 GMT

Hello @Shicong Hong ,

1] Delete files older than 48 hrs

condition in tMap - > ((TalendDate.getCurrentDate()).getTime() - (Long)row1.mtime) > (2 * 24 * 3600000)

2] The file name of tFileDelete component should be:

((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))

Thanks for the solution this works for me!