topic Re: How to filter based on date time? in Talend Studio

How to filter based on date time?

talendtester — Wed, 08 Feb 2017 00:16:55 GMT

I am reading from a delimited file and trying to filter for only the rows of date within a specific date time range.
I found this for dates:
https://help.talend.com/search/all?query=How+to+compare+Dates&content-lang=en
How can I make it compare Date Times?
I am trying this:
context.myStartDate ="2017-02-03 23:00:00"
context.myEndDate ="2017-02-04 00:00:00"

TalendDate.compareDate( input_row.newColumn5, context.myStartDate,"yyyy-MM-dd HH:mm:ss") > 0
&& TalendDate.compareDate( input_row.newColumn5, context.myEndDate, "yyyy-MM-dd HH:mm:ss") < 1

Is it possible with a job that looks like this?
tFileInputDelimited > tFilterRow > tFileOutputDelimited

Re: How to filter based on date time?

talendtester — Mon, 13 Feb 2017 22:22:47 GMT

Can anyone answer?

Re: How to filter based on date time?

vapukov — Tue, 14 Feb 2017 00:15:07 GMT

Can anyone answer?

What is Your problem?
Yes You can use tFilterRow or tMap with filter conditions
for examples TalendDate.diffDate or TalendDate.compareDate

Re: How to filter based on date time?

talendtester — Tue, 14 Feb 2017 00:41:49 GMT

I have been trying to filter the date time for a specific hour on a particular day with tFilterRow but can't get it to work. So far I have only been able to filter for the particular day. I am having trouble filtering the hour.
Can you please share an example of how to filter for an hour like 5pm? (5pm GMT is 23:00 Central Standard Time)
Thanks

Re: How to filter based on date time?

vapukov — Tue, 14 Feb 2017 02:57:52 GMT

I have been trying to filter the date time for a specific hour on a particular day with tFilterRow but can't get it to work. So far I have only been able to filter for the particular day. I am having trouble filtering the hour.
Can you please share an example of how to filter for an hour like 5pm? (5pm GMT is 23:00 Central Standard Time)
Thanks

Sure
You always must convert data to same format, so if You need example - please attach sample data set

Re: How to filter based on date time?

talendtester — Tue, 14 Feb 2017 03:04:37 GMT

myDate
2017-02-03 23:30:57
2017-02-03 23:13:49
2017-02-03 23:30:19
2017-02-03 23:27:34
2017-02-03 23:19:40
2017-02-03 23:46:29
2017-02-03 23:06:06
2017-02-03 23:48:32
2017-02-03 23:52:16
2017-02-03 23:50:44
2017-02-03 23:52:16
2017-02-03 23:43:30
2017-02-03 23:43:22
2017-02-03 23:42:01
2017-02-03 23:03:19
2017-02-03 22:31:42
2017-02-03 22:27:38
2017-02-03 22:52:26
2017-02-03 22:35:15
2017-02-03 22:45:49
2017-02-03 22:16:10
2017-02-03 22:05:28
2017-02-03 22:00:28
2017-02-03 22:44:11
2017-02-03 22:07:05
2017-02-03 22:39:52
2017-02-03 22:35:17
2017-02-03 22:38:33
2017-02-03 22:53:15
2017-02-03 22:37:19
2017-02-03 22:37:48
2017-02-03 22:42:46
2017-02-03 22:20:02
2017-02-03 22:37:45
2017-02-03 22:38:18
2017-02-03 22:38:55
2017-02-03 22:52:02
2017-02-03 22:08:29
2017-02-03 22:06:54
2017-02-03 22:17:52
2017-02-03 22:43:04
2017-02-03 22:37:56
2017-02-03 22:15:54
2017-02-03 22:11:29
2017-02-03 22:11:56
2017-02-03 22:48:49
2017-02-03 22:08:48
2017-02-03 22:40:58

Re: How to filter based on date time?

vapukov — Tue, 14 Feb 2017 03:15:13 GMT

please

same with tFilterRow

Re: How to filter based on date time?

talendtester — Tue, 14 Feb 2017 03:17:53 GMT

So use a tMap instead of a tFilterRow?

Re: How to filter based on date time?

vapukov — Tue, 14 Feb 2017 03:22:09 GMT

So use a tMap instead of a tFilterRow?

any

Re: How to filter based on date time?

talendtester — Tue, 14 Feb 2017 03:24:29 GMT

ok, thanks!

Re: How to filter based on date time?

vapukov — Tue, 14 Feb 2017 03:31:43 GMT

ok, thanks!

welcome! 😉
this is why I ask - what is the problem?
why it not work in Your case? (I of course sure - You was tested it and not just ask how to do something 🙂 )
there are many reasons for wrong work of some real Job

Re: How to filter based on date time?

sbxr — Fri, 03 Jan 2020 14:04:40 GMT

How can we filter files based on Date from a directory and print those filename.

for example i want to copy all the file to other folder which is 6 months old.

Re: How to filter based on date time?

Anonymous — Fri, 03 Jan 2020 17:52:29 GMT

@sbxr , use a tFileList to iterate each file in the directory, and then use a tFileProperties to read the file properties including mtime, filename etc, check the mtime to determine if it is needed to move.