filter data on time basis

[Anonymous]

hello everyone,

how can we filter data on time basis ?,

i have a tmysql input source data, i want to filter data on time ranges.

input source:-

ID	data	record_added_dt
8742645	41.49489	2019-08-13 00:01:02
8742644	41.4949	2019-08-13 08:01:06
8742643	41.49515	2019-08-13 09:00:00
8742642	41.49575	2019-08-13 00:01:32
8742641	41.49597	2019-08-12 23:59:32
8742640	41.49806	2019-08-13 17:02:02
8742639	41.49946	2019-08-13 00:02:32
8742638	41.50322	2019-08-12 23:58:31
8742637	41.50414	2019-08-12 23:59:03
8742636	41.50951	2019-07-09 03:11:59
8742635	41.50414	2019-07-10 03:11:56
8742634	41.5095	2019-07-10 03:11:56

Ques:-  i want to filter data between 06:00:00 to 18:00:00 time ranges .

please help,

thanks in advanced,

Regards,

Manish

[Sujay1]

Hi @vitspltalend  if your data is coming from databases like mysql you can filter it in DB itself and bring necessary data right ? Something like 

select * from table where dt between '2012-03-11 06:00:00' and '2012-05-11 18:00:00' ;

cause filtering in source(DB) is much more effective than bringing all data to talend and then filter it. Just a food for thought. 

[Anonymous]

hello @Sujay ,

thanks for answer,

It will work fine only for one day data, in my requirements there is multiple days.

[TRF · Accepted solution]

select * from yourTable where DATE_FORMAT(dt, '%H%i') between '0600' and '1800'

[TRF]

Did it help?
If so, thanks to mark your case as solved.