topic CDC is not working in scheduling time in Talend Studio

CDC is not working in scheduling time

Anonymous — Sat, 16 Nov 2024 06:02:35 GMT

Hi all,

I have created a CDC tables while it's working fine when ever i used run button in talend.

Same jobs after scheduled these build jobs using task scheduler for every hour am getting ZERO records from these CDC tables.

source destination

mssql ----------------->HIVE

NOte: From client side the mssql database is dropping and recreating every night 10 pm.IS this cause any issue am getting zero records in hive by CDC tables.

Can anyone help me for this issue to resolve..

Re: CDC is not working in scheduling time

manodwhb — Fri, 19 Apr 2019 12:38:03 GMT

@saibabu ,what was the scheduled time? is it same time dropping and creating database ? if yes it could be problem.

Re: CDC is not working in scheduling time

Anonymous — Fri, 19 Apr 2019 13:10:03 GMT

Scheduled time was started 17-04-2019 4.00.00 am and it will run every one hour as Repeat task and Duration : - INDEFINITELY

Re: CDC is not working in scheduling time

vapukov — Fri, 19 Apr 2019 14:26:50 GMT

Hi @saibabu ,

of course it could be a problem

Talend use trigger based CDC, so when you drop the database, it must drop triggers on tables

Re: CDC is not working in scheduling time

Anonymous — Mon, 22 Apr 2019 07:24:39 GMT

But they are re-creating triggers every day @10 pm dropping & creating entire db again