topic Re: Job runs twice before ending in Talend Studio

Job runs twice before ending

profuse — Thu, 02 May 2019 21:52:57 GMT

Hi,

I have a job the reads a tFileInputDelimited and CSV Lookup through the tMap and outputs two TFileOutputDelimited files.

The job reads and process all the input data, creates the two output files and then restarts again. After processing the data the second time, the job completes and the output data looks correct.

Can anyone tell me why the job is running twice and how I can get this to end after processing the data the first time?

All the best.

Re: Job runs twice before ending

Anonymous — Thu, 02 May 2019 22:06:28 GMT

What makes you think it is running twice? Can you show us a screenshot of the job?

Re: Job runs twice before ending

profuse — Fri, 03 May 2019 16:40:13 GMT

Hi,

When I watch the job run, I see the file row counts increase. After it finishes processing the input once, then the row counts reset to zero and its begins to run again. Once the job process the data twice, here is a look at the screen. Any idea why it cycles through the data twice?

Re: Job runs twice before ending

nfz11 — Sat, 04 May 2019 04:05:16 GMT

I think the reason is you have two triggers that point to your main flow, the tSetGlobalVars and tLibraryLoad. You should chain those two inline to fix it. Right now it runs like this so you process your rows twice:

tSetGlobalVars -> Your main logic subjob -> tLibraryLoad -> Your main logic subjob

If you need the tSetGlobalVars and tLibraryLoad to run before your main logic then just set it up like this:

tSetGlobalVars

on component ok >

tLibraryLoad

on component ok >

Your main logic subjob

Re: Job runs twice before ending

profuse — Mon, 06 May 2019 16:35:32 GMT

nfz11,

By linking the two together, the job only reads the input files in once, processes and finishes!

Thank You NFZ11

Re: Job runs twice before ending

Anonymous — Mon, 06 May 2019 16:57:51 GMT

Nice spot @nfz11!!

Re: Job runs twice before ending

Anonymous — Thu, 23 May 2019 09:48:57 GMT

Can someone please check and let me know if this is something related to my issue?

https://community.talend.com/t5/Design-and-Development/Kafka-is-storing-messages-twice/m-p/161997/highlight/false#M98766

Re: Job runs twice before ending

Anonymous — Sun, 26 May 2019 10:14:27 GMT

I doubt this is happening, but you can check by downloading a Kafka client to view the messages that are stored.