topic Re: Trying to enable multi-threading FlowToIterate in Talend Studio

Trying to enable multi-threading FlowToIterate

decimatum — Fri, 15 Nov 2024 22:39:33 GMT

I am trying to enable parallel execution for tFlowToIterate_2 component. However, it is disabled. I am hoping if someone knows why. Thanks for the help.

Re: Trying to enable multi-threading FlowToIterate

Anonymous — Fri, 12 Aug 2022 09:41:04 GMT

Which version of studio are you using? I check with v8.0.1 and I can see the 'enable parallel execution' option is available in basic setting panel.

BTW, I don't understand you use the 'OncomponentOK' connector rather than 'Iterate' after tFlowToIterate2 in your Job, tFlowToIterate component is usually used to iterate the input data one by one.

Regards

Shong

Re: Trying to enable multi-threading FlowToIterate

decimatum — Fri, 12 Aug 2022 10:00:47 GMT

I am using V8.0.1.

I can see that the option "Enable parallel execution is " But for my tFlowToIterate component it is disabled(The checkbox is disabled.). Looked at some other components e.g. tDBOutput and found that it is enabled (Black). I have attached some screenshots below for reference.
I tried both oncomponentok and iterate to test if it affects. But I take note of your advice to use iterate instead thanks.

I am also unclear why my enable parallel execution is disabled on my side. Hope you understand I was expecting this option to be enabled as well.

Re: Trying to enable multi-threading FlowToIterate

Anonymous — Sat, 13 Aug 2022 10:18:06 GMT

can you have a try to disactivate the component 'dbToCSV' and other components? If the problem still exists, set some dummy values on the DB components, then export the job items and share it to me (shong@talend.com).

Re: Trying to enable multi-threading FlowToIterate

decimatum — Mon, 15 Aug 2022 05:35:45 GMT

Hi I have attached a simple flow. With a CSV to simulate the issue I face. Hopefully it helps. On my end the "Enable parallel execution is disabled.

Re: Trying to enable multi-threading FlowToIterate

Anonymous — Mon, 15 Aug 2022 07:26:26 GMT

I have imported your job into TOS for data integration 8.0.1, and I can see the 'enable parallel execution' option is available in basic setting panel.

Are you using the same GA version TOS_DI-20211109_1610-V8.0.1?

Regards

Shong

Re: Trying to enable multi-threading FlowToIterate

decimatum — Mon, 15 Aug 2022 07:35:07 GMT

Yes I am using that version. I am unsure why the option is disabled on my side.

Most components are disabled but some like tDBOutput has it enabled.

Disabled means I cannot enable it at all on my side. Greyed out. Is there something I must do on my side to enable it? Or is it supposed to be enabled by default?

Re: Trying to enable multi-threading FlowToIterate

Anonymous — Mon, 15 Aug 2022 08:24:26 GMT

One point: you should click on the 'iterate' connector in the job, rather than tFlowToIterate component, see my screenshot in previous post.

Re: Trying to enable multi-threading FlowToIterate

decimatum — Mon, 15 Aug 2022 08:31:34 GMT

This works. I was clicking on the component not the connector. This was the issue.