topic lookup in parallel does not exist in tMap in Talend Studio

lookup in parallel does not exist in tMap

J_Boumhil — Fri, 15 Nov 2024 22:39:26 GMT

Hello everyone,

I would like to use the lookup in parallel option but I can't find it! is this normal?

I use talend open studio for data integration.

Re: lookup in parallel does not exist in tMap

Anonymous — Thu, 11 Aug 2022 13:55:07 GMT

Sorry, I am not sure I understand what it is you are wanting to do? Are you talking about having more than one lookup source being run in parallel or are you wanting to query your lookup source with every row from your main source?

Re: lookup in parallel does not exist in tMap

J_Boumhil — Thu, 11 Aug 2022 14:00:24 GMT

thank you for intervention

The Job execution speed is slowed down. To maximize the Job execution performance, I want to activate the lookup in parallel option, but this option does not exist in tMap property settings.

Re: lookup in parallel does not exist in tMap

J_Boumhil — Thu, 11 Aug 2022 15:09:39 GMT

normally it should be displayed like the capture

Re: lookup in parallel does not exist in tMap

InfoCraft — Thu, 11 Aug 2022 20:36:21 GMT

Because you are using a TOS version.

Re: lookup in parallel does not exist in tMap

Anonymous — Fri, 12 Aug 2022 02:36:35 GMT

Hello,

This feature is available in talend subscription solution not open source.

Re: lookup in parallel does not exist in tMap

Anonymous — Fri, 12 Aug 2022 06:15:38 GMT

I am also looking for a solution, Because I am also getting a same issue. Please help! What do we have to do?

Re: lookup in parallel does not exist in tMap

J_Boumhil — Fri, 12 Aug 2022 09:11:51 GMT

Thank you for your answer.

is there a lookup in parallel alternative in the TOS version?

Re: lookup in parallel does not exist in tMap

J_Boumhil — Fri, 12 Aug 2022 09:35:15 GMT

here is my problem. it's been 18 hours since the loading started and the number of rows/s has decreased. and I'm at 10% loading

Re: lookup in parallel does not exist in tMap

Anonymous — Fri, 12 Aug 2022 09:48:00 GMT

@Jawad Boumhil , To load large of data volumes, the best practices is to store the lookup data on disk instead of memory.

Re: lookup in parallel does not exist in tMap

J_Boumhil — Fri, 12 Aug 2022 10:51:46 GMT

@Shicong Hong You are right, but in the output between tMap and the fact it's slower than before.

Re: lookup in parallel does not exist in tMap

InfoCraft — Fri, 12 Aug 2022 20:53:22 GMT

Hi,

keep "Store temp data == true" then use tDBOutputBulkExec.

Best regards,

😷19

Re: lookup in parallel does not exist in tMap

Anonymous — Mon, 29 Aug 2022 02:00:49 GMT

Hello,

Could you please give us more description about your current situation? Are you using talend open source or subscription solution?

Best regards

Sabrina