topic Re: tMap and tJoin component wont accept a second connection in Talend Studio

tMap and tJoin component wont accept a second connection

Anonymous — Sat, 16 Nov 2024 02:50:58 GMT

hello,

i have a process where i want to take an input from kafka then send to an api and get back the results from the api, the kafka input also has some values that i already parsed, but then i want to join the api response with the values that i parsed using a column that is common between the two outputs, but talend does not allow me to do that for some reason.

can i even do that ??

here are some screenshots from what i am trying to do

i just want to join row 4 with "out_logs" from the tmap

here is the map

Now whenever i try to join talend wont allow me, i cant do this

here's the tmap configuration

I also tried putting two tkafka input componenets for the same topic then join them, but only 1 tkafka input component work at a time, they didnt not work at the same time.

any help ??

Re: tMap and tJoin component wont accept a second connection

manodwhb — Mon, 30 Mar 2020 03:21:29 GMT

You cannot join from the same source , to do the join from the same source, you need to use thashouput and has in puts to d o join.

Re: tMap and tJoin component wont accept a second connection

Anonymous — Mon, 30 Mar 2020 10:25:00 GMT

thanks manodwhb
I tried tHashoutput, but it does not work in real time either
i tried this and it gave me the error "The hash is not initialized : The hash must exist before you read from it" (i guess i know why )

also i tried this, but while running, it never starts the joining subjob

any help would be apperciated.

thanks

Re: tMap and tJoin component wont accept a second connection

manodwhb — Mon, 30 Mar 2020 10:50:51 GMT

go with the second way and you need to use on subjob OK trigger not on component OK and you need to define the schema which your linking the thashoutput.

Re: tMap and tJoin component wont accept a second connection

Anonymous — Mon, 30 Mar 2020 11:10:38 GMT

thanks again for your reply Manohar.

the joing subjob does not work either (no errors or anything, it just doest start)

what i've noticed, that since tkafkainput is a kafka consumer the kafka subjob will keep running until i kill it ( it is listenining to the kafka topic in real time)

so, my assumption is that the joining subjob will never start because the kafka subjob will never stop.

is there any way to force start it ??

if not, allow me to bring back this

is there is anyway in talend that i can start tHashInput_1 after tHashoutput_1 ??

thanks again Manohar.