How to setting tkafkaoutput timeout

Anonymous — Sat, 16 Nov 2024 11:01:56 GMT

I use tkafkaoutput component for my job. And I tried to add exception handling for this component by adding tdie,tlogcatcher and tfileoutputdelimited. I test it using the wrong broker list(I connected to localhost:909 which is not exist) and then tkafkaoutput component will throw warning message but it can't stop (no time out). My problem is how to make exception occurs and send the exception log to tfileoutputdelimited and stop the job.
I already add timeout.ms , retry.backoff.ms setting on tkafkaoutput component advanced setting. But nothing works. Can anyone help me to figure this out??
here is the warning message :

Starting job kafkainputoutputwithexceptionhandling at 06:08 28/09/2015.
 connecting to socket on port 3850
 connected
: org.apache.kafka.clients.producer.ProducerConfig - The configuration value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer was supplied but isn't a known config.
: org.apache.kafka.clients.producer.ProducerConfig - The configuration key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer was supplied but isn't a known config.
: kafka.utils.VerifiableProperties - Property serializer.encoding is not valid
: org.apache.kafka.common.network.Selector - Error in I/O with localhost/127.0.0.1
java.net.ConnectException: Connection refused: no further information
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
    at org.apache.kafka.common.network.Selector.poll(Selector.java:238)
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
    at java.lang.Thread.run(Unknown Source)
: org.apache.kafka.common.network.Selector - Error in I/O with localhost/127.0.0.1
java.net.ConnectException: Connection refused: no further information
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
    at org.apache.kafka.common.network.Selector.poll(Selector.java:238)
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
    at java.lang.Thread.run(Unknown Source)

Thanks

Re: How to setting tkafkaoutput timeout

Anonymous — Thu, 08 Oct 2015 07:52:28 GMT

Hi chandra_huang,

Could you please check this jira issue: https://jira.talendforge.org/browse/TBD-2639 to see if it is what you need?
Best regards
Sabrina

topic How to setting tkafkaoutput timeout in Talend Studio

How to setting tkafkaoutput timeout

Re: How to setting tkafkaoutput timeout