Connection reset with tMicrosoftAzureHubInput

Burgo — Fri, 15 Nov 2024 22:15:19 GMT

Hi everyone,

i'm having the following connection problem using the tMicrosoftAzureHubInput component for reading from an event hub with 7 partitions:

After the following KO, the batch is dead but still running with nothing to do, also with the "die on error" checked.

In debug the exception is not catchable because is raised by the ms library (i think):

java.net.SocketException: Connection reset

at java.base/java.net.SocketInputStream.read(SocketInputStream.java:186)

at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)

at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:478)

at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:472)

at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70)

at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1454)

at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1065)

at java.base/java.io.InputStream.read(InputStream.java:205)

at org.apache.qpid.amqp_1_0.client.TCPTransportProvider.doRead(TCPTransportProvider.java:234)

at org.apache.qpid.amqp_1_0.client.TCPTransportProvider.access$000(TCPTransportProvider.java:47)

at org.apache.qpid.amqp_1_0.client.TCPTransportProvider$1.run(TCPTransportProvider.java:185)

at java.base/java.lang.Thread.run(Thread.java:829)

[ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

Exception in thread "listenerThread4_tMicrosoftAzureHubInput_1" [ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

Exception in thread "listenerThread3_tMicrosoftAzureHubInput_1" [ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

Exception in thread "listenerThread1_tMicrosoftAzureHubInput_1" [ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}[ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener4_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8522)

at java.base/java.lang.Thread.run(Thread.java:829)

Exception in thread "listenerThread6_tMicrosoftAzureHubInput_1" Exception in thread "listenerThread5_tMicrosoftAzureHubInput_1" Exception in thread "listenerThread2_tMicrosoftAzureHubInput_1" java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener1_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8453)

at java.base/java.lang.Thread.run(Thread.java:829)

Exception in thread "listenerThread0_tMicrosoftAzureHubInput_1" java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener3_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8499)

at java.base/java.lang.Thread.run(Thread.java:829)

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener0_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8430)

at java.base/java.lang.Thread.run(Thread.java:829)

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener2_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8476)

at java.base/java.lang.Thread.run(Thread.java:829)

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener5_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8545)

at java.base/java.lang.Thread.run(Thread.java:829)

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener6_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8568)

at java.base/java.lang.Thread.run(Thread.java:829)

Someone can help me, please?

Thanks.

Re: Connection reset with tMicrosoftAzureHubInput

Anonymous — Thu, 22 Dec 2022 09:15:00 GMT

Hello,

tMicrosoftAzureHubInput is a custom component which is written by talend community members and shared on talend exchange portal.

The third party custom components on Talend Exchange are not supported by Talend, since we don't have the source code of these components. It is the ownership of the person who built it.

Best regards

Sabrina

Re: Connection reset with tMicrosoftAzureHubInput

Burgo — Thu, 22 Dec 2022 15:14:15 GMT

Hi Sabrina,

is there another supported component that I can use to read from an Azure Event Hub?

Re: Connection reset with tMicrosoftAzureHubInput

Anonymous — Fri, 23 Dec 2022 09:01:44 GMT

Hello,

Here is a topic about: What is the best component to use to read messages from Azure Event Hub in real-time?

https://community.talend.com/s/question/0D53p00007vCjCxCAK/what-is-the-best-component-to-use-to-read-messages-from-azure-event-hub-in-realtime

Feel free to let us know if it helps.

Best regards

Sabrina

Re: Connection reset with tMicrosoftAzureHubInput

Burgo — Mon, 02 Jan 2023 09:29:39 GMT

Hi Sabrina and happy new year.

Unfortunately the linked topic is not helpful because a real example is missing.

Can you provide one?

I have the following string for the hub connection:

Endpoint=sb://abc-prod.servicebus.windows.net/;SharedAccessKeyName=PreviewDataPolicy;SharedAccessKey=kFxeXXXXXN7OQ=;EntityPath=abc-account

How can I use it with a Route?

Thanks.

Re: Connection reset with tMicrosoftAzureHubInput

Anonymous — Mon, 09 Jan 2023 09:20:52 GMT

Hello,

It looks Azure Event Hub is compliant with AMQP, you have already checked this guide?

https://docs.microsoft.com/en-us/azure/service-bus-messaging/service-bus-amqp-protocol-guide

Best regards

Sabrina

topic Re: Connection reset with tMicrosoftAzureHubInput in Talend Studio

Connection reset with tMicrosoftAzureHubInput

Re: Connection reset with tMicrosoftAzureHubInput

Re: Connection reset with tMicrosoftAzureHubInput

Re: Connection reset with tMicrosoftAzureHubInput

Re: Connection reset with tMicrosoftAzureHubInput

Re: Connection reset with tMicrosoftAzureHubInput