Connection reset with tMicrosoftAzureHubInput

[Burgo]

Hi everyone,

i'm having the following connection problem using the tMicrosoftAzureHubInput component for reading from an event hub with 7 partitions:

 

After the following KO, the batch is dead but still running with nothing to do, also with the "die on error" checked.

In debug the exception is not catchable because is raised by the ms library (i think):

java.net.SocketException: Connection reset

    at java.base/java.net.SocketInputStream.read(SocketInputStream.java:186)

    at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)

    at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:478)

    at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:472)

    at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70)

    at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1454)

    at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1065)

    at java.base/java.io.InputStream.read(InputStream.java:205)

    at org.apache.qpid.amqp_1_0.client.TCPTransportProvider.doRead(TCPTransportProvider.java:234)

    at org.apache.qpid.amqp_1_0.client.TCPTransportProvider.access$000(TCPTransportProvider.java:47)

    at org.apache.qpid.amqp_1_0.client.TCPTransportProvider$1.run(TCPTransportProvider.java:185)

    at java.base/java.lang.Thread.run(Thread.java:829)

[ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

[ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

[ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

Exception in thread "listenerThread4_tMicrosoftAzureHubInput_1" [ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

Exception in thread "listenerThread3_tMicrosoftAzureHubInput_1" [ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

Exception in thread "listenerThread1_tMicrosoftAzureHubInput_1" [ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}[ERROR] 15:02:52 com.microsoft.eventhubs.client.EventHubReceiver- Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

    at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

    at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

    at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener4_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8522)

    at java.base/java.lang.Thread.run(Thread.java:829)

Exception in thread "listenerThread6_tMicrosoftAzureHubInput_1" Exception in thread "listenerThread5_tMicrosoftAzureHubInput_1" Exception in thread "listenerThread2_tMicrosoftAzureHubInput_1" java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

    at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

    at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

    at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener1_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8453)

    at java.base/java.lang.Thread.run(Thread.java:829)

Exception in thread "listenerThread0_tMicrosoftAzureHubInput_1" java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

    at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

    at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

    at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener3_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8499)

    at java.base/java.lang.Thread.run(Thread.java:829)

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

    at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

    at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

    at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener0_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8430)

    at java.base/java.lang.Thread.run(Thread.java:829)

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

    at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

    at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

    at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener2_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8476)

    at java.base/java.lang.Thread.run(Thread.java:829)

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

    at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

    at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

    at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener5_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8545)

    at java.base/java.lang.Thread.run(Thread.java:829)

java.lang.RuntimeException: Error{condition=detach-forced,description=Force detach the link because the session is remotely ended.}

    at com.microsoft.eventhubs.client.EventHubReceiver.checkError(EventHubReceiver.java:123)

    at com.microsoft.eventhubs.client.EventHubReceiver.receive(EventHubReceiver.java:87)

    at sorgenia.mq_job_contacts_0_1.MQ_JOB_contacts$1MessageListener6_tMicrosoftAzureHubInput_1.run(MQ_JOB_contacts.java:8568)

    at java.base/java.lang.Thread.run(Thread.java:829)

Someone can help me, please?

Thanks.

[Anonymous]

Hello,

tMicrosoftAzureHubInput is a custom component which is written by talend community members and shared on talend exchange portal.

The third party custom components on Talend Exchange are not supported by Talend, since we don't have the source code of these components.  It is the ownership of the person who built it.

​Best regards

Sabrina

[Burgo]

Hi Sabrina,

is there another supported component that I can use to read from an Azure Event Hub?

[Anonymous]

Hello,

Here is a topic about: What is the best component to use to read messages from Azure Event Hub in real-time?

https://community.talend.com/s/question/0D53p00007vCjCxCAK/what-is-the-best-component-to-use-to-read...

Feel free to let us know if it helps.

Best regards

Sabrina

[Burgo]

Hi Sabrina and happy new year.

Unfortunately the linked topic is not helpful because a real example is missing.

Can you provide one?

I have the following string for the hub connection:

Endpoint=sb://abc-prod.servicebus.windows.net/;SharedAccessKeyName=PreviewDataPolicy;SharedAccessKey=kFxeXXXXXN7OQ=;EntityPath=abc-account

How can I use it with a Route?

Thanks.

[Anonymous]

Hello,

It looks Azure Event Hub is compliant with AMQP, you have already checked this guide?

https://docs.microsoft.com/en-us/azure/service-bus-messaging/service-bus-amqp-protocol-guide

Best regards

Sabrina