tFileFetch Connection Refused - Is file dimension a failure point?

andreasignori — Fri, 15 Nov 2024 22:07:48 GMT

I'm having a terrible day on trying to use a tFileFetch component to download some files from an SMB Shared Folder.

To give you a little bit of context, we have a shared folder easily accessible from windows, in this folder there are some files, mainly CSV and Access files. I have to get access to this file from my Job, my job will run on a linux job server.

I developed my job by directly referencing the shared folder on my tInputFileDelimited. I entered the URL and everything worked perfectly. Unfortunately, this does not work on the Job server, probably because there is a difference between how Windows and Linux can access the shared folder. So i thought about using a tFileFetch component to download the file and then use them. I was able to download a small CSV, but if I tried to download something bigger or any Access DB, I got this error.

Java.net.ConnectException: Connection refused: connect

at java.net.DualStackPlainSocketImpl.connect0(Native Method)

at java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImpl.java:79)

at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)

at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)

at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)

at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)

at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)

at java.net.Socket.connect(Socket.java:589)

at java.net.Socket.connect(Socket.java:538)

at java.net.Socket.(Socket.java:434)

at java.net.Socket.(Socket.java:211)

at jcifs.smb.SmbTransport.ssn139(SmbTransport.java:182)

at jcifs.smb.SmbTransport.negotiate(SmbTransport.java:244)

at jcifs.smb.SmbTransport.doConnect(SmbTransport.java:309)

at jcifs.util.transport.Transport.run(Transport.java:240)

at java.lang.Thread.run(Thread.java:748)

After that the job stay in Idle for some minutes, then it ends. I was wondering if it was a Firewall/SMB settings that may can cause this error, the client confirmed that there is no similar rule or setting. I think it's strange that I manage to successfully download a small file and have this error with the same type but different dimension (i successfully download a 900KB file and have trouble with 15MB one).

Considering that I need to access to this shared folder from my job running on a Linux server.... do you have any idea on where I'm mistaken or what I should try differently?

Re: tFileFetch Connection Refused - Is file dimension a failure point?

SamuelLenk — Tue, 28 Mar 2023 08:52:48 GMT

Have you tried getting the file without using Talend? E. g. using smbget command in a terminal?

Ideally try this from the same machine where you would run your Talend job.

Or can you place files in different sizes in the Samba share you try to use tFileFetch on them with increasing file size each time?

Can you get logs from the machine where the samba share is located? Maybe this gives some insight.

topic Re: tFileFetch Connection Refused - Is file dimension a failure point? in Talend Studio

tFileFetch Connection Refused - Is file dimension a failure point?

Re: tFileFetch Connection Refused - Is file dimension a failure point?