topic Tfilefetch upload documents in Talend Studio

Tfilefetch upload documents

Anonymous — Wed, 20 Mar 2019 12:05:50 GMT

Hi, i just want to know if tfilefetch can upload all type of document ? with all size of document ? Small or Big ? Is there a limit size with that componant ?

I try to upload files with tfilfetch on Nuxeo server with an url in http mode. Some of documents are uploaded by the server and some not. Big sizes are rejected. More than 2088790 octets

Thanks for your help.

Marc

Re: Tfilefetch upload documents

Anonymous — Fri, 22 Mar 2019 08:28:52 GMT

Hello @marcl1 ,

What's error message are you getting when upload large file via tFileFetch component? Is it the java.lang.OutOfMemoryError?

Best regards

Sabrina

Re: Tfilefetch upload documents

Anonymous — Fri, 22 Mar 2019 14:31:15 GMT

Hi, i have error message from the component. When i play the job for each file i use the tFilefetch for on file to upload then the job ask the server (with a tRestClient) in GET methode to send the return code. The nuxeo server send for the uploaded files code 201 ( Then ok) but when files are big the server returns an error. I'm sur that the problem is with the server but the team doesn't want to investigate and they officialy say that someTalend components are not well writed.

Here the message error:

There isContinue_tFileFetch_1 an exception on: ''http://serverName/nuxeo/api/v1/upload/batchId-315a6257-32ac-4daf-91fa-d0ab09a69ada/0""

java.net.SocketException: Connection reset by peer: socket write error

at java.net.SocketOutputStream.socketWrite0(Native Method)

at java.net.SocketOutputStream.socketWrite(Unknown Source)

at java.net.SocketOutputStream.write(Unknown Source)

at java.io.BufferedOutputStream.write(Unknown Source)

at org.apache.commons.httpclient.methods.multipart.FilePart.sendData(FilePart.java:222)

at org.apache.commons.httpclient.methods.multipart.Part.send(Part.java:311)

at org.apache.commons.httpclient.methods.multipart.Part.sendParts(Part.java:384)

at org.apache.commons.httpclient.methods.multipart.MultipartRequestEntity.writeRequest(MultipartRequestEntity.java:163)

at org.apache.commons.httpclient.methods.EntityEnclosingMethod.writeRequestBody(EntityEnclosingMethod.java:495)

at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:1973)

at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:993)

at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:397)

at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:170)

at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)

at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)

at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFileFetch_1Process(AppelRestDocumentsImages_V2.java:7398)

at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFileProperties_1Process(AppelRestDocumentsImages_V2.java:7074)

at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFixedFlowInput_1Process(AppelRestDocumentsImages_V2.java:6073)

at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tRESTClient_2Process(AppelRestDocumentsImages_V2.java:5022)

at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFileInputDelimited_1Process(AppelRestDocumentsImages_V2.java:3043)

at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tDBRow_1Process(AppelRestDocumentsImages_V2.java:1891)

at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tDBConnection_3Process(AppelRestDocumentsImages_V2.java:1724)

at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.runJobInTOS(AppelRestDocumentsImages_V2.java:14608)

at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.main(AppelRestDocumentsImages_V2.java:14021)

Re: Tfilefetch upload documents

Anonymous — Fri, 22 Mar 2019 17:46:11 GMT

Hi , i only get this error :

There isContinue_tFileFetch_1 an exception on: "http://serverName/nuxeo/api/v1/upload/batchId-315a6257-32ac-4daf-91fa-d0ab09a69ada/0"