Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Tfilefetch upload documents

Hi, i just want to know if tfilefetch can upload all type of document ? with all size of document ? Small or Big ? Is there a limit size with that componant ?

I try to upload files with tfilfetch on Nuxeo server with an url in http mode. Some of documents are uploaded by the server and some not. Big sizes are rejected. More than 2088790 octets

Thanks for your help.

Marc

Labels (2)
3 Replies
Anonymous
Not applicable
Author

Hello @marcl1 ,

What's error message are you getting when upload large file via tFileFetch component? Is it the java.lang.OutOfMemoryError?

Best regards

Sabrina

Anonymous
Not applicable
Author

Hi, i have error message from the component. When i play the job for each file i use the tFilefetch for on file to upload then the job ask the server (with a tRestClient) in GET methode to send the return code. The nuxeo server send for the uploaded files code 201 ( Then ok) but when files are big the server returns an error. I'm sur that the problem is with the server but the team doesn't want to investigate and they officialy say that  someTalend components are not well writed.

Here the message error:

There isContinue_tFileFetch_1 an exception on: ''http://serverName/nuxeo/api/v1/upload/batchId-315a6257-32ac-4daf-91fa-d0ab09a69ada/0""

java.net.SocketException: Connection reset by peer: socket write error

            at java.net.SocketOutputStream.socketWrite0(Native Method)

            at java.net.SocketOutputStream.socketWrite(Unknown Source)

            at java.net.SocketOutputStream.write(Unknown Source)

            at java.io.BufferedOutputStream.write(Unknown Source)

            at org.apache.commons.httpclient.methods.multipart.FilePart.sendData(FilePart.java:222)

            at org.apache.commons.httpclient.methods.multipart.Part.send(Part.java:311)

            at org.apache.commons.httpclient.methods.multipart.Part.sendParts(Part.java:384)

            at org.apache.commons.httpclient.methods.multipart.MultipartRequestEntity.writeRequest(MultipartRequestEntity.java:163)

            at org.apache.commons.httpclient.methods.EntityEnclosingMethod.writeRequestBody(EntityEnclosingMethod.java:495)

            at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:1973)

            at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:993)

            at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:397)

            at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:170)

            at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)

            at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFileFetch_1Process(AppelRestDocumentsImages_V2.java:7398)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFileProperties_1Process(AppelRestDocumentsImages_V2.java:7074)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFixedFlowInput_1Process(AppelRestDocumentsImages_V2.java:6073)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tRESTClient_2Process(AppelRestDocumentsImages_V2.java:5022)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFileInputDelimited_1Process(AppelRestDocumentsImages_V2.java:3043)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tDBRow_1Process(AppelRestDocumentsImages_V2.java:1891)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tDBConnection_3Process(AppelRestDocumentsImages_V2.java:1724)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.runJobInTOS(AppelRestDocumentsImages_V2.java:14608)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.main(AppelRestDocumentsImages_V2.java:14021) 

Anonymous
Not applicable
Author

Hi , i only get this error :

"

There isContinue_tFileFetch_1 an exception on: "http://serverName/nuxeo/api/v1/upload/batchId-315a6257-32ac-4daf-91fa-d0ab09a69ada/0"

java.net.SocketException: Connection reset by peer: socket write error

            at java.net.SocketOutputStream.socketWrite0(Native Method)

            at java.net.SocketOutputStream.socketWrite(Unknown Source)

            at java.net.SocketOutputStream.write(Unknown Source)

            at java.io.BufferedOutputStream.write(Unknown Source)

            at org.apache.commons.httpclient.methods.multipart.FilePart.sendData(FilePart.java:222)

            at org.apache.commons.httpclient.methods.multipart.Part.send(Part.java:311)

            at org.apache.commons.httpclient.methods.multipart.Part.sendParts(Part.java:384)

            at org.apache.commons.httpclient.methods.multipart.MultipartRequestEntity.writeRequest(MultipartRequestEntity.java:163)

            at org.apache.commons.httpclient.methods.EntityEnclosingMethod.writeRequestBody(EntityEnclosingMethod.java:495)

            at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:1973)

            at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:993)

            at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:397)

            at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:170)

            at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)

            at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFileFetch_1Process(AppelRestDocumentsImages_V2.java:7398)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFileProperties_1Process(AppelRestDocumentsImages_V2.java:7074)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFixedFlowInput_1Process(AppelRestDocumentsImages_V2.java:6073)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tRESTClient_2Process(AppelRestDocumentsImages_V2.java:5022)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tFileInputDelimited_1Process(AppelRestDocumentsImages_V2.java:3043)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tDBRow_1Process(AppelRestDocumentsImages_V2.java:1891)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.tDBConnection_3Process(AppelRestDocumentsImages_V2.java:1724)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.runJobInTOS(AppelRestDocumentsImages_V2.java:14608)

            at pomona_2019.appelrestdocumentsimages_v2_0_1.AppelRestDocumentsImages_V2.main(AppelRestDocumentsImages_V2.java:14021) 
 "