topic Re: Uploading a file to tREST API in Talend Studio

Uploading a file to tREST API

Anonymous — Mon, 26 Feb 2018 21:04:16 GMT

Hello,

I am calling a REST API which has multiple input parameters and one of the input parameters is a file (CSV).

How can I load a file using tREST component?

Re: Uploading a file to tREST API

Anonymous — Mon, 26 Feb 2018 22:47:47 GMT

It would help to see the API specification for this. But you may be able to just use the tFileFetch (https://help.talend.com/reader/jomWd_GKqAmTZviwG_oxHQ/F4QsQrja9IQEa_kKqmBfNQ). Don't be put off by the name, this component can be used to both download files and upload them.

Re: Uploading a file to tREST API

Anonymous — Mon, 26 Feb 2018 22:56:11 GMT

Thanks for the reply. However i have to pass a bunch of parameters in the body of the request as shown in the postman screenshot below. How do you propose I do that using tFileFetch? Any example to share perhaps?

Capture.PNG

Re: Uploading a file to tREST API

Anonymous — Mon, 26 Feb 2018 23:26:46 GMT

The tFileFetch sends a multipart message in the body. This contains the file and the other parameters. It is unfortunate that I cannot try this out as I do not have access to your service. Web services are notoriously tricky to work out without having access to them. But have you tried setting our parameters in the parameters section of the tFileFetch?

Re: Uploading a file to tREST API

Anonymous — Tue, 27 Feb 2018 20:41:31 GMT

I tried with the tFileFetch component and it seems to be hitting the service but returns with the below error message. I get the header of the response back but not the body and I dont know from where its trying to pick the "\defaultfilename.txt". Also, if I try to run the component the second time it fails. And if I change the file name to something else it runs again with the below message. Do you know whats going on here.

"Starting job Copy_of_testRestAPI at 15:35 27/02/2018.

[statistics] connecting to socket on port 3694
[statistics] connected
Status Line: HTTP/1.1 200 OK
*** Response Header ***
Server: nginx
Date: Tue, 27 Feb 2018 20:35:45 GMT
Content-Type: application/json
Content-Length: 612
Connection: keep-alive
Vary: Accept-Encoding
X-Powered-By: Express
Vary: Origin
X-Content-Type-Options: nosniff
X-XSS-Protection: 1; mode=block
Strict-Transport-Security: max-age=86400; includeSubDomains
Exception in component tFileFetch_1 (Copy_of_testRestAPI)
java.io.FileNotFoundException: \defaultfilename.txt (Access is denied)
at java.io.FileOutputStream.open0(Native Method)
at java.io.FileOutputStream.open(Unknown Source)
at java.io.FileOutputStream.<init>(Unknown Source)
at java.io.FileOutputStream.<init>(Unknown Source)
at amgen_data_validations.copy_of_testrestapi_0_1.Copy_of_testRestAPI.tFileFetch_1Process(Copy_of_testRestAPI.java:618)
at amgen_data_validations.copy_of_testrestapi_0_1.Copy_of_testRestAPI.runJobInTOS(Copy_of_testRestAPI.java:890)
at amgen_data_validations.copy_of_testrestapi_0_1.Copy_of_testRestAPI.main(Copy_of_testRestAPI.java:733)
[statistics] disconnected"

1.PNG
2.PNG

Re: Uploading a file to tREST API

Anonymous — Wed, 28 Feb 2018 09:48:04 GMT

This looks like a file/folder permission issue. Have you tried moving the file to a location where everyone has permission?

Re: Uploading a file to tREST API

Anonymous — Wed, 28 Feb 2018 17:02:04 GMT

yes the file is in "c://" with read write access to everyone.

Also, like I said if I change the name of the file it works fine and then in the above case it got the header back but not the body.

Re: Uploading a file to tREST API

Anonymous — Wed, 28 Feb 2018 17:22:11 GMT

Attaching my settings from tFileFetch. Does this seem to be right? Any pointers?

3.PNG
4.PNG

Re: Uploading a file to tREST API

Anonymous — Wed, 28 Feb 2018 17:36:39 GMT

Your settings look fine.

The defaultfilename.txt comes from some default code for the tFileFetch to set a destination filename. You could maybe try ticking "Use cache to save resource" as a workaround (if that is causing this, it is a bug).

This is really difficult to resolve without having access to the service. Documentation and implementations of services can vary wildly and you really need to treat using them with Talend like a debugging exercise. If I were you I would try this method demonstrated here: http://talend.nl/talend-tech-tip-calling-a-rest-service-for-file-upload/

Re: Uploading a file to tREST API

Anonymous — Fri, 09 Mar 2018 20:06:13 GMT

Ultimately I did write the JAVA code to call the API. Which is not the ideal way to do it. So going to close this topic and have opened another one to see if anyone from Talend can address it.

Re: Uploading a file to tREST API

Anonymous — Sun, 20 Jan 2019 16:50:05 GMT

rhall_2_0

I am very interested in how tFileFetch for uploading a file to an API

however the link you specified in your response is invalid

could you please either send me a new link or provide the necessary instructions on how to use this connector

you have always been helpful

thank you in advance

mjan100917

Re: Uploading a file to tREST API

Anonymous — Sun, 20 Jan 2019 16:50:19 GMT

rhall_2_0

I am very interested in how tFileFetch for uploading a file to an API
however the link you specified in your response is invalid

could you please either send me a new link or provide the necessary instructions on how to use this connector

you have always been helpful

thank you in advance

mjan100917

Re: Uploading a file to tREST API

Anonymous — Sun, 20 Jan 2019 22:40:58 GMT

Hi @mjan100917,

I just tested the link and it works for me. I suspect that maybe the server was down when you tried it.

Regards

Richard

Re: Uploading a file to tREST API

OSchmitt1227 — Thu, 03 Jun 2021 09:13:47 GMT

Hi,

The link http://talend.nl/talend-tech-tip-calling-a-rest-service-for-file-upload/ seems to be broken. Does anyone have the original post?

Best regards,

Olivier

Re: Uploading a file to tREST API

hamdi_bourbia — Fri, 01 Oct 2021 14:54:22 GMT

Hi, is it not possible to uploading a (csv) file via HTTP PUT method using the tRESTClient component ? tFileFetch is deprecated in studio 7.3, so it doesn't seem very industrializable ...

Re: Uploading a file to tREST API

Anonymous — Fri, 01 Oct 2021 18:07:11 GMT

You can upload files using the tRestClient, but there is not a standard "out of the box" way of achieving this. It very much depends on the API you are using. Some APIs require the file is converted to a Base64 encoding, some take the contents of the file and recreate the file on the server (usually when the file is just supplying data), others do it other ways. Then there are the different headers, etc, you need to configure. The only way I have ever managed to achieve this is by having access to the API, the API documentation and then configuring the tRestClient according to that. Sometimes I have also had to use some Java in order to get it working. This is not a flaw with Talend, this is a consequence of different implementations of how this task is achieved.