topic Web Service in Talend Studio

Web Service

raoh — Sat, 16 Nov 2024 02:29:44 GMT

Hello,

I have a problem with the processing of the response returned by my component.

First of all,

"https://mySite.fr/export/csvproducts"

This URL return me a CSV file when i use it in my web browser. I tried with POSTMAN is working too.

I want to automate this file generation so I can store it in a database.

For this I used the "thttpRequest" component with GET method

then i used "tExtractDelimitedFields"

The first line is my header which contains 17 columns.

And the result is weird : i have only the first line

Where i'm wrong ?

I thank you in advance

If u have time and idea what to do here ==> Unresolved Post : Curl

Re: Web Service

tjohn — Thu, 07 May 2020 23:42:15 GMT

Hi
I think you need to first check response . Put a tlogrow after thttprequest.
Further what is the delimiter in textractdelimited component?
Give a screenshot. Thanks

Re: Web Service

raoh — Fri, 08 May 2020 00:17:20 GMT

Hi,

Thank u for your answer :

I've put a tlogrow after thttprequest :

Tlogrow's result :

The delimiter is : semicolon ( ; )

Regards,

Re: Web Service

tjohn — Sat, 09 May 2020 16:41:18 GMT

Hi raoh,
give a try to this :
in tHttpRequest, check write the response body in file and choose file directory
then place a tFileInputFullRow Component to process line by line
link with your existing tExtractDelimitedFields and tlogrow
that will do the trick
Thanks

Re: Web Service

raoh — Mon, 11 May 2020 10:35:36 GMT

Hi @tjclearner

It's working good.

But unfortunately on the target environment (the one where the processing will be deployed), the only right I have is to access the database. I am not allowed to write files on the server ...

I have the impression that the answer is not properly formatted. It doesn't "see" the line break. For the traitement the answer is a single line.

To test this, I added 20 more columns in the component tExtractDelimitedFields , and guess what, all my columns are filled.

I was thinking at 2 other ways :

if we put a tJavaRow/tJavaFlex between tHttpRequest and tExtractDelimitedFields, to format the response it could be work ?
Or this way : This step is divided into 2 parts
1. To insert the response directly in table (temp_table, which contains 1 columns as array[])
2. From this table, with a specific treatement( how ?) insert in my final table

Regards,

Re: Web Service

raoh — Fri, 15 May 2020 09:21:31 GMT

any idea ?