Web Service

[raoh]

Hello,

I have a problem with the processing of the response returned by my component.

First of all,

"https://mySite.fr/export/csvproducts"

This URL return me a CSV file when i use it in my web browser. I tried with POSTMAN is working too.

I want to automate this file generation so I can store it in a database.

For this I used the "thttpRequest" component with GET method

then i used "tExtractDelimitedFields"

The first line is my header which contains 17 columns.

And the result is weird : i have only the first line

Where i'm wrong ?

I thank you in advance

If u have time and idea what to do here ==> Unresolved Post : Curl 

[tjohn]

Hi
I think you need to first check response . Put a tlogrow after thttprequest.
Further what is the delimiter in textractdelimited component?
Give a screenshot. Thanks

[raoh]

Hi,

Thank u for your answer :

I've put a tlogrow after thttprequest :

Tlogrow's result :

The delimiter is : semicolon ( ; )

Regards,

[tjohn]

Hi raoh,
give a try to this :
in tHttpRequest, check write the response body in file and choose file directory
then place a tFileInputFullRow Component to process line by line
link with your existing tExtractDelimitedFields and tlogrow
that will do the trick
Thanks

[raoh]

Hi @tjclearner 

It's working good.

But unfortunately on the target environment (the one where the processing will be deployed), the only right I have is to access the database. I am not allowed to write files on the server ...

I have the impression that the answer is not properly formatted. It doesn't "see" the line break. For the traitement the answer is a single line.

To test this, I added 20 more columns in the component tExtractDelimitedFields , and guess what, all my columns are filled.

I was thinking at 2 other ways :

1. if we put a tJavaRow/tJavaFlex  between tHttpRequest and tExtractDelimitedFields, to format the response it could be work ?
2. Or this way : This step is divided into 2 parts
   1. To insert the response directly in table (temp_table, which contains 1 columns as array[])
   2. From this table, with a specific treatement( how ?) insert in my final table

Regards,

[raoh]

any idea ?