topic Re: From json file to tRESTClient one request only in Talend Studio

From json file to tRESTClient one request only

rubenfasilva — Fri, 15 Nov 2024 22:17:38 GMT

Hello.

I have a simple job with a json file structed like this:

[

{

"sku" : "A",

"warehouse" : "NY",

"qty" : 2

{

"sku" : "B",

"warehouse" : "CA",

"qty" : 3

{

"sku" : "C",

"warehouse" : "LA",

"qty" : 1

}

]

That I would like to post on a website using trestclient with one request only instead one request per line.

My job is:

tfileinputjson -> txmlMap -> trestclient

Is possible to make one request only?

Re: From json file to tRESTClient one request only

Anonymous — Wed, 07 Dec 2022 22:19:44 GMT

You'll need to explain what is happening here. Why do you have JSON going to a tXMLMap? That seems a little odd. Also, how is your original JSON formed? Is that it in the example above? How is your tFileInputJSON configured? What does your API expect in terms of structure?

Re: From json file to tRESTClient one request only

Anonymous — Thu, 08 Dec 2022 03:53:11 GMT

Make sure the 'All in one' option is set to 'true' if you want to build one document.

Regards

Shong

Re: From json file to tRESTClient one request only

rubenfasilva — Mon, 12 Dec 2022 15:37:23 GMT

Hello Shong.

I tried your way, buy my post api is expecting my json struture, but i am receiving this:

200||{"data":[{"status":"error","error":"SKU is a required param","erp_transaction_id":null}]}.

And this is api server logs:

I don't understand why

Re: From json file to tRESTClient one request only

Anonymous — Mon, 12 Dec 2022 15:47:59 GMT

I think the best way of solving this is to work out what you are API actually needs first. Getting the job right can only be done once you know what you should be sending the API. This will depend up on the documentation for the API. Once you know what needs to be sent, we can help you get it sent in the right way with Talend.

Re: From json file to tRESTClient one request only

rubenfasilva — Mon, 12 Dec 2022 16:17:14 GMT

The api needs this structure and the json file is ok with this:

[

{

"sku" : "A",

"warehouse" : "NY",

"qty" : 2

{

"sku" : "B",

"warehouse" : "CA",

"qty" : 3

{

"sku" : "C",

"warehouse" : "LA",

"qty" : 1

}

]

I've tried this json structure on the API using postmad and works fine.

Maybe it's something between txmlmap or trestclient?

Re: From json file to tRESTClient one request only

Anonymous — Mon, 12 Dec 2022 16:22:47 GMT

You shouldn't be using a tXMLMap for this. That is for XML, not for JSON. How are you creating this JSON?

Re: From json file to tRESTClient one request only

rubenfasilva — Mon, 12 Dec 2022 16:35:41 GMT

The json file is created like this:

With Generate an json array option as True

Tmap:

If you need more info, let know!

Thank you all!

Re: From json file to tRESTClient one request only

Anonymous — Mon, 12 Dec 2022 17:05:58 GMT

I presume that the "stocks" file is the file you are reading with your tFileInputDelimited component. Is that correct? I also presume that you just want to send everything in the file in one API call. Is that correct?

If so, you can change the tFileInputDelimited to a tFileInputRaw. Output as a String. Connect that to a tMap and connect the Rest component to the output of the tMap. Connect your input "content" field to the output "string" field.

This will connect the content to your REST component unchanged. If you need it change, we will need to do something a little differently, but I will need to know what you want changed.

Re: From json file to tRESTClient one request only

Anonymous — Mon, 12 Dec 2022 17:17:08 GMT

Oh, if that "stocks" file has private data in it, you should probably take it down.

Re: From json file to tRESTClient one request only

rubenfasilva — Tue, 13 Dec 2022 09:30:09 GMT

Hello.

Stocks file is the struture in json.

If I use it as raw, I have no answer from API:

200||{"data":[{"status":"error","error":"No data received","erp_transaction_id":null}]}

Re: From json file to tRESTClient one request only

Anonymous — Tue, 13 Dec 2022 10:34:25 GMT

Can you show me the job design and how the components are configured please? You should not be sending no data unless there is something wrong with how the components are configured. If the components are configured correctly, then we will need to look at what your API is expecting.

Re: From json file to tRESTClient one request only

rubenfasilva — Tue, 13 Dec 2022 11:17:37 GMT

Hello.

From a csvfileinput I am generating json file(stocks.json) with the required structure.

Then I am trying to make the post using the stocks.json file to the API

This is the json file input:

This is the txmlmap:

Thank you

Re: From json file to tRESTClient one request only

Anonymous — Tue, 13 Dec 2022 11:53:00 GMT

The tXMLMap is the wrong component. That produces XML and not JSON.

I was hoping you would show me the job where you tried my suggestion. The way you're doing the above will not work at all if your API requires JSON.

Re: From json file to tRESTClient one request only

rubenfasilva — Tue, 13 Dec 2022 12:16:19 GMT

Hello

If i do your suggestion I have this response:

200||{"data":[{"status":"error","error":"No data received","erp_transaction_id":null}]}

This i what I did:

This is the tmap config:

I am stuck....

Re: From json file to tRESTClient one request only

Anonymous — Tue, 13 Dec 2022 14:38:52 GMT

You need to send JSON to the "string" column. "body" is for XML, "string" is for JSON. Although XML looks like a String, it is handled differently. JSON is just handled as a String.

Re: From json file to tRESTClient one request only

rubenfasilva — Tue, 13 Dec 2022 15:07:29 GMT

Hello.

I did that now and I have this response:

statusCode body string

200||{"data":[{"status":"error","error":"No data received","erp_transaction_id":null}]}

This is my job:

My tmap:

I've tested the raw data that is inside the file on postman and works fine.

Re: From json file to tRESTClient one request only

Anonymous — Tue, 13 Dec 2022 15:22:21 GMT

Can you add a tLogRow between your tMap and tRESTClient. This will show you what is being sent to the tRESTClient. I presume that the tFileInputRaw is set to "Read the file as a string".

The one component we have not looked at yet is the tRESTClient. Can you show me how that is configured?

Re: From json file to tRESTClient one request only

rubenfasilva — Tue, 13 Dec 2022 15:36:50 GMT

Hello.

yes, tFileInputraw is set to read as string.

trestclient:

And with the the tlogrow between tmap and trestclient we have this:

Let me know if you need anything else.

Once again, thank you

Re: From json file to tRESTClient one request only

Anonymous — Tue, 13 Dec 2022 16:00:42 GMT

OK, everything is looking OK from what I can see. Do you have any documentation for the API that I can look at? The number of records that were included in the JSON file are quite a lot. I suspect that the error message is misleading. Can you test this by reducing the number of records to 1, then try 2, 3, 4, etc, and see what you get?