topic Re: send json data via REST request on talend in Talend Studio

send json data via REST request on talend

Anonymous — Sat, 16 Nov 2024 05:48:51 GMT

hi evryone , i want to send data to my elasticsearch database. for that I recover my data from an oracle database I transform them into json and send them via a REST request on talend

I use elasticsearch versions 7.0.1 and talend 7.1.1

data send :

{"name": "Fabrice", "site": "Paris", "department": "North West"}

method Post in this url : "http://localhost:9200/myIndex"

i have this error :

exception in component tRESTClient_1 (DataOracleToJson)
javax.ws.rs.WebApplicationException: HTTP 400 Bad Request

Re: send json data via REST request on talend

vapukov — Fri, 17 May 2019 10:51:55 GMT

Hi,

you put "Content-Type" and "Accept" into the wrong place

if you want to use them (it will work and without) - use Advanced settings headers section

add:

one more:

URL
and Relative path

both parts of the full address:

URL - http://localhost:9200

Relative path - /myindex/_doc

Re: send json data via REST request on talend

Anonymous — Fri, 17 May 2019 11:06:46 GMT

thank you for your answer, I remove but still the same problem :

Exception in component tRESTClient_1 (DataOracleToJson)
javax.ws.rs.WebApplicationException: HTTP 400 Bad Request
	at local_projectoracle_to_json.dataoracletojson_0_1.DataOracleToJson.tWriteJSONField_2_InProcess(DataOracleToJson.java:2621)
	at local_projectoracle_to_json.dataoracletojson_0_1.DataOracleToJson$1ThreadXMLField_tWriteJSONField_2_Out.run(DataOracleToJson.java:930)

yet if I run the query with curl it works

curl -XPOST "http://localhost:9200/myIndex/_doc" -H 'Content-Type: application/json' -d' {"name": "Fabrice", "site": "Paris", "department": "North West"}'

Re: send json data via REST request on talend

vapukov — Fri, 17 May 2019 11:21:39 GMT

please see add part of answer

Re: send json data via REST request on talend

Anonymous — Fri, 17 May 2019 11:29:36 GMT

Re: send json data via REST request on talend

vapukov — Fri, 17 May 2019 11:55:16 GMT

I mean - see "add" section in my answer 🙂

your address is duplicate each other, but it really - 2 parts of the same address

also - good to add some connection to response and error flows from tRESTClient

both parts of the full address:
URL - http://localhost:9200
Relative path - /myindex/_doc

Re: send json data via REST request on talend

Anonymous — Mon, 20 May 2019 13:12:09 GMT

thanks for your answer, i edit but there is always the same error HTTP 400 Bad Request, I look with wireshark, the request is send but the json object is not send

Re: send json data via REST request on talend

vapukov — Mon, 20 May 2019 13:24:18 GMT

Hi,

there need to check all chain - what and how you prepare, types, column name

in my case, I use a single tXMLMap instead of tMap + tWriteJSON and populate column body (type document)

everything work

Re: send json data via REST request on talend

Anonymous — Mon, 20 May 2019 14:00:31 GMT

I put the tXMLMap and I checked all the chain I see the object json go until tRestClient, everything seems ok. I think the problem comes from the configuration of the tRestClient, how to fill the body of the column (document type)

Re: send json data via REST request on talend

Anonymous — Tue, 21 May 2019 13:42:34 GMT

with curl :

With curl

with talend:

With talend

Re: send json data via REST request on talend

Anonymous — Wed, 22 May 2019 09:04:48 GMT

when I put a document in the tXMLmap it tells me "type mismatch can not convert from string to document"
and on the forum:

https://community.talend.com/t5/Design-and-Development/resolved-Need-to-convert-JSON-string-to-document-for-use-in/td-p/78091

it says that it must be sent in string and not in document, when I do it, it puts me in error (except error 400 bad request), when I check the request send with wireshark I see the object json is not send in the request

Re: send json data via REST request on talend

Anonymous — Wed, 05 Feb 2020 10:10:47 GMT

i had the same issue and I used this flow. in the tWriteJsonField, the Output column is set to "string" and not the body and I removed the root Node as I don't need it