topic Re: Insert data into DB using Django REST API in Talend Studio

Insert data into DB using Django REST API

sushantV — Mon, 05 Nov 2018 18:08:53 GMT

I am trying utilize Django REST APIs to insert data into the database, instead of the direct write. I've been able to read JSON data using the tRESTClient component but I am not too sure about the insertion/POST. Could someone point me to the components (and relation) that I should use?

The current job that I have is mostly: Read data from raw file -> tMap -> DB and I wish to do something like Read data from raw file -> tMap -> (pass on data to REST endpoint via POST)

PS: I realize that this might not be the most efficient way to ingest data but that's what the business wants since it brings in an additional layer of control.

Re: Insert data into DB using Django REST API

Anonymous — Mon, 05 Nov 2018 18:23:52 GMT

use a tRestClient component to send rest requests.

Re: Insert data into DB using Django REST API

sushantV — Mon, 05 Nov 2018 19:09:08 GMT

Still not working but I got it moved ahead a little.

Used the tRestClient component after my tMap and I could see the records getting inserted into the DB but all of them are without any data. Strangely nowhere I was asked to specify the JASON tree. The number of records getting inserted are equal to rows being read from raw file so at least something is right. But I couldn't locate the menu/options to specify which data element read from the raw file should tag to which JASON element.

How do I specify the data to JSON mapping?

@@rhall @Dijke @TRF @nthampi

Re: Insert data into DB using Django REST API

sushantV — Tue, 06 Nov 2018 17:03:06 GMT

Quite amazed that nobody knows this/ can help with this thing. I am sure somebody would have done doing a POST insert using RESTful APIs in Talend. @ctoum @

Re: Insert data into DB using Django REST API

sushantV — Thu, 08 Nov 2018 18:52:58 GMT

Need some help here. Can someone at least point me in some direction? I can try to figure things on my own. At least the experts, let me know which component should I be using.