topic Re: Processing Dynamic URL data with tRestClient in Talend Studio

Processing Dynamic URL data with tRestClient

Anonymous — Fri, 08 Nov 2019 14:47:26 GMT

Hi Team,

I am trying to update the Slack API URL with particular channel_id ( we already inserted in oracle table) through tRestClient component.

What i have done is updated the context variable with tJava and using that context variable in URL. Below are the attachment for the same( image and image(1)):-

The problem with this approach is, output i am getting is from the last updated channel_id in the context variable.

Below image(2), we are getting two channel_id's ( as i am fetching only these two from oracle)

from tJava.

But output from the URL is for the last updated channel_id that is CQ74QNGG5. Can anyone help me in this ??

Re: Processing Dynamic URL data with tRestClient

Anonymous — Fri, 08 Nov 2019 18:27:51 GMT

Change your tJava to a tJavaFlex and join it using a "row" to the tRestClient. Keep the code the same. Your problem is being caused by the fact that the first subjob is running completely before your tRestClient is running. By joining the flows, you can get the tRestClient to run for every iteration.

Re: Processing Dynamic URL data with tRestClient

Anonymous — Mon, 11 Nov 2019 10:38:23 GMT

It worked, with the tLogRow. As you can see in the images of two channels. But in the oracle while inserting i am getting only one channel data that is CQ74QNGG5 channel. Last image is of oracle data. I am not able to get the reason, why it is.

Channel_CQ4PL1QSG.PNG
Channel_CQ74QNGG5.PNG
Oracle_data.PNG

Re: Processing Dynamic URL data with tRestClient

Anonymous — Mon, 11 Nov 2019 10:56:47 GMT

You are not inserting to Oracle in the screenshots that I have seen. When is this happening? Also, would you be able to add your images to the main body of the post. The "Photos" button allows you to do that. It can be quite difficult to work with images that need to be downloaded and viewed in a separate window.

Re: Processing Dynamic URL data with tRestClient

Anonymous — Mon, 11 Nov 2019 11:05:43 GMT

Okay, I will do that. Actually I was using truncate table with reuse storage in Action on table, that's why i think on second iteration it will truncate the records and then insert the latest one.

By Removing the truncate table option to default, i am able to insert records. But i can manage both, iteration process and when i run again it should truncate data and load again in DB.

Re: Processing Dynamic URL data with tRestClient

Anonymous — Mon, 11 Nov 2019 11:08:39 GMT

You are correct. When you have an iterate link in your flow, all components following that Iterate link are restarted for every iteration. As your DB component was restarted for every link, it will have truncated everything that was there prior to the restart

Re: Processing Dynamic URL data with tRestClient

Anonymous — Mon, 11 Nov 2019 12:24:31 GMT

Agreed, but with this, when i run my job again the data got appended again. So is there any other way, i can truncate the table without effecting my iteration logic.

Re: Processing Dynamic URL data with tRestClient

Anonymous — Mon, 11 Nov 2019 13:40:35 GMT

Truncate it at the beginning of the Job. The first step of the Job should be the truncation step, then everything else will follow

Re: Processing Dynamic URL data with tRestClient

Anonymous — Tue, 12 Nov 2019 06:20:26 GMT

How to truncate the job at the beginning, should i need to write some custom code or sql query while i am fetching the data.

Below is the image how i am fetching the data from oracle

Re: Processing Dynamic URL data with tRestClient

Anonymous — Tue, 12 Nov 2019 12:17:36 GMT

Use a tDBRow and write the truncate statement in that.