topic How to process the data save in SQL DB from tRestClient on Talend Open Studio for Big Data in Talend Studio

How to process the data save in SQL DB from tRestClient on Talend Open Studio for Big Data

Anonymous — Sat, 16 Nov 2024 08:25:27 GMT

Hello Everyone,

I am very new to everithing here Talend,Talend community,Rest,JSON,XML.

Having said that, I needed to pull data from Zoho CRM using reporting API.

I found a way to do it using tRestClient (data fetch working perfectly fine). Below is the screenshot of the job.

But I am facing issue in saving this data into a table in MySQL DB.

Need help in understanding which components I should use to bring data into a format that I can save into DB table.

Also attached the data sheet I received after running the above job.

csv output configurationtrestclient configuration

Thanks in advance...!!

Re: How to process the data save in SQL DB from tRestClient on Talend Open Studio for Big Data

vboppudi — Wed, 11 Apr 2018 15:25:10 GMT

Hi,

To modify data in specific format you can use tMap or any other component based on your requirement. You can use tMysqlOutput to process data to DB.

Regards,

Re: How to process the data save in SQL DB from tRestClient on Talend Open Studio for Big Data

Anonymous — Wed, 11 Apr 2018 15:39:18 GMT

@vboppudi

Thanks for the quick reply, but data is not as simple as it should be.

If you look at the data sheet I have attached you will understand that, it may not be possible to directly use tmap and save it.

When you look at the data sheet if you still think its possible to identify the columns and rows then please share bit more details on how to do it.

Thanks

Re: How to process the data save in SQL DB from tRestClient on Talend Open Studio for Big Data

vboppudi — Wed, 11 Apr 2018 15:49:51 GMT

Hi,

Do you have sample data returned from tRestclient?

If yes please provide that return data and expected data to be loaded in DB.

Regards,

Re: How to process the data save in SQL DB from tRestClient on Talend Open Studio for Big Data

Anonymous — Thu, 12 Apr 2018 05:50:09 GMT

Hi Veeranjaneyulu,

I had replied you y'day but its not appearing here. So am replying again.

I have attached the output from tRestClient.

Also below is the out I want to save it. Am showing here only 4 columns as sample. But there are more columns in attached file.

Thanks Again

out_final.csv
expected_output_format.xlsx

Re: How to process the data save in SQL DB from tRestClient on Talend Open Studio for Big Data

vboppudi — Thu, 12 Apr 2018 22:51:50 GMT

Hi,

Are you looking to read CSV file record by record and split record into different attributes then apply business logic for each attribute. Then load records to target DB table?

If yes please find the approach below.

Here you need to pass tRestclient return data to tFileinputFullrow and using tExtractDelimitedfields you can split one record in number of attributes by specifying delimiter.

Regards,