topic Re: Conversion of file types dynamically using talend in Talend Studio

Conversion of file types dynamically using talend

Nadz-Talend — Tue, 30 Mar 2021 05:30:01 GMT

I am new to talend and I am finding a Transformation service fits with our organization.

My requirement is mainly transforming a given file to particular format.

Ex: JSON to XML

XML to JSON, etc

I need to expose a talend job as a common service and when running this service user should be able to give file path, file type and target file type.

Can I do this using talend?

Is there any way to define dynamic schema for xml and json files?

Is there any good documentations regarding those requirements.

Highly appreciate your response regarding this.

Thank You

Re: Conversion of file types dynamically using talend

Anonymous — Tue, 30 Mar 2021 07:32:37 GMT

Hello,

Are you trying to achieve this goal in a standard job(Data Integration) or talend ESB product with mediation route?

With talend data integration, you are able to convert XML to JSON with below design

tFileInputXML--main--tWriteJsonField--main-->tFileOutputDelimited

For JSON to XML, read your json file using tFileInput and pass to the tHmap and then create the XML.

Please give us more information about your input source and background which will be helpful for us to assistant you.

Best regards

Sabrina

Re: Conversion of file types dynamically using talend

Nadz-Talend — Tue, 30 Mar 2021 08:28:42 GMT

Thank you for your prompt response.

Since I need to expose the job as a web service, now I downloaded talend ESB but it is only showing 'standalone job' as the build type.

It is not showing 'Axis Web Services (WAR)' in build type dropdown.

I'm using talend ESB 7.3.1 version.

What is the reason for that?

Please answer to below questions also.

Is there any possibility for user to define their schema in run time using talend open studio? (ESB or Data Integration)
Is there any difference in designing jobs for transformation between talend ESB and talend Data Integration?
Is there any possibility to use talend open studio as a web plugin?

Re: Conversion of file types dynamically using talend

Nadz-Talend — Wed, 31 Mar 2021 04:11:23 GMT

@Xiaodi Shi

Could you please tell how can I expose a talend job as a service.

talend ESB is only showing standalone job as the build type.

Other question is Is there any possibility to use talend open studio as a web plugin?

Highly appreciate your response regarding this.

Re: Conversion of file types dynamically using talend

gjeremy1617088143 — Wed, 31 Mar 2021 07:10:12 GMT

Hi Nadz, if you use a ESB component like tResRequest to build a Restfull service, you can build it in a Bundle osgi instead of a Job standalone and you can deploy it on a Talend runtime to expose your job as a service.

Re: Conversion of file types dynamically using talend

Anonymous — Wed, 31 Mar 2021 07:23:08 GMT

Hello,

The Axis WebService (WAR) and Axis WebService (ZIP) build job types have been deprecated since V 6.5.1.

You can not define schemas at run time. The schemas must be defined during design, not at run time.

Note: If you are using Talend Enterprise software such as Talend Data Integration, you can define a dynamic column to map different schemas. For more information, refer to How to process changing data structure?.

For your last question, what's your job requirement? Could you please give us more description about web plugin?

Best regards

Sabrina

Best regards

Sabrina

Re: Conversion of file types dynamically using talend

Nadz-Talend — Wed, 31 Mar 2021 07:50:43 GMT

Ok Thanks.

I want to integrate talend open source tool with our web deployment.

Then, our users can create their own jobs when they need.

So, is talend open source tool exposed as a web plugin

Re: Conversion of file types dynamically using talend

Nadz-Talend — Wed, 31 Mar 2021 07:51:24 GMT

Ok Thanks, I'll try this

Re: Conversion of file types dynamically using talend

Nadz-Talend — Wed, 31 Mar 2021 10:06:03 GMT

@guenneguez jeremy If I explain my requirement,

Users of the our systems send the requests.

Some times we need to transform the request contents Ex: Json->Xml or XML->Json or any other transformation

What I am trying to do is creating a talend job which is exposed as a rest service and our system calls to that rest service when we need to do data transformation.

can I achieve this type of solution using talend open studio.

Re: Conversion of file types dynamically using talend

Nadz-Talend — Wed, 31 Mar 2021 10:06:43 GMT

@Xiaodi Shi If I explain my requirement,

Users of the our systems send the requests.

Some times we need to transform the request contents Ex: Json->Xml or XML->Json or any other transformation

What I am trying to do is creating a talend job which is exposed as a rest service and our system calls to that rest service when we need to do data transformation.

can I achieve this type of solution using talend open studio.

Re: Conversion of file types dynamically using talend

gjeremy1617088143 — Wed, 31 Mar 2021 12:13:49 GMT

Yes you have to configure a Runtime where you'll deploy the bundle osgi and your job will act like as a Rest service if you use Rest component inside. Check talend documentation about runtime and rest component : trestclient , trestrequest and trestresponse(you'll find them in the ESB related component in the palette).

trestclient : to send rest request

tresrequest : to catch rest request

trestresponse : to throw back a response to the request