Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Embedded Talend?

Is it possible to use Talend embedded inside another application (similar to how CloverETL allows embedded mode)? The goal would be to programmatically generate an ETL pipeline and then have Talend run it.
Thanks!
Labels (2)
13 Replies
Anonymous
Not applicable
Author

Hello
tSystem component executes one or more command as you do on CMD. This component can typically used for companies which already implemented other application that they integrate into their processing flow through Talend.
Best regards
shong
Anonymous
Not applicable
Author

Instead of having Talend call another process using tSystem, can the reverse be done? Can I have my system configure and run a Talend pipeline - so Talend is embedded into my application?
Thanks!
fyk_cz
Contributor
Contributor

You can export your job as a Java POJO package (or as an Axis WebService). I'm using this packages for my projects (in java) everyday.
Anonymous
Not applicable
Author

Exporting as a Java POJO sounds great for running the job, but doesn't that still require the UI to output the POJO?
Is there a way to have Talend programmatically generate the ETL pipeline, and then generate the runtime Java POJO? For example, suppose I know I have two sources of data and want to join them and output them to a file. Does Talend have an API for creating a new ETL pipeline, configuring the two sources and sink, adding the join, and exporting the pipeline - all without requiring user interaction?
Thanks!
Anonymous
Not applicable
Author

Hi,
Talend Export Job Scripts feature allows you to deploy and execute a job on any server, regardless
Talend Open Studio.
The job scripts export adds to an archive all the files required to execute the job, including the .bat and
.sh along with the possible context-parameter files or relative files.
The export type include also Java POJO, Axis Webservice (WAR) and Axis,Webservice (Zip).
Best look
Anonymous
Not applicable
Author

Perhaps my question is not clear. I understand that I can export an ETL pipeline I've created in the UI and then run that job embedded in another Java application.
My question:
Can I create a new job, configure it, and export it using *only* the Talend API, not using the Talend UI at all?
fyk_cz
Contributor
Contributor

Is there a way to have Talend programmatically generate the ETL pipeline, and then generate the runtime Java POJO? For example, suppose I know I have two sources of data and want to join them and output them to a file. Does Talend have an API for creating a new ETL pipeline, configuring the two sources and sink, adding the join, and exporting the pipeline - all without requiring user interaction?

I mean you need own task generator, for recompute all in the space 0683p000009MACn.png ...
Create a job for a new data transfer, export the job to POJO package and embede generated package to your own app. If you need transfer something from somewhere to someplace, you need "somegenerator". But I mean, with well configured and prepared Talend job, you can use only one package and "something" define via properties and contexts.
Anonymous
Not applicable
Author

mikem2005, did you ever get your question answered? I'm looking for the same thing. As far as I can tell the only way to create a new job is through the TalenD UI.
There doesn't seem to be an API exposed for other applications to create jobs.
Anonymous
Not applicable
Author

Looks like Pentaho kettle uses an API. May please try to find out .
Please let us know in case it is useful.
Thanks and Regards,
Pravu Mishra.