topic Re: Talend Open Studio for ETL in Installing and Upgrading

Talend Open Studio for ETL

Anonymous — Sat, 16 Nov 2024 05:00:52 GMT

Hello everyone,,

Have anybody ever tried to use Talend Open Studio Data Integration as ETL tool?

The system I have is not really complicated (like 5+ Postgres OLTP DBs and 1 Greenplum DWH), but volume of data can be quite big, up to 1 billion records/per month/per 1 PG DB. Probably gonna update DWH with new data from OLTPs' overnight every day. Is Talend Open Studio gonna fit in the architecture? If not, or if you know any better solutions, or just have nay thoughts about that, please feel free to write.

Re: Talend Open Studio for ETL

vapukov — Mon, 12 Aug 2019 15:04:35 GMT

Hi Lincoln,

first of all - yes, Talend Open Studio is a ETL tool, and yes it very good 🙂

but when you asking about sizes, there are no simple answer, all depends form:

- what transformation you plan do run?

- what network bandwidth and latency?

- what source and target databases performance?

values which you mention is not small, so it must be proper architecture design and testing

regards, Vlad

Re: Talend Open Studio for ETL

Anonymous — Wed, 21 Aug 2019 16:07:14 GMT

Hi,

I have used Talend Open Studio to do a data migration, granted not large volumes but many different data source types into a cloud based application with complex transformations.

Talend is a Java code generator, when you build jobs to deploy Talend creates a zip file with Java Jar's along with shell and batch scripts to execute. So you can deploy the code to a server with plenty of processing power, disk space and IO.