topic Re: Performance Improvement in tmap or tjoin in Talend Studio

Performance Improvement in tmap or tjoin

mani1304 — Sat, 16 Nov 2024 05:20:56 GMT

Hi,

I have a doubt that if we sort before join in talend like in ab initio, it will increase performance or not ? In Ab Initio, data must be sorted before join(it gives 2 options in memory for smaller set of data and external join before join for large set of data), but in talend, I don't see sort is necessary before join, but I am thinking to involve join because data is heavy.

Re: Performance Improvement in tmap or tjoin

Anonymous — Tue, 09 Jul 2019 14:37:03 GMT

Hi,

I don't think sorting is necessary since it will try to join on all input values for the columns used for join. You can give it a try by adding a large data set and do some experiments in a sample job 🙂

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂