I have a doubt that if we sort before join in talend like in ab initio, it will increase performance or not ? In Ab Initio, data must be sorted before join(it gives 2 options in memory for smaller set of data and external join before join for large set of data), but in talend, I don't see sort is necessary before join, but I am thinking to involve join because data is heavy.
I don't think sorting is necessary since it will try to join on all input values for the columns used for join. You can give it a try by adding a large data set and do some experiments in a sample job 🙂
Warm Regards, Nikhil Thampi
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂
