topic Re: When to use tAggregateRow and when to use tSortRow + tAggregateSortedRow in Talend Studio

When to use tAggregateRow and when to use tSortRow + tAggregateSortedRow

shameer1 — Sat, 16 Nov 2024 06:01:00 GMT

I am new to talend. Can anybody let me know when to use tAggregateRow and when to use tSortRow ->tAggregateSortedRow as both will give the same output.

Re: When to use tAggregateRow and when to use tSortRow + tAggregateSortedRow

Anonymous — Wed, 24 Apr 2019 09:06:43 GMT

Hi,

Please refer below post where it is explained with an example.

https://community.talend.com/t5/Design-and-Development/resolved-taggregaterow-vs-taggregatesortedrow-vs-tuniqrow/td-p/111374

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: When to use tAggregateRow and when to use tSortRow + tAggregateSortedRow

Anonymous — Wed, 24 Apr 2019 09:09:17 GMT

Hi,

tAggregateSortedRow aggregates the sorted input data for output column based on a set of operations.

tAggregateRow receives a flow and aggregates it based on one or more columns.

https://help.talend.com/reader/KxVIhxtXBBFymmkkWJ~O4Q/VVQYE5AV~OFaAnSfC13t2g

https://help.talend.com/reader/KxVIhxtXBBFymmkkWJ~O4Q/i_YvOl2oUaVpW1UTnJao_g

So the first one will avoid the sorting part since the assumption is that incoming data is already sorted. So for sorted data, tAggregateSortedRow will give better performance.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: When to use tAggregateRow and when to use tSortRow + tAggregateSortedRow

shameer1 — Wed, 24 Apr 2019 09:51:58 GMT

Thanks Nikhil for the reply. But if the source data is not sorted then which one of below two will give better performance.

1:-tAggregrateRow

2:- tSortRow ->tAggregateSortedRow

Or both of them will give the same performance

Re: When to use tAggregateRow and when to use tSortRow + tAggregateSortedRow

Anonymous — Wed, 24 Apr 2019 10:01:38 GMT

Hi Shameer,

It will be more or less same performance since you have to same actions (either within one component or through two components).

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: When to use tAggregateRow and when to use tSortRow + tAggregateSortedRow

David_Beaty — Wed, 24 Apr 2019 16:53:06 GMT

Hi,

The 2 options you suggest have one major functional difference - if your incoming data set you're try to aggregate is large then using tSortRow & tAggregatedSortedRow is the only way to go. tAggregateRow has to maintain the data set in memory, so will have issues as the size of the data set increases. Use the sort on disk functionality in the tSortRow and you'll be fine.

Re: When to use tAggregateRow and when to use tSortRow + tAggregateSortedRow

AnnaSchmd — Wed, 11 Oct 2023 09:59:52 GMT

Hi David,

Does tAggregateRow make a implicit sorting in memory? And then keeps tAggregateRow those sorted rows in memory?