Out of memory with taggregaterow

[_AnonymousUser]

Hello,
I have an issue with the component taggregaterow.
It takes too much memrory, and i would like to know if you have a tips about it.
I import a big file with 3 columns: Customer - Household
i need to check if i don't have a same Customer in different hosehold
For that i use the taggregaterow then tmap with filter (see attach files)
but that takes too much memory, and job is failed
any idea to reduce the memory used?
thanks a lot

[Anonymous]

Hi,
I think tMap is the component which consume too much memory.
See this KB article outOfMemory
Best regards
Sabrina

[_AnonymousUser]

Hello
thanks for your reply,
i don't have access to your article, same in using my talend Id
How could i replace tmap component?
In my job
import file -> aggregate row -> tmap -> outputfile
tmap make a filter,ow12.Count_household > 1,
and export all customer_id having more than 1 household
thank for your ideas

[Anonymous]

Hi,
The reference is on Talend Help Center and you are welcome to use your forum ID or register a new account freely. In addition, for a large set of data, try to store the data on disk instead of memory on tMap.
See my screenshot
Best regards
Sabrina

[_AnonymousUser]

Hi back,
i just tried, and it the same, i still use more than 1024Mo of memory, and the job failed
but in fact i think i have found, in replacing tmap by tuniqrow (using disk), i can chck if card is not use twice in different household
thanks a lot for your time

[Anonymous]

Hi StephMich,
You need to register to MyTalend (http://www.talend.com/user/register) to benefit from all Talend online resources, inclusing Talend Help Center (KB + full online documentaiton).
This registration is free of charge.
Elisa

[_AnonymousUser]

Hello Elisa,
I'm already register, but when i go to the forum, it tells i'm not register and i appear as Guest
My id is Stefanem
thanks for your help
About my issue, i resolved the Tmap problem, in replacing it by a tuniqrow.
But still have an issue with the taggregaterow to count the number of custmer_id per household and export it in sql table, it takes all the memory
If you have an idea?
thanks

[Anonymous]

Hi,
Perhaps Allocating more memory to the Talend Studio is a good option for your case.
Best regards
Sabrina