TRecordMatching Java Heap Space & Settings

Anonymous — Fri, 31 May 2019 06:30:12 GMT

Hi,

I've got 2 tables where I want to match the ID Field (PK) and if any don't match, I want to insert them into another table.

I've got about 5 million records in one table and keep getting the Java Heap space error stopping the job.

I saw the post about this issue & added the '-XX:-UseGCOverhead' JVM argument to both source data components but it still happens.

Is there another way to overcome this?

I'm also unclear about the purpose & settings for the 'Blocking Selection' and the option to tick the Checkbox for 'Replace output column with Lookup column if matches or possible matches'.

I've read the Talend user notes but I find they are a bit general with the use of the components.

Can anyone assist here?

Thanks

Re: TRecordMatching Java Heap Space & Settings

Anonymous — Mon, 10 Jun 2019 04:40:08 GMT

Hello,

Ensure that the job has high enough memory in your studio and modify the -Xmx accordingly.

Are you using tMap component in your job design? Could you please post your job design screenshots on community?

Best regards

Sabrina

topic TRecordMatching Java Heap Space & Settings in Data Quality

TRecordMatching Java Heap Space & Settings

Re: TRecordMatching Java Heap Space & Settings