tHashOutput and tHashInput Capacity

[Anonymous]

Hi Team,

I am trying to load and read 30 million records in tHashxx components. The records will look like (key, value1, value2) . I need to reload and read  tHashxx for every iteration till 30 iterations.

I am able to read till 280 thousands using tMap but not more than that. Please suggest on how to achieve this?

Attached is the screenshot of the job flow for your reference. 

tHashOutput3 and tHashInput2 will have the 30million records.

Note : as of now I am limiting the data coming from the tDB2Input.

[Anonymous]

Hi,
Did you get any outofmemory or heap space error? or just job is hanging ?
What's the error you are getting when read thousands data by using tMap?
Best regards
Sabrina

[Anonymous]

Hi, am getting out of memory issue. My RAM is 16 gig. 

[Anonymous]

Hi,
You can raise your JVM 

Go to the job execution panel



Thanks,

Amine

[Anonymous]

Hi, I have raised the JVM values, limited the number of columns read but still am unable to achieve.

[Anonymous]

Hi,
Could you please post the error message also your JVM settings!
thanks