[resolved] java.lang.OutOfMemoryError: Java heap space

[Anonymous]

Hi All.
One Table have 4million rows.
I am Exporting 4million rows to csv file i am getting below error.
"Exception in thread "main" java.lang.OutOfMemoryError: Java heap space"
How to increase Java heap space?
Thanks
kumar.talend

[Jcs19]

Hi,
I am using two source files (delimited .dat files ). Both the files have 2 million records . I am joining these files in tmap and sending the output to a flat file (.dat). but its giving me Java heap memory error after reading 1 lakh records.
I have tried all the options written in above comments ( tried increasing Xmx parameter, Store temp data =Yes), but still I am getting the error.
Can someone please suggest what should I Try.

You need to increase it again, or you just need more memory.
Check the task manager to see if you're RAM is full when you're running the job

[Anonymous]

Hi ummed,
Did you increase Xmx parameter in the Run 'Advanced Settings'which works for your current job not Talend Studio?
What's your OS and RAM?
Best regards
Sabrina

[Anonymous]

Hi Sabrina,
Thanks for your reply. Yes, I increased the Xmx parameter value in Run   'Advanced Settings' as well. I tried all the combinations (increasing it at Talend studio level, increasing at Run job level and increasing for both of them). My OS is windows 7 and RAM is 4 GB.
When I put this job on client server, it is running fine.
Q-1)  so I guess its RAM issue on my system, Please confirm .
But another problem is, its taking 15 minutes to join 2 flat files (3 million records in each file ) and write to target flat file.
Q-2) is there any way I can increase the performance?
One way I can think of is Parallelism , but it seems in Talend open studio we do not have option to do Parallelism ( its available in Talend Data integration ).
So before moving to Talend Data Integration, I want to do testing if how much it will improve the performance.
Q-3) Can you please let me know if there is any option to download trail version of Talend Data Integration so that I can do initial testing before moving to Talend Data Integration.

[Anonymous]

Hi ummed,
As suggested, you need to optimaize the job deisgn and allocate more memory to the job execution.
Would you mind showing us your current job design screenshots?

Q-3) Can you please let me know if there is any option to download trail version of Talend Data Integration so that I can do initial testing before moving to Talend Data Integration.

You can download a free trial Talend Enterprise for Data Integration product from Talend Official Website: https://www.talend.com/enterprise-data-integration
Best regards
Sabrina

[Anonymous]

Hi,
I have installed Talend Enterprise edition from above link. And i got below icons on my computer in talend folder but all of them are only services. How do i start the  Talend to build any jobs( i don't see any icon for job developer) ? is there something missing in the installation?
Please suggest.

[Anonymous]

attaching the screenshot

[Anonymous]

I am not able to attach the screenshot. but in my windows- all programs one folder "Talend 5.6.2 " is created and below is the structure of this folder:
Talend 5.6.2 ( this is main folder )
 
 Talend Administration Center ( this is 1st option in main folder)
 Manager Services     ( this is sub folder which has below options)
      Start Remote Job Server
      Start Talend Administration Center
      Start Talend Command Line Service
      Start Remote Job Server
      Start Talend Administration Center
      Start Talend Command Line
      
How can i start building the job from here as the only options i see are to start the services.

[Anonymous]

Hi,
I was able to find the window where to create job. But i have another questions now:
1. how to login into Talend Enterprise Data Integration Administration Center ( i don't remember setting up any id/password for this while installing )

2. When i right click on my toracleinput , i don't see option for set parallelism  . Can you please let me know why.  I was trying to do as explained at below link.



Thanks,
Ummed

[Anonymous]

Hi ummed,
Here is a response in your another topic https://www.talendforge.org/forum/viewtopic.php?id=45006.
Best regards
Sabrina

[Anonymous]

I upgraded the Talend from 5.5.1 to 6.1.1 recently. I am getting this "java.lang.Exception: java.lang.OutOfMemoryError: Java heap space" when I build my job in Talend 6.1.1 Studio. This never happened in 5.5.1 Studio. This is the setting for my 6.1.1 Studio.
-vmargs
-Xms1024m
-Xmx2048m
-XX:MaxPermSize=512m
-Dfile.encoding=UTF-8