Skip to main content
Announcements
Introducing Qlik Answers: A plug-and-play, Generative AI powered RAG solution. READ ALL ABOUT IT!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

slow talend

Hello,
I am using Talend BIg data.But i am facing problem now.Talend has become very slow now. I dont know why it has become like that.
Previously it was very fast.
I am trying to load 10000 rows but it taking 400seconds for that.
Could you please tell me what is the problem behind this???
Regards,
Vinuta
Labels (2)
14 Replies
Anonymous
Not applicable
Author

Hi,
Is it slow just for your specific job or the whole studio performance is worse than before?
Best regards
Sabrina
Anonymous
Not applicable
Author

Hello,
The studio performance is worse than before.
If I load the job it is coming as GC overhead limit exceeded.
Regards,
Vinuta
Anonymous
Not applicable
Author

hi all,
you haven't got enought memory  to do the Job.
GC overhead is about the fact that JVM spent to many time to his garbage collector.
It's due to too many java object created for the RAM available.
Increase memory or (better way) refactoring your job to optimize data management.
regards
laurent
Anonymous
Not applicable
Author

Hi,
can you please tell me how to do that??
Regards,
Vinuta
Anonymous
Not applicable
Author

Hello,
I have installed java environment 1.7.0_71 version for windows 8.1. Can i use this version for Talend Bigdata???
Vinuta
Anonymous
Not applicable
Author

hello,
I have a job that looks like:
tredshiftinput > tMap >> tmysqlOutput

My file has  million rows and I get to  loaded I get the error. What can I do differently to avoid this Java heap space error?
Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.listIterator(Unknown Source)
at java.util.AbstractList.listIterator(Unknown Source)
at java.util.AbstractSequentialList.iterator(Unknown Source)
at routines.system.RunStat.sendMessages(RunStat.java:261)
at routines.system.RunStat.run(RunStat.java:225)
at java.lang.Thread.run(Unknown Source)
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.lang.Class.getDeclaredFields0(Native Method)
at java.lang.Class.privateGetDeclaredFields(Unknown Source)
at java.lang.Class.getDeclaredField(Unknown Source)
at java.util.concurrent.atomic.AtomicReferenceFieldUpdater$AtomicReferenceFieldUpdaterImpl.<init>(Unknown Source)
at java.util.concurrent.atomic.AtomicReferenceFieldUpdater.newUpdater(Unknown Source)
at java.sql.SQLException.<clinit>(Unknown Source)
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1811)
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
disconnected
at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:510)
at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:372)
at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:252)
at project_1.r_m_refr_0_1.r_m_refr.tRedshiftInput_1Process(r_m_refr.java:1046)
at project_1.r_m_refr_0_1.r_m_refr.runJobInTOS(r_m_refr.java:1800)
at project_1.r_m_refr_0_1.r_m_refr.main(r_m_refr.java:1657)
Regards,
Vinuta
Anonymous
Not applicable
Author

Hi,

Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap space


Have you already checked KB articles:https://help.talend.com/pages/viewpage.action?pageId=190513217 and https://community.talend.com/t5/Migration-Configuration-and/OutOfMemory-Exception/ta-p/21669?content... ?

Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
I have installed java environment 1.7.0_71 version for windows 8.1. Can i use this version for Talend Bigdata???

Please check document about: TalendHelpCenter:Compatible Platforms
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi all,
I have checked these blogs. For windows 8.1 64 bit operating system oracle java 7 is supported.so, I have installes java 1.7.1_71 version.
But If I try to check the version and incresing memory in command prompt it is coming as java version 1.8 is required. I do not know whether 1.8 is compatible for Talend big data??
What should I do now??Can you please tell me??
Regards,
Vinuta