Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
During data mapping from tHiveInput to tDBOutput the loading becomes slow then stops, I have a hive table containing 900,000 rows, I execute, the loading stops at 150,000 rows, so I changed the parameters of JVM to increase the performance Xms256 to Xms512 and Xmx1024 to Xmx2048, I execute other times but stops at 300,000
how to fix this problem
Hello @not specified not specified,
So looking at the scenario, it seems like your job still need more JVM memory. You may want to try incrementally increasing the JVM and see at what memory the job finishes normally. Also, you can try using Memory Run feature in studio to understand the execution of job:
https://help.talend.com/r/en-US/7.3/studio-user-guide-data-fabric/showing-jvm-resource-usage-during-job-or-route-execution
Hope this helps.