Hallo,
I have migrated some project from Talend Open Studio 5.6.1 to 6.1.0 - mostly with no problems. But the job generation seems to be very slow.
So I created some very simple jobs, a MainJob and 10 empty subjobs. The MainJob contains 10 tRunJob-Components that call the empty subjobs. Here a comparison of the job-generation:
Talend 5.6.1: < 1s
Talend 6.0.1: ~ 2.5s
Talend 6.1.0: ~ 5s
Then I migrated some "production" jobs to version 6.1.0. This are mostly normal etl-processes to build up dimension-tables for a DWH-database.
Job-Generation:
Talend 5.6.1: ~10s
Talend 6.1.0: ~51s
And this were quite "small" jobs. I have a bigger Job that needs about 4-5 Minutes to export on 5.6.1. After 15 Minutes I killed the export-process on 6.1.0.
Is there anything setting to speedup the job-generation? Any maven settings? Any parallelization for job generation?
Hey guys, only to state your system is slow does not help. Please post a short description of the systems.
Following information would be fine:
1. Which Code repository you use (Git/SVN) and which product you use here
2. If the Code repository does not run on the same server as the TAC please post the network latency (measured with ping starting from the TAC server)
3. Which operation system runt the TAC and the commandline
4. Does the command line runs on the same server as the TAC?
5. On Windows, are there any virus scanner running?
6. Which java version you use.
7. Please check in the TAC the view Commandline and post how long the single steps takes.
8. Do you use user components?
As suggested, description of the systems we are using -
1. Which Code repository you use (Git/SVN) and which product you use here? -- SubVersion svn, version 1.9.4 (r1740329)
2. If the Code repository does not run on the same server as the TAC please post the network latency (measured with ping starting from the TAC server)? -- Code repository and TAC both on the same server.
3. Which operation system runt the TAC and the commandline? -- CentOS release 6.7 (Final)
4. Does the command line runs on the same server as the TAC? -- CommandLine & TAC both on the same server.
5. On Windows, are there any virus scanner running? -- Not Applicable
6. Which java version you use. -- Java(TM) SE Runtime Environment (build 1.8.0_92-b14)
7. Please check in the TAC the view Commandline and post how long the single steps takes. Generating a job takes nearly 4-5 mins.
8. Do you use user components? -- No
Thanks & Regards
Ashok Karnam
Hi, I guess I have found the problem:
https://help.talend.com/search/all?query=Compatible+version+control+systems&content-lang=en According to this page SVN version 1.9.4 is not supported. I know similar problems in customer installation and we solved that only by switching back to SVN version 1.8.11
Do you have installed the SVN with the package management or do you use Collabnet Edge?
I usually use the Collabnet Edge server because of the nice web administration interface but also here, we cannot use the latest release because it contains SVN 1.9.x
We have saved an older version of this server for our self:
http://jan-lolling.de/talend/CollabNetSubversionEdge-4.0.13_linux-x86_64.tar.gz The installation guid from the recent release can be applied to this older version. Please do not do the suggested update within this server - you would run in the same issues.
This is not a SVN issue --- I am using TOS 6.2.1 with local projects and have just starting noticing the much slower build run times recently. I am running Java 8 on both my laptop and target (HP Itanium) server, with no virus scan or other significant processes in the background. Nothing has changed in my configuration recently except upgrading to latest TOS. I would say there has been an order of magnitude increase in both compile and run times.
I have similar problem with my Talend Studio. I don't connect to SVN due to slowness, and local projects take atleast 20 to 25 minutes to build and reach the execution path. This is very frustrating, I have 2 simple jobs with very few components. Please help me how to improve my talend studio performance.
According to this page SVN version 1.9.4 is not supported. I know similar problems in customer installation and we solved that only by switching back to SVN version 1.8.11
Hello!
I use
Talend Data Management Platform 6.2.1
svnserve, version 1.8.16
java 1.8
RHEL 7.2
When I start to generate job on Conductor >> Job Conductor tab I see "Generating" status and on monitoring >> commandline tab I see last command:
and it lasts like forever...
The job is very simple, it consists of Input >> tConvertType >> tMap >> Output and it is one of the first jobs created on this server.
Is there any ideas how can we fix it?
Thanks!
Client-Server connection is good.
Hi,
I have been facing the same problem with Talend Ver6.2.1. We are doing versioning on the GitHub And executing a simple job is taking as much as 15 minutes. It's totally unusable this way. We are using Talend Data Services and connecting remotely to TAC.
Any help would be greatly appreciated.
Hi Vaidas, Could you please indicate what's the build version you are using? Have you already reported a ticket about your issue to talend support portal? Best regards Sabrina
