topic Re: Delimited file output in Talend Studio

Delimited file output

Soumya_M — Fri, 15 Nov 2024 21:38:39 GMT

Hello, so I've created a talend job where I insert data to a table on a daily basis [tDBRow] and execute select statement [tPostgresqlInput] on the data to get output in the form of .csv file [tFileDelimited]. It looks like this -

If i run individually all jobs are executed within few seconds, but - if i put it in sequence and run the job is taking more time [like half an hour],

there isn't any issue with the components. They have simple insert and select statements. I need your help as to why it is taking half an hour to run the whole job [where as individually few seconds]. Also, after the second OnSubjobOk is where it is taking majority of time. Can anyone help me regarding this ?

Re: Delimited file output

Anonymous — Tue, 27 Jun 2023 03:58:42 GMT

Hello,

We need a little bit more information to address your performance issue.

- How many rows are treated by your job ?

- Your databases are local or on network ?

Before launching the job, you could check the "Statistics" box to see where the data-flow is slow( We are suspecting dataflow is slowing at the entry point-->DB input).

Best regards

Sabrina

Re: Delimited file output

Soumya_M — Tue, 27 Jun 2023 04:52:49 GMT

query runs on a table of around 500k odd rows and db is on local machine. Okay, Statistics box as in tStatCatcher Statistics ?