Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
gcjp
Contributor
Contributor

TLogCatcher_1 -> tMap -> tDBOutput performance issues

Hello,

We are using AWS Redshift. We have a shared etl_execution_log_history table to which I log to from several jobs.

The job inserts whenever a tWarn is run.

This means we are logging around 700 rows in a 30 minute period. The tDBOutput is logging only 1 record at a time, which is causing the load to take considerably longer than expected, as Redshift does not handle single inserts very well.

We have tried using the Extended Insert option but this doesn't seem to work as I can still see single rows being inserted, even after this option has been checked on our logging.

Please would someone assist with some suggestion as to how we can avoid this single row insert issue?

Thanks

1 Reply
Anonymous
Not applicable

Hello,

Could you please post your current job design screenshots here which will be helpful for us to address your issue quickly.

Best regards

Sabrina