topic Re: How Talend Insert a Lot of Rows in Talend Studio

How Talend Insert a Lot of Rows

Anonymous — Sat, 16 Nov 2024 04:02:47 GMT

Hello Community,

I hope you are having a nice day, I'm Inserting a nearly a 160 000 rows for a specific period, but i'm struggling with some not inserted data after the job is done. Please I want to know whether Talend discard a lot of data(10 000 rows to be exact) inserted in PostgreSQL if detects an exciting row within my new database.

I look forward to hearing from you guys as soon as possible.

Re: How Talend Insert a Lot of Rows

Raghuram_Puram — Fri, 22 Nov 2019 10:25:24 GMT

Hi @mrexeto ,

Please upload any screenshots of the job design.

Also try to capture the rejected records in tMap(if you're using one) and observe the pattern for the rejected records if it helps.

Regards,

Raghu

Re: How Talend Insert a Lot of Rows

Anonymous — Fri, 22 Nov 2019 10:44:33 GMT

Hello @rchinta,
Thank you for your quick reply, unfortunately I can't post any screen shots, I'm just asking whether this problem can occur while inserting or not ?

Re: How Talend Insert a Lot of Rows

Anonymous — Fri, 22 Nov 2019 16:03:38 GMT

Hi,

I guess commit is not happening properly. Could you please add auto commit in tPostgreSQLConnection component?

If you want commit and an rollback in controlled manner, please add a tPostgresSQLCommit component for same connection after tDBOutput component. Connect both components using On SubJob Ok trigger.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved