How Talend Insert a Lot of Rows

[Anonymous]

Hello Community,

I hope you are having a nice day, I'm Inserting a nearly a 160 000 rows for a specific period, but i'm struggling with some not inserted data after the job is done. Please I want to know whether Talend discard a lot of data(10 000 rows to be exact) inserted in PostgreSQL if detects an exciting row within my new database. 

I look forward to hearing from you guys as soon as possible.

[Raghuram_Puram]

Hi @mrexeto ,

Please upload any screenshots of the job design.

Also try to capture the rejected records in tMap(if you're using one) and observe the pattern for the rejected records if it helps.

Regards,

Raghu

[Anonymous]

Hello @rchinta,
Thank you for your quick reply, unfortunately I can't post any screen shots, I'm just asking whether this problem can occur while inserting or not ?

[Anonymous]

Hi,

    I guess commit is not happening properly. Could you please add auto commit in tPostgreSQLConnection component?

If you want commit and an rollback in controlled manner, please add a tPostgresSQLCommit component for same connection after tDBOutput component. Connect both components using On SubJob Ok trigger.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved