I have a job which performs and update or insert on a table but it currently takes too long to run. In the past I've replaced a single dboutput component with 2 and used a map inner join to split out the inserts and updates so I can more efficiently deal with the data.
In this particular job I'm not getting the results I'm expecting. The inner join seems to be rejecting too many rows and I'm getting errors about inserting duplicate keys from the dbOutput that is configured for inserts.
I've confirmed in the database that the majority of the data that is being rejected by the inner join exists in the database.
Can anyone help me in diagnosing what is wrong with the job or what I've missed?
@AB - Congrats for identifying the root cause of the issue.
Could you please mark your last post as the answer to this topic (which contains the explanation of your solution)? This will help to enrich the content of our Talend community.
