We are loading few tables from SAP to Snowflake using Talend jobs(Incremental and Full load). Quite recently, we are seeing some issues in the data that is being loaded on a schedule to Snowflake layer. It looks like that Talend is loading data from some different table to our target table in Snowflake. eg. If the target table is X and the source table in SAP is also X having 100 records, the job is loading data from Y table for few records let's say 20 and the rest 80 records are from the correct table.
Has anyone ever faced this issue and if yes then how did you resolve this? Happy to give any more info if required.
@Anshita Sinha , it sounds weird, I think you need to check if any other jobs or programs that load data into the same target table. If you are using tSnowflakesOutput component to load data, there is a global variable ((Integer)globalMap.get("tDBOutput_1_NB_SUCCESS")) which counts the total number of processed data, the global variables are helpful to debug this kind of issue.
