topic Re: Issues in handling data transfer from HDFS to Azure BLOB (and SQL DW SP Execution) in Talend Studio

Issues in handling data transfer from HDFS to Azure BLOB (and SQL DW SP Execution)

Anonymous — Sat, 16 Nov 2024 09:18:59 GMT

Hi,

We use Talend component to transfer data from HDFS location to Azure BLOB and then we run SP in SQLDW using the Talend component.
But,While running the end-to-end flow we found that when there is an issue/failure in Stored Procedure (SQLDW) the job is not returning any error details, Its continuing further as if the SP completed fine.
Because of this the Job completes even though there is an Error in Stored Procedure execution in SQLDW.

We run the HDFS to Azure BLOB transfer Job using tRunJob component. Could any one provide any suggestions to handle this issue ?

Thanks,

Sakthi

Re: Issues in handling data transfer from HDFS to Azure BLOB (and SQL DW SP Execution)

Anonymous — Sat, 09 Sep 2017 12:10:29 GMT

In which component do you call the SP? Are you checking the return code of the component calling the SP? Are the components and the tRunJob "Die on Error" option set?

Please post screenshots of jobs and component settings.

Re: Issues in handling data transfer from HDFS to Azure BLOB (and SQL DW SP Execution)

Anonymous — Mon, 11 Sep 2017 11:36:23 GMT

Hi All,

We manged to resolve the issue. Yes, Die on Error set already.

Now, we made changes at SP to throw different error, previously SP catches that and throws divide by zero error. It seems talend job couldnt get the divide by zero error. Now, it is fine and able to catch the SP failure.

Thanks

Re: Issues in handling data transfer from HDFS to Azure BLOB (and SQL DW SP Execution)

Anonymous — Mon, 05 Aug 2019 18:58:32 GMT

Hello, @sakthi16 . It's been a while since this post was answered for the last time, but I'm experiencing an issue while trying to execute an SP from Talend and I wish I could get some help from your end: could you tell me in which component do you call the SP?

Better yet, would please provide a sample JOB for connecting to an SQL DW instance, retrieving system date and call a SP passing the retrieved date as a parameter? It would really help me. I'm using Talend Data Fabric 6.5.1.