topic Re: Issue with tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec in Talend Studio

Issue with tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec

vbadri — Sat, 16 Nov 2024 00:09:24 GMT

Hello there,

I'm trying to read data from a spark table (via jdbc connector) writing to a synapse table, using dynamic data/column type, since I need to do the same for multiple tables using the same job dynamically through context variables. Its all INSERT only operation since the tDBOutput components are really slow as I mentioned in my other post (https://community.talend.com/s/question/0D55b000065cA4TCAU/issue-with-tazuresynapseoutput-and-tdboutput), I had to try these bulk components as I have used bulk components successfully for Vertica DB in the past.

tDBOutputBulk

tDBBulkExec

tDBOutputBulkExec

Does the above components support dynamic schema/column type?

When I tried with Dynamic schema/column type, job throwing a ERROR notification that it doesn't support Dynamic, still generates the file with records but with ' - ' as delimiter no matter what ever I provide in the 'Field Separator' (I gave "," as delimiter originally). Then the '

tDBBulkExec' throws the below error.

com.microsoft.sqlserver.jdbc.SQLServerException: Parse error at line: 1, column: 1: Incorrect syntax near 'BULK'.

I've tried again by providing the complete schema respective to the table for the query output (instead of Dynamic schema/column type), it is still failing the same error.

com.microsoft.sqlserver.jdbc.SQLServerException: Parse error at line: 1, column: 1: Incorrect syntax near 'BULK'.

I don't understand what that error means, Am I doing something wrong or the components are not working as expected?

Please take a look and respond.

Thanks & Kind Regards

Re: Issue with tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec

Anonymous — Mon, 17 May 2021 11:03:28 GMT

Hello,

Could you please check your "Code" tab in your job to see if there will be your compile error highlighted in red line?

Best regards

Sabrina

Re: Issue with tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec

vbadri — Tue, 18 May 2021 15:22:41 GMT

Thanks for your reply.

I have checked for any indication in the code tab, but there is no indication or any compilation errors either. As I mentioned before, job did run but doesn't gave me any indication where/why the error is occurring.

Re: Issue with tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec

Anonymous — Thu, 20 May 2021 03:47:44 GMT

Hello,

Is this issue caused by "dynamic schema" setting? Which is not supported in tAzureSynapseOutput.

We have replied to your another topic about: https://community.talend.com/s/question/0D55b000065cA4TCAU/issue-with-tazuresynapseoutput-and-tdboutput

Could you please check it?

Best regards

Sabrina

Re: Issue with tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec

vbadri — Thu, 20 May 2021 08:25:17 GMT

Thanks for your response.

No.

As I mentioned in my original post, the issue is about tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec components, it is not about 'tAzureSynapseOutput', that is the reason I've created a separate topic as these are independent issues.

BTW I tried to use 'tAzureSynapseOutput' with dynamic schema and it didn't worked, so, I had to switch to 'tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec' components, which also didn't work due to the above mentioned issues in the original post.

Please don't get confused, this issue is only about "com.microsoft.sqlserver.jdbc.SQLServerException: Parse error at line: 1, column: 1: Incorrect syntax near 'BULK'." error while using the 'tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec' component sets.

Hope it make sense.

Kind Regards