Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello there,
I'm trying to read data from a spark table (via jdbc connector) writing to a synapse table, using dynamic data/column type, since I need to do the same for multiple tables using the same job dynamically through context variables. Its all INSERT only operation since the tDBOutput components are really slow as I mentioned in my other post (https://community.talend.com/s/question/0D55b000065cA4TCAU/issue-with-tazuresynapseoutput-and-tdbout...), I had to try these bulk components as I have used bulk components successfully for Vertica DB in the past.
tDBOutputBulk
tDBBulkExec
tDBOutputBulkExec
Does the above components support dynamic schema/column type?
When I tried with Dynamic schema/column type, job throwing a ERROR notification that it doesn't support Dynamic, still generates the file with records but with ' - ' as delimiter no matter what ever I provide in the 'Field Separator' (I gave "," as delimiter originally). Then the '
tDBBulkExec' throws the below error.
com.microsoft.sqlserver.jdbc.SQLServerException: Parse error at line: 1, column: 1: Incorrect syntax near 'BULK'.
I've tried again by providing the complete schema respective to the table for the query output (instead of Dynamic schema/column type), it is still failing the same error.
com.microsoft.sqlserver.jdbc.SQLServerException: Parse error at line: 1, column: 1: Incorrect syntax near 'BULK'.
I don't understand what that error means, Am I doing something wrong or the components are not working as expected?
Please take a look and respond.
Thanks & Kind Regards
Hello,
Could you please check your "Code" tab in your job to see if there will be your compile error highlighted in red line?
Best regards
Sabrina
Thanks for your reply.
I have checked for any indication in the code tab, but there is no indication or any compilation errors either. As I mentioned before, job did run but doesn't gave me any indication where/why the error is occurring.
Hello,
Is this issue caused by "dynamic schema" setting? Which is not supported in tAzureSynapseOutput.
We have replied to your another topic about: https://community.talend.com/s/question/0D55b000065cA4TCAU/issue-with-tazuresynapseoutput-and-tdbout...
Could you please check it?
Best regards
Sabrina
Thanks for your response.
No.
As I mentioned in my original post, the issue is about tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec components, it is not about 'tAzureSynapseOutput', that is the reason I've created a separate topic as these are independent issues.
BTW I tried to use 'tAzureSynapseOutput' with dynamic schema and it didn't worked, so, I had to switch to 'tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec' components, which also didn't work due to the above mentioned issues in the original post.
Please don't get confused, this issue is only about "com.microsoft.sqlserver.jdbc.SQLServerException: Parse error at line: 1, column: 1: Incorrect syntax near 'BULK'." error while using the 'tDBOutputBulk, tDBBulkExec & tDBOutputBulkExec' component sets.
Hope it make sense.
Kind Regards