Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello there,
I'm trying to load some data, using Dynamic column type to synapse tables.
Tried both 'tAzureSynapseOutput' and 'tDBOutput' components and both are performing very slow INSERT only operations, doing around 4.2 rows/sec.
Also seeing an error saying that '
tAzureSynapseOutput' doesn't support 'Dynamic Type' but the documentation (
tAzureSynapseOutput Standard properties • Azure SQL Data Warehouse • Reader • Welcome to Talend Help...) says that it does support
"The dynamic schema feature can be used in the following modes:
Insert , Update, Insert or update , Update or insert , and Delete.".
Does it mean 'Dynamic' data type for the schema?
Thanks & Kind Regards
Hello,
tAzureSynapseOutput component doesn't support dynamic type
Best regards
Sabrina
Thanks for your reply.
I understand that it doesn't support Dynamic type, but from the documentation as quoted in my post, what does it mean when it says :
"The dynamic schema feature can be used in the following modes:
Insert , Update, Insert or update , Update or insert , and Delete.".
Hello,
Dynamic Schema is an advanced feature in Talend subscription products. It allows you to design Jobs without having to know the structure (names, types, and number of columns) of the data to be handled. You can find more information about this feature at How to process changing data structure?
However, not every component supports the dynamic schema feature.
Best regards
Sabrina
Thanks for your response, I understand the concept of Dynamic Schema with in Talend (been using since 3-4 years).
Currently trying to use the same in one of my projects (using the Subscription Products), how ever, unable to use the same feature with Synapse components as I mentioned above in my original post.
I understand you are saying that it doesn't support dynamic, but the documentation for 'tAzureSynapseOutput' says it does support it, can you confirm if the documentation is wrong?
https://help.talend.com/r/fE4RCKUei9Dgtwy6fHDVhg/zn_gfUge39FLoHuWwxzBRQ
Hello,
In the component reference, 'tAzureSynapseOutput' mainly says "Action on data" setting and a note that "The dynamic schema feature can be used in the following modes: Insert, Update, Insert or update, Update or insert, and Delete." with this setting.
It doesn't indicate this component tAzureSynapseOutput does support dynamic schema.
Best regards
Sabrina
Thanks for the response.
Sure thing.
"It doesn't indicate this component tAzureSynapseOutput does support dynamic schema."
I understand you are saying it doesn't indicate the support for Dynamic Schema.
"The dynamic schema feature can be used in the following modes: Insert, Update, Insert or update, Update or insert, and Delete."
What does the above statement actually mean, can you please explain, thanks.
Hello,
It should be a general note that "The dynamic schema feature can be used in the following modes: Insert, Update, Insert or update, Update or insert, and Delete." on the condition that you are using components that does support dynamic schema feature.
You could skip this section if the current component doesn't support for dynamic schema.
Feel free let us know if it is OK with you.
Best regards
Sabrina
Best regards
Sabrina
Thanks for clarifying 🙂
Kind Regards.
Hello,
Feel free to let us know if there is any further help we can give.
Best regards
Sabrina