Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi,
I have picked up Talend development(fairly new) for one of our use case and in the process of designing a job for data load from PostgreSQL to Snowflake.
Dev Tool - Version: 8.0.1 (Talend Data Fabric)
Error -
[FATAL] 14:12:32 ent_udm_cld.job_delta_postgres_common_env_0_1.Job_Delta_Postgres_Common_ENV- tDBOutput_2 Unrecognized type id_Object
java.lang.UnsupportedOperationException: Unrecognized type id_Object
at org.talend.codegen.enforcer.IncomingSchemaEnforcer.diToAvro(IncomingSchemaEnforcer.java:306) ~[talend-codegen-utils-0.31.0.jar:?]
at org.talend.codegen.enforcer.IncomingSchemaEnforcer.addDynamicField(IncomingSchemaEnforcer.java:173) ~[talend-codegen-utils-0.31.0.jar:?]
at ent_udm_cld.job_delta_postgres_common_env_0_1.Job_Delta_Postgres_Common_ENV.tDBInput_6Process(Job_Delta_Postgres_Common_ENV.java:6561) [classes/:?]
at ent_udm_cld.job_delta_postgres_common_env_0_1.Job_Delta_Postgres_Common_ENV.tFileInputDelimited_3Process(Job_Delta_Postgres_Common_ENV.java:5063) [classes/:?]
at ent_udm_cld.job_delta_postgres_common_env_0_1.Job_Delta_Postgres_Common_ENV$6.run(Job_Delta_Postgres_Common_ENV.java:3599) [classes/:?]
Logic - Am using Dynamic schema for 'tdbinput' component (PostgreSQL) with tmap before 'tdboutput' component(Snowflake). Coming up with the above exception.
Please suggest if there is any way to overcome this issue!
Hi @Manoj M
It seems there's a data type on your input postgresql table that Talend is not able to dynamically find a correspondent data type for snowflake.
In that case, perhaps you can customize Talend's data type mapping by doing the following:
File -> Edit Project properties -> General -> Metadata of TalendType
Then you might try editing the mapping_Snowflake.xml file.
Here's a similar post on the community that might help you:
https://community.talend.com/s/question/0D55b00008683PoCAI/error-on-tdboutput-using-dynamic-schema-when-there-is-a-varbinery-data-type?language=en_US
Hi @Anselmo Peixoto - Thanks for your response. I did went through one similar discussion on his forum but not able to edit the 'Metadata of Talend Type' file. Is it something that has to be done by Admins or can i do it in the developer tool?