Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I designed a job where I was using tdbrow to clear a snowflake stream once the pipeline runs. This component was working perfectly until today where I started getting an error.
To find the root cause of error, I created a simplified job to find the issue but am still getting the same error. Could you please have a look and advise on the same.
SNOWFLAKE TABLE
CREATE or replace TABLE TEST(
ID NUMBER IDENTITY(1,1),
AS_AT_DATE DATE
);
SNOWFLAKE STREAM ON THE TABLE
CREATE OR REPLACE STREAM "STRM_TEST"
ON
TABLE "DEV_DB"."RAW_SCH"."TEST";
INSERT STATEMENT IN THE TABLE
INSERT INTO TEST
values
(1,'2022-11-15')
ERROR
Exception in component tDBRow_1 (test1d)
org.talend.components.api.exception.ComponentException: UNEXPECTED_EXCEPTION
at org.talend.components.common.avro.JDBCAvroRegistry$6.convertToAvro(JDBCAvroRegistry.java:372)
at org.talend.components.common.avro.JDBCAvroRegistry$6.convertToAvro(JDBCAvroRegistry.java:362)
at org.talend.components.common.avro.JDBCResultSetIndexedRecordConverter$ResultSetIndexedRecord.<init>(JDBCResultSetIndexedRecordConverter.java:104)
at org.talend.components.common.avro.JDBCResultSetIndexedRecordConverter.convertToAvro(JDBCResultSetIndexedRecordConverter.java:82)
at org.talend.components.snowflake.runtime.SnowflakeRowReader.advance(SnowflakeRowReader.java:142)
at org.talend.components.snowflake.runtime.SnowflakeRowReader.start(SnowflakeRowReader.java:115)
at org.talend.codegen.flowvariables.runtime.FlowVariablesReader.start(FlowVariablesReader.java:73)
at webpas_dev.test1d_0_1.test1d.tDBRow_1Process(test1d.java:1031)
at webpas_dev.test1d_0_1.test1d.runJobInTOS(test1d.java:2336)
at webpas_dev.test1d_0_1.test1d.main(test1d.java:2022)
Caused by: net.snowflake.client.jdbc.SnowflakeSQLException: Cannot convert value in the driver from type:12 to type:big decimal, value=Table RESET_TBL successfully created..
at net.snowflake.client.jdbc.SnowflakeResultSetV1.getBigDecimal(SnowflakeResultSetV1.java:261)
at org.talend.components.common.avro.JDBCAvroRegistry$6.convertToAvro(JDBCAvroRegistry.java:370)
... 9 more
[FATAL] 18:55:16 webpas_dev.test1d_0_1.test1d- tDBRow_1 UNEXPECTED_EXCEPTION
hi Sabrina,
yes, you are correct. Clicking on guess schema worked.
thanks
Hello,
It seems you are adding schema manually which might fail with exception.
Could you please clarify what talend build version and patch you are using?
You'd better use guess schema which has a hiding property "logic Type".
Could you please also try to alter the data type in the input field definition schema to big decimal to see if it is working?
Best regards
Sabrina
hi Sabrina,
yes, you are correct. Clicking on guess schema worked.
thanks
Hello,
Great it works and feel free to let us know if there is any further help we can give.
Best regards
Sabrina