Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
humapathy
Contributor
Contributor

Using dynamic schema throws error in tSnowflakeInput component

Hi I have a very simple workflow to source data from snowflake and store it out as flat file.  When I use dynamic as the schema type, the job fails with following error code if I explicitly specify the column names in my query.  However, when i just specify 'Select *' it just runs fine even having 'dynamic' as the datatype.  

 

INFO: sql command to get primary key metadata: show /* JDBC0683p000009MACJ.pngatabaseMetaData.getPrimaryKeys() */ primary keys in table "OPENFIT"."RECURLY_STITCH_PROD"."RECURLY_SUBSCRIPTIONS"

 

[FATAL]: bi_data_lake.openfit_snowflake_simple_flow_0_1.Openfit_Snowflake_Simple_Flow - tSnowflakeInput_2 2

java.lang.ArrayIndexOutOfBoundsException: 2

at org.talend.components.common.avro.JDBCResultSetIndexedRecordConverter$ResultSetIndexedRecord.get(JDBCResultSetIndexedRecordConverter.java:111)

at org.talend.daikon.di.DiOutgoingDynamicSchemaEnforcer.getDynamicValues(DiOutgoingDynamicSchemaEnforcer.java:146)

at org.talend.daikon.di.DiOutgoingDynamicSchemaEnforcer.get(DiOutgoingDynamicSchemaEnforcer.java:105)

at bi_data_lake.openfit_snowflake_simple_flow_0_1.Openfit_Snowflake_Simple_Flow.tSnowflakeInput_2Process(Openfit_Snowflake_Simple_Flow.java:1105)

at bi_data_lake.openfit_snowflake_simple_flow_0_1.Openfit_Snowflake_Simple_Flow.tSnowflakeConnection_2Process(Openfit_Snowflake_Simple_Flow.java:489)

at bi_data_lake.openfit_snowflake_simple_flow_0_1.Openfit_Snowflake_Simple_Flow.runJobInTOS(Openfit_Snowflake_Simple_Flow.java:1644)

at bi_data_lake.openfit_snowflake_simple_flow_0_1.Openfit_Snowflake_Simple_Flow.main(Openfit_Snowflake_Simple_Flow.java:1475)

[statistics] disconnected

Exception in component tSnowflakeInput_2 (Openfit_Snowflake_Simple_Flow)

java.lang.ArrayIndexOutOfBoundsException: 2

at org.talend.components.common.avro.JDBCResultSetIndexedRecordConverter$ResultSetIndexedRecord.get(JDBCResultSetIndexedRecordConverter.java:111)

at org.talend.daikon.di.DiOutgoingDynamicSchemaEnforcer.getDynamicValues(DiOutgoingDynamicSchemaEnforcer.java:146)

at org.talend.daikon.di.DiOutgoingDynamicSchemaEnforcer.get(DiOutgoingDynamicSchemaEnforcer.java:105)

at bi_data_lake.openfit_snowflake_simple_flow_0_1.Openfit_Snowflake_Simple_Flow.tSnowflakeInput_2Process(Openfit_Snowflake_Simple_Flow.java:1105)

at bi_data_lake.openfit_snowflake_simple_flow_0_1.Openfit_Snowflake_Simple_Flow.tSnowflakeConnection_2Process(Openfit_Snowflake_Simple_Flow.java:489)

at bi_data_lake.openfit_snowflake_simple_flow_0_1.Openfit_Snowflake_Simple_Flow.runJobInTOS(Openfit_Snowflake_Simple_Flow.java:1644)

at bi_data_lake.openfit_snowflake_simple_flow_0_1.Openfit_Snowflake_Simple_Flow.main(Openfit_Snowflake_Simple_Flow.java:1475)

Job Openfit_Snowflake_Simple_Flow ended at 11:24 06/02/2019. [exit code=1]

 

0683p000009M2yG.png

Labels (6)
2 Replies
Anonymous
Not applicable

Hello,

Could you please clarify in which talend version/edition you are?

Best regards

Sabrina

humapathy
Contributor
Contributor
Author

We are usin Talend Studio 6.4. Please note that this behavior is not consistent for all tables. For a different table in the same Schema, it works fine with dynamic Schema and select clause with explicit column names.