topic tWaitForSqlData on Snowflake connection in Data Quality

tWaitForSqlData on Snowflake connection

mickg — Sat, 16 Nov 2024 01:51:05 GMT

I have a working Snowflake connection (if I omit tWaitForSqlData, tDBInput returns data from the table to be tested by tWaitForSqlData).

Yet when running the job, I get:

Starting job Monitor_SF_table at 22:29 20/07/2020.

[statistics] connecting to socket on port 3463

[statistics] connected

Exception in component tWaitForSqlData_1 (Monitor_SF_table)

java.lang.NullPointerException

at thehartford.monitor_sf_table_0_1.Monitor_SF_table.tWaitForSqlData_1Process(Monitor_SF_table.java:725)

at thehartford.monitor_sf_table_0_1.Monitor_SF_table.tDBConnection_1Process(Monitor_SF_table.java:519)

at thehartford.monitor_sf_table_0_1.Monitor_SF_table.runJobInTOS(Monitor_SF_table.java:1591)

at thehartford.monitor_sf_table_0_1.Monitor_SF_table.main(Monitor_SF_table.java:1440)

[statistics] disconnected

Job Monitor_SF_table ended at 22:29 20/07/2020. [Exit code = 1]

Thank you in advance.

Re: tWaitForSqlData on Snowflake connection

Anonymous — Tue, 21 Jul 2020 03:07:20 GMT

Hello,

From the error stack trace, it seems that there is a DB connection issue from your side. Are you able to retrieve data from your DB by using a simple job? Such as, tDBConnection-->tDBInput-->tLogRow

Best regards

Sabrina

Re: tWaitForSqlData on Snowflake connection

Anonymous — Tue, 21 Jul 2020 07:30:32 GMT

You need to select an existing DB connection on tWaitForSQLData, and make sure the DB connection is created before it is used.

Regards

Shong

Re: tWaitForSqlData on Snowflake connection

Anonymous — Wed, 29 Jul 2020 20:24:32 GMT

Hello,

I'm getting the same error

It's working when I tested it with other DBs, as well as testing just the job without the tWaitForSQLData component (with Snowflake components only).

Can you provide a screenshot of a working job for this use case? as well as screenshot of the tWaitForSQLData component tab?

Thanks,

Nadav

Re: tWaitForSqlData on Snowflake connection

Anonymous — Thu, 30 Jul 2020 02:47:34 GMT

@Nadav Malka

I have made a testing and reproduced the issue. I see you have created an issue on our bugtracker, I just paste it here for other users to watch it

https://jira.talendforge.org/browse/TDI-44643

Regards

Shong