topic Re: Snowflake - empty strings converted to NULL in Talend Studio

Snowflake - empty strings converted to NULL

Rimvis — Tue, 05 Mar 2019 11:21:09 GMT

Hi,

I am using Talend to load data into Snowflake. Data is being passed using tSnowflakeOutput component.

If there are empty strings in the source data, I'm getting an error:

java.io.IOException: net.snowflake.client.loader.Loader$ConnectionError: 

State: INGEST_DATA, INSERT INTO ... SELECT * FROM ..., NULL result in a non-nullable column

at org.talend.components.snowflake.runtime.SnowflakeWriter.close

No nulls are allowed on source, destination, or anywhere on data pipeline

Looks like somehow empty strings are being converted to NULLS automatically.

Is there any way to prevent this?

I can't see any setting that would control this behavior.

Thanks,

Rimvis

Re: Snowflake - empty strings converted to NULL

Anonymous — Tue, 05 Mar 2019 11:26:09 GMT

Hi,

Could you please verify whether you have unchecked the below check box in tDBOutput(Snowflake)?

This should fix your issue.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Snowflake - empty strings converted to NULL

Rimvis — Tue, 05 Mar 2019 12:01:47 GMT

Hi Nikhil ,

I can't see this option anywhere. I am using Talend Open Studio 6.5.1 if that helps.

Re: Snowflake - empty strings converted to NULL

Anonymous — Tue, 05 Mar 2019 12:08:25 GMT

Hi,

The screen shot I had shared was for version 7.1 of Talend. It is having significant improvements for Snowflake both from additional functionalities and performance perspective.

If you are not in a position to upgrade to 7.1, my suggestion will be to try to verify whether you can add the data with single space and verify it is overcoming the null issue. Of course it is not a great option like the first one but still you can manage the overall flow.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂

Re: Snowflake - empty strings converted to NULL

Rimvis — Tue, 05 Mar 2019 15:18:46 GMT

Thanks Nikhil,

Upgrading to 7.1 is certainly worth considering.

Adding a space or any other character to make the string non-empty does help. But for now I simply changed target column to allow nulls and processing the data in later stages.

Thanks for your help,

Rimvis