Talend/Snowflake issues with autocommit

[LMelcher]

Hi there,

I'm new to using Talend Studio Version 8.0.1, and I might have missed some things since I'm still learning.

I'm working on a project where I need to read data from a CSV file and map it to a Snowflake database table while using transactions.

At first, I tried using Talend's native Snowflake components, like tSnowflakeInput, tSnowflakeOutput, tSnowflakeConnection, tSnowflakeCommit, and tSnowflakeRollback. Unfortunately, every tSnowflakeOutput committed, even though I tried to turn off auto-commit in different ways, including deactivating it inside Snowflake. I made sure that I matched all components with the correct database connection, too.

To fix this problem, I switched to using JDBC, and everything is working as expected.

Do you have any ideas about what could have caused the issue with the native Snowflake components?

Check out the attached image to see the job working with JDBC.

Thanks!

[Anonymous]

Hello,

Starting from V 7.3.1, we have added new option "commit every" on tSnowflakeConnection, tSnowflakeCommit and tSnowflakeRollBack. You are able to to control transaction logic during reading/writing data to SnowFlake with the help of tSnowflakeCommit, tSnowflakeRollBack components.

Best regards

Sabrina

[LMelcher]

Hello,

thank you for your answer.

Could you please tell me, if the job design I provided should work with tSnowflake components?

Thank you.

[Anonymous]

Hello,

The job design should work with tsnowflakexxx components and tSnowflakeconnection has the option to deselect 'AutoCommit'.

Did you see the log in the snowflake History that it does auto commit to true and therefore, Rollback is not working?

Please try to check "Die on error" option to make it fail to see if there is any error message printed on console?

Best regards

Sabrina

[LMelcher]

Hello,

'AutoCommit' was deselected.

In the snowflake History I could still see a commit coming from Talend.

"Die on error" does not invoke any error messages.

Regards,

Lasse

[Anonymous]

Hello,

Is there any message in your CsvMverror?

"Rollback message: "+((String)globalMap.get("tDBRollback_1_ERROR_MESSAGE"))) 

Best regards

Sabrina