topic Re: tSQLiteInput and terminated tSQLiteConnection in Talend Studio

tSQLiteInput and terminated tSQLiteConnection

Anonymous — Thu, 09 Nov 2017 15:35:45 GMT

Hello.

My tSQLiteInput uses an existing tSQLiteConnection.

In certain circumstances the tSQLiteConnection is beeing terminated and my tSQLiteInput throws an exception because of missing connection and my job stops running.

Is there any way to reopen the connection when it has been terminated?

Thank you and best regards.

Re: tSQLiteInput and terminated tSQLiteConnection

Anonymous — Fri, 10 Nov 2017 00:41:44 GMT

Instead of using existing connection, you can provide
connection details in input explicitly . it will cost you 0 to always open a new connection, in the case of sqlite db.

Re: tSQLiteInput and terminated tSQLiteConnection

Anonymous — Mon, 13 Nov 2017 12:37:32 GMT

Hello Chirgal. Why you mean that it costs me 0 if I access the file each iteration of around 200k iterations each hour?

Thank you.

Re: tSQLiteInput and terminated tSQLiteConnection

Anonymous — Mon, 13 Nov 2017 13:01:05 GMT

Sqlite db are server less and based on local file only. R u really connecting to any external server while opening connection?

Re: tSQLiteInput and terminated tSQLiteConnection

Anonymous — Mon, 13 Nov 2017 13:03:16 GMT

Hello, I know that sqlite is file based. But file i/o also takes time. db file is stored on a netshare...

Re: tSQLiteInput and terminated tSQLiteConnection

Anonymous — Mon, 13 Nov 2017 14:00:34 GMT

You can open/close connection per iteration . There won't be performance impact.

Yes I/O may impact, if you are running iterations in parallel. But sqlite won't complain ,since it always does write work for 1 connection/process/thread at a time, while read operations can be done in parallel.

Re: tSQLiteInput and terminated tSQLiteConnection

Anonymous — Thu, 07 Dec 2017 15:49:02 GMT

This doesn't work.

I run into "locked database" exeption quite fast.

Filehandler seems to keep it locked longer than an iteration takes...