TOS DI - tsqlite output slow performance

Anonymous — Tue, 14 Nov 2017 09:21:24 GMT

Hello everyone! I have a problem with tsqlite output component, i tried the same simple job on my Windows (i7 2,20 GHz - 16 GB RAM - 64 bit) :

As you see it's a very simple JOB where I am loading a 3'000'000 rows csv table, in a sqlite db.

The problem is that this job run on average 5000 rows/s on my windows. But I tried it on the macbook air of my colleagues and the same job run on average 75 000 rows/s, and moreover the macbook has only 8GB of RAM .

I tried to increase Xmx and Xms but nothing changed. Someone can give me a suggestion?

Re: TOS DI - tsqlite output slow performance

Anonymous — Wed, 15 Nov 2017 07:19:16 GMT

Hi,

The average speed was getting slow down when you load your data into tsqliteoutput component?

Here is "Use Batch" check box in advanced settings of tsqliteoutput component which is used to activate the batch mode for data processing.

Let us know if it is OK with you.

Best regards

Sabrina

topic Re: TOS DI - tsqlite output slow performance in Talend Studio

TOS DI - tsqlite output slow performance

Re: TOS DI - tsqlite output slow performance