topic Re: Perfomance while loading csv into table in Talend Studio

Perfomance while loading csv into table

Karuetl — Sat, 16 Nov 2024 08:06:57 GMT

I am trying to load csv file into table , but performance is very very very slow , File is comma delimited with 6 million rows , lookup table is feed generated ID and it inserts into table

help me the changes to loaded faster for 6 million rows ...

In tmap i have below

Re: Perfomance while loading csv into table

Karuetl — Tue, 12 Jun 2018 17:41:00 GMT

I tried below approach . first load into file and use that file and load into table

still slow

Re: Perfomance while loading csv into table

Anonymous — Wed, 04 Jul 2018 08:22:32 GMT

Hello,

What's your target DB? Have you tried to set "Use Batch Size" option to activate the batch mode for data processing?

Best regards

Sabrina

Re: Perfomance while loading csv into table

Anonymous — Wed, 04 Jul 2018 11:25:02 GMT

The problem is clearly caused by your DB. In order for us to help we will need to know....

1) What the DB is?

2) Is it on-premise or remote?

3) What are your connection settings?

4) What are your t{DB}Output settings (both Basic and Advanced)