Taking too much time to load data

[javvaji]

Hi,

I am loading data from Netezza to Vertica Database, i am having 1.3cr records of data it was taking almost 2hr to load data.

I tried using bulk load,i also enabled the cursor option in NetezzaInput component.

And i also tried to load data using Dynamic data type option in Edit schema i was getting the following error

org.netezza.error.NzSQLException: An existing connection was forcibly closed by the remote host

can any one can help me on this error and also any other option to load data faster.

Thanks,

Bharath.

[TRF]

You don't need to how many rows in the table. Just decide/test how many you are able to get at a time. For example 1,000,000 then with the appropriate logic, iterate over the select tasks (tNetezzaInput, tFileOutputDelimited) and of course a piece of Java code to set the offset and limit values using global variables.
I'm sure it works but can't be sure how the db will react (don't work with netezza); I just know the engine accept offset and limit.