What's the maximum no of rows/records can be loaded into Oracle from TOS 6.5?

[Anonymous]

Good evening,

I have a CSV file which has 21829697 records and am trying to load into Oracle using tOracleOutPut. Job is failing at 5325000 mil records.

Please find the attachments:

  1. Actual Talend Job - Doing development in my local machine(Windows Server)

  2. Error in the Run console

Performance tuning i have done:

1. Increased JVM arguments: Xms5120M and Xmx12288M

2. In tMap settings: Gave "Temp data directory path" to load the data temporarily into my local machine

   a. Gave "Max buffer size as: 2000000

Could any of you please help me how to load all(21829697) records into Target-Oracle. 

Any help is greatly appreciated in achieving this task.

Thanks & Regards

Kumar

[Anonymous]

Hello,

The cause of this error is that the available memory is not sufficient for the maximum heap size set by -Xmx parameter.

Are you installing Talend Studio on a 64-bit operating system? What's your RAM?

Best regards

Sabrina

[Anonymous]

Hi,

Thank you for the response.

Are you installing Talend Studio on a 64-bit operating system? Installed on 64 bit OS

What's your RAM? 16 GB

I have allotted 8 gigs out of my total available RAM.

Please let me know what else i can do.. 

Thankyou

Kumar

[Anonymous]

Hi Kumar,

     You are trying to load around 21 million records to target DB. So you will have to ideally use Oracle Bulk components instead of normal tOracleOutput. Could you please try tOracleOutputBulkExec component to load the data. Sample scenarios are already available both in help document and in Talend community.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved