topic Re: Load big XML File (<5GB) into Oracle DB with NCLOB Fields in Talend Studio

Load big XML File (<5GB) into Oracle DB with NCLOB Fields

Anonymous — Sat, 16 Nov 2024 11:52:28 GMT

1. If I import XML File with size > 3GB, following Error occurs:
Unhandled event loop exception
JAVA heap space
2. Supposed, I have 1GB free Memory available. The XML File which I would like to import into Oracle Database (NCLOB fields) is ?3GB. How can I create an Job with Talend which can handle such big XML Files?
Target Database is Oracle 10g and the Table definition is the following creating Script:
create table F56LIMTX
(
LI56RCT NUMBER ,
LI56TMS NUMBER ,
LI56LIMICD NCHAR(12) NOT NULL ,
LI56LNGPCD NCHAR(1) NOT NULL ,
LI56UPDC NCHAR(1) ,
LI56COMM NCLOB ,
LI56UPDGAL NCHAR(1) ,
LIUSER NCHAR(10) ,
LIPID NCHAR(10) ,
LIJOBN NCHAR(10) ,
LIUPMJ NUMBER(6, 0) ,
LITDAY NUMBER ,
constraint F56LIMTX_PK primary key ( LI56LIMICD, LI56LNGPCD )
) ;

Re: Load big XML File (<5GB) into Oracle DB with NCLOB Fields

Anonymous — Mon, 14 Oct 2013 20:59:41 GMT

I do not think so this is a good example of using Talend. I would recommend using a bulk loader to import this huge content. With the normal build-in Oracle components this cannot be done.

Re: Load big XML File (<5GB) into Oracle DB with NCLOB Fields

Anonymous — Mon, 13 Jan 2014 16:25:29 GMT

Hi,
Can anyone briefly describe how to XML content into Oracle database ? (tags and attributes to normal table). My Sample XML looks like below.