Split file rows into multiple files

[Anonymous]

Hi all
I have a 80 Million row file, which brings my oracle instance to explode...
I can handle 10 Mio rows in one iteration.
Has anybody a suggestion how to read the file and iterate over each 10 Mio segment ?
Thanks in advance,
Benjamin

[Anonymous]

hi,
i get teh same probleme.
I want to split a file every change of a key
AA;e
AA;r
BB;e
the result would be 1 file with all the AA and one file with BB etc
thx

[Anonymous]

Dobprofi - on the tFileOutputDelimited component - see this ;
http://talendforge.org/forum/postgallery.php?pid=10763&filename=schema.png
Chris - have a look at this....
http://talendforge.org/forum/viewtopic.php?id=2533

[Anonymous]

Hi SMaz
great contribution, Thank you!
I was actually not looking at this component, because I am using the tOracleOutputBulk, which is in fact about twice as fast as tFileOutput. But after your suggestion I reconsider using tFileOutput.
Cheers
Benjamin

[Anonymous]

Hi,
I've written a new tutorial on "how to split a file into many files regarding a key on each record" which explains how to solve this kind of task. It is actually only available in french. The tutorial shows 3 different technics to achieve this task.
Hope it can be useful.