Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
PMandrekar1684995754
Contributor
Contributor

Split large source file in talend

Hi Team,

If large source file want to split in source side itself how we can achieve this ?

Labels (2)
2 Replies
anselmopeixoto
Partner - Creator III
Partner - Creator III

Hello @Priyanka Mandrekar​ 

You might be able to achieve what you want starting from tfileInputFullRow component.

 

You'll probably need to get file's row count before (try using tFileRowCount) and create a loop (tLoop) to dynamically split file according with your needs.

 

Then you can set tFileInputFullRow's Limit parameter to read a specific number of rows and its Header parameter as a step.

Anonymous
Not applicable

Hello,

Could you tell us how large this file is likely to be? At what level should the file be split?

Due to "split" option will be available in tfileoutputdelimited component, If you want to get several delimited files, you can use tfileoututdelimited to achieve it.

Best regards

Sabrina