Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
The problem is, you accumulate all data into the memory with complex structure.
You could try the user components tFileExcelWorkbookOpen (has a streaming option to limit the memory usage) + tFileExcelSheetOutput and tFileExcelWorkbookSave
With the streaming option allows you to write nearly unlimited (only limited by Excel it self) number of large rows.
The trade off of this mode is, you can only access the last 100 rows after writing them within the Talend job but if you want only writing and do not read out in the same job, this will work.
connecting to socket on port 4045
connected
2014-02-12 18:06:24|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default||begin||
2014-02-12 18:06:24|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelWorkbookOpen_1|begin||
2014-02-12 18:06:25|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelWorkbookOpen_1|end|success|1016
2014-02-12 18:06:26|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tMSSqlRow_1|begin||
2014-02-12 18:06:26|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tMSSqlRow_1|end|success|47
2014-02-12 18:06:26|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_1|begin||
2014-02-12 18:06:29|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_1|end|success|3031
2014-02-12 18:06:29|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_2|begin||
2014-02-12 18:06:30|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_2|end|success|1468
2014-02-12 18:06:30|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelWorkbookSave_1|begin||
2014-02-12 18:06:38|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelWorkbookSave_1|end|success|8235
2014-02-12 18:06:39|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_3|begin||
2014-02-12 18:06:41|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_3|end|success|2453
2014-02-12 18:06:41|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_4|begin||
2014-02-12 18:06:43|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_4|end|success|1453
2014-02-12 18:06:52|jmrNVc|jmrNVc|jmrNVc|544|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default||end|success|27828
disconnected
Job MyJob ended at 18:06 12/02/2014.
### Job STARTED at 2014/02/12 17:53:28 (jobId=20140212_174057_vYBXD, jobExecutionId=20140212175328_pVLLY) ###
2014-02-12 17:53:28|20140212175328_pVLLY|20140212175328_pVLLY|20140212175328_pVLLY|5676|MyProject|MyJobl|_owoZQImUEeO5AbT5-_XKlg|0.6|Default||begin||
2014-02-12 17:53:29|20140212175328_pVLLY|20140212175328_pVLLY|20140212175328_pVLLY|5676|MyProject|MyJobl|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tMSSqlRow_1|begin||
2014-02-12 17:53:29|20140212175328_pVLLY|20140212175328_pVLLY|20140212175328_pVLLY|5676|MyProject|MyJobl|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tMSSqlRow_1|end|success|78
17:53:31|20140212175328_pVLLY|20140212175328_pVLLY|20140212175328_pVLLY|5676|MyProject|MyJobl|_owoZQImUEeO5AbT5-_XKlg|0.6|Default||end|success|2640
### Job ENDED SUCCESSFULLY at 2014/02/12 17:53:31 (jobId=20140212_174057_vYBXD, jobExecutionId=20140212175328_pVLLY) ###
### Job STARTED at 2014/02/13 10:06:14 (jobId=20140213_095819_kzpvS, jobExecutionId=20140213100614_ghgca) ###
2014-02-13 10:06:14|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default||begin||
2014-02-13 10:06:15|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelWorkbookOpen_1|begin||
2014-02-13 10:06:15|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelWorkbookOpen_1|end|success|0
2014-02-13 10:06:15|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tMSSqlRow_1|begin||
2014-02-13 10:06:15|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tMSSqlRow_1|end|success|78
2014-02-13 10:06:15|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_1|begin||
2014-02-13 10:06:16|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_1|end|success|281
2014-02-13 10:06:16|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_2|begin||
2014-02-13 10:06:16|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_2|end|success|250
2014-02-13 10:06:16|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelWorkbookSave_1|begin||
2014-02-13 10:06:16|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelWorkbookSave_1|end|success|0
2014-02-13 10:06:16|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_3|begin||
2014-02-13 10:06:17|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_3|end|success|203
2014-02-13 10:06:17|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_4|begin||
2014-02-13 10:06:17|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default|tFileExcelSheetOutput_4|end|success|156
2014-02-13 10:06:21|20140213100614_ghgca|20140213100614_ghgca|20140213100614_ghgca|9468|MyProject|MyJob|_owoZQImUEeO5AbT5-_XKlg|0.6|Default||end|success|6719
### Job ENDED SUCCESSFULLY at 2014/02/13 10:06:21 (jobId=20140213_095819_kzpvS, jobExecutionId=20140213100614_ghgca) ###