Limitation on rows in TOS

[Anonymous]

Is there a limitation on the no of rows in trial version of TOS ?   my job is not loading the data after 20000rows.. looks like it is not updating more than that.

[Anonymous]

Did this work?

[Anonymous]

It copied 23000 rows and the job failed..   I executed the job thru control M .. below is the error log

C:

cd C:\Talend\6.5.1\studio\Solar_0.1\Solar\

java -Xms256M -Xmx1024M -cp .;../lib/routines.jar;../lib/dom4j-1.6.1.jar;../lib/log4j-1.2.16.jar;../lib/mssql-jdbc.jar;../lib/ojdbc\
6.jar;../lib/talend-oracle-timestamptz.jar;../lib/talend_file_enhanced_20070724.jar;solar_0_1.jar; local_project.solar_0_1.Solar --\
context=Default
[FATAL]: local_project.solar_0_1.Solar - tMSSqlOutput_1 112007;Exceeded the memory limit of 20 MB per session for prepared statemen\
ts. Reduce the number or size of the prepared statements.
java.sql.BatchUpdateException: 112007;Exceeded the memory limit of 20 MB per session for prepared statements. Reduce the number or \
size of the prepared statements.
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeBatch(SQLServerPreparedStatement.java:1867)
at local_project.solar_0_1.Solar$1LimitBytesHelper_tMSSqlOutput_1.limitBytePart1(Solar.java:1537)
at local_project.solar_0_1.Solar.tOracleInput_1Process(Solar.java:1579)
at local_project.solar_0_1.Solar.runJobInTOS(Solar.java:2079)
at local_project.solar_0_1.Solar.main(Solar.java:1910)
Exception in component tMSSqlOutput_1 (Solar)
java.sql.BatchUpdateException: 112007;Exceeded the memory limit of 20 MB per session for prepared statements. Reduce the number or \
size of the prepared statements.
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeBatch(SQLServerPreparedStatement.java:1867)
at local_project.solar_0_1.Solar$1LimitBytesHelper_tMSSqlOutput_1.limitBytePart1(Solar.java:1537)
at local_project.solar_0_1.Solar.tOracleInput_1Process(Solar.java:1579)
at local_project.solar_0_1.Solar.runJobInTOS(Solar.java:2079)
at local_project.solar_0_1.Solar.main(Solar.java:1910)

Job Object statistics
====================
Total User CPU Time: 13.563 second

Total Kernel CPU Time: 1.531 second

This Period Total User CPU Time: 13.563 second

This Period Total Kernel CPU Time: 1.531 second

Total Page Fault Count: 85689

Total Processes: 2

Active Processes: 0

Total Terminated Processes: 0

Total peak job memory used: 379.556 mega bytes

[Anonymous]

You're using Azure aren't you. This looks like an Azure limitation. Try changing the batch size or doing this in chunks.

[Anonymous · Accepted solution]

Take a look at this: https://stackoverflow.com/questions/44188234/azure-exceeded-the-memory-limit-of-20-mb-per-session-fo...

It shows that this is likely an Azure configuration limitation. I do not believe this is a Talend issue.