Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
One of the job is failing.
Since we have more than 600GB per node and we have 17 nodes. So when we use "tCassandraInput_1" and provide a select query to fetch data to tMap it will throw an error as cassandra will not support select query for bigger Dataset.
Please let us know which component to use or how to resolve this issue.
Below is the debug logs:
Starting job ras_stream2batch_device_hourly_data at 14:28 28/03/2019.
[INFO ]: migrationtdp.ras_stream2batch_device_hourly_data_0_1.ras_stream2batch_device_hourly_data - TalendJob: 'ras_stream2batch_device_hourly_data' - Start.
[statistics] connecting to socket on port 3639
[statistics] connected[DEBUG]: migrationtdp.ras_stream2batch_device_hourly_data_0_1.ras_stream2batch_device_hourly_data - tCassandraConnection_3 - Start to work.[DEBUG]: migrationtdp.ras_stream2batch_device_hourly_data_0_1.ras_stream
Hi,
this is not a Talend specific issue, but issue related to Cassandra and could be repeated with any Cassandra client
the sample of discussions - https://stackoverflow.com/questions/32689856/cassandra-timeout-during-read-query-at-consistency-one
it better to ask on Cassandra related forums, how to better tune it
as a variant - increase the timeout in Cassandra settings, but not sure if it help on huge datasets with large returned numbers of rows