topic Re: Job Failure: tCassandraInput_1 Cassandra failure during read in Talend Studio

Job Failure: tCassandraInput_1 Cassandra failure during read

badri1 — Sat, 16 Nov 2024 06:13:35 GMT

One of the job is failing while migrating data from DataStax cassandra to cassandra..

Since we have more than 600GB per node and we have 17 nodes. So when we use "tCassandraInput_1" and provide a select query to fetch data to tMap it will throw an error as cassandra will not support select query for bigger Dataset.

Please let us know which component to use or how to resolve this issue.

Below is the error we are getting:

Starting job ras_stream2batch_device_hourly_data at 14:28 28/03/2019.

[INFO ]: migrationtdp.ras_stream2batch_device_hourly_data_0_1.ras_stream2batch_device_hourly_data - TalendJob: 'ras_stream2batch_device_hourly_data' - Start.
[statistics] connecting to socket on port 3639
[statistics] connected[DEBUG]: migrationtdp.ras_stream2batch_device_hourly_data_0_1.ras_stream2batch_device_hourly_data - tCassandraConnection_3 - Start to work.[DEBUG]: migrat

To see the whole post, download it here

Re: Job Failure: tCassandraInput_1 Cassandra failure during read

akumar2301 — Thu, 28 Mar 2019 15:45:10 GMT

This is datastax documentation on this error . Hope this will be helpful

https://support.datastax.com/hc/en-us/articles/204612559-ReadTimeoutException-seen-when-using-the-java-driver-caused-by-excessive-tombstones

Re: Job Failure: tCassandraInput_1 Cassandra failure during read

badri1 — Thu, 28 Mar 2019 15:51:53 GMT

Thanks Abhishek,

We have read this article but we can't change the gc_grace_seconds to below as we already have bigger grace period and its in production.

alter table example with gc_grace_seconds = 10000

Any suggestion really help.

Best Regards,