topic Re: Data Volume in Data Quality

Data Volume

Anonymous — Sat, 16 Nov 2024 10:07:48 GMT

Dear Team,
I have to export bulk data (approx 1 billion) from Cassandra 2.0.14 via Talend. While I am using CQL (SELECT or COPY ) on cqlsh, it gets timeout or Cassandra is not properly response. Can it be exported via Talend BD ? I have tested it for 50,000 records and it is working fine. but I am not sure about bulk extraction. Can anyone suggest ?

Thanks,
Sunil

Re: Data Volume

Anonymous — Tue, 07 Feb 2017 06:44:26 GMT

Hi,
Could you please indicate what's build version you are using? open source or subscription version? What does your job design look like?
Bestn regards
Sabrina

Re: Data Volume

Anonymous — Tue, 07 Feb 2017 17:32:13 GMT

I am using Talend Big Data community version 6.2.1 and DSE Cassandra 2.0.14 . Actually Biz is looking full data of Cassandra table in CSV files. but it is not possible using CQL (Select * from tablename) or COPY command due huge data in Cassandra table.