Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
TomG1
Creator
Creator

Migration of 2000 Ms-SQL-Server Tables to Cassandra

Hi,
We have a requirement to migrate around 2000 tables from SQL server to Cassandra(Big Data) Database.
The jobs are simple in which SQL server table will be mapped to a Cassandra table.
There is no complex logic. Its just copying data from one table(in SQL SERVER) to another table (in Cassandra)
SQL_SERVER_TABLE_1------------>Cassandra_Table_1 and so on..
So for 2000 tables in SQL Server we have to create 2000 jobs to copy data into Cassandra.
can you please suggest some automation so that we can save time of creating 2000 jobs manually?
P.S: Note that in Cassandra a table is called a 'column family'. For the sake of clarity I have mentioned it as table.
Thanks
Tom
Labels (2)
3 Replies
Anonymous
Not applicable

Hi,
Are your 2000 tables same schema structure?
So far, tCassandraOutput don't support for "Dynamic Schema" feature.
Best regards
Sabrina
Anonymous
Not applicable

Hi xdshi,
We have a query regarding the above scenario which was raised by Tom.
Lets suppose we have Source with Schema1 and Target with Schema2. And target table structures are same as Source table structures.
But each tables are different from each other structurally. Our requirement is to load all the 2000 target tables with single or less number of jobs.
Please advise this can be done or not.
Thanks
Anonymous
Not applicable

Hi,
So far, talend big data components don't support for dynamic schema.
Best regards
Sabrina