Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Q&A with Qlik - Qlik Cloud Migration: Questions about migrating to Qlik Cloud? Catch the latest replay!
cancel
Showing results for 
Search instead for 
Did you mean: 
karandama2006
Creator
Creator

Migrating 2 billion records to SAP HANA

Hi ,

I'm trying to Migrate 2 billion records from a table in SQL Server to a table in SAP HANA using talend.

Current throughput which I'm getting is close to 25k rows per second , with this speed it would take more than a day to successfully load that data .

Is there a smart way of doing this ?

 

Thanks

Labels (3)
2 Replies
vapukov
Master II
Master II

Hi,

 

I haven't so big data just for test with Hana, but for most of the databases - build in method for bulk load data fom csv is fastest from all possible

HANA support it as well

 

but also speed depends from the sources and transformations as well - do you request data from a database? is it contain any order operations? and etc. 

 

karandama2006
Creator
Creator
Author

Yes , Data is requested from Database , there is no transformation except adding a timestamp