Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable
‎2013-06-12 08:54 AM

Insert large amount of data (97,000,000)

Hi,
I have a source table with nearly 97,000,000 rows which I want to insert into a destination table.
I am using Microsoft SQL Server in my job I use tMSSqlInput to get the source which is wired directly to a tMSSqlOutput to output to the destination table. The job takes ages but the SSIS job which I am replacing runs in around a minute.
I there a more efficient way of doing this?
Thank,
Dave.
Labels (2)
Labels
241 Views
0 Likes
4 Replies
Anonymous
Not applicable
‎2013-06-14 12:21 AM
Author

Hi,
If your DB Microsoft SQL Server support for bulk, talend also provide bulk components to deal with large amount of data.
Best regards
Sabrina
241 Views
0 Likes
Anonymous
Not applicable
‎2013-06-14 04:11 AM
Author

Hi Sabrina,
What components would I use from the palette?
Thanks for your help,
Dave.
241 Views
0 Likes
Anonymous
Not applicable
‎2013-06-14 04:19 AM
Author

Hi,
You can see the component references tMSSqlBulkExec and tMSSqlOutputBulk with related scenarios.
Best regards
Sabrina
241 Views
0 Likes
Anonymous
Not applicable
‎2013-06-14 05:56 AM
Author

Thanks Sabrina I overlooked these. The intellisense says "Loads efficiently data from file" I took it literally.
Thanks again 0683p000009MACn.png
241 Views
0 Likes