Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Not applicable
‎2010-09-03 08:53 PM

Slow Extraction using SAP Connector

Hi all,

I'm currently pulling some data from the VBAP table in SAP. And the performance is very slow! The table size is 100mil records and is about 100GB is disk size. I loaded it for more than 12 hours and it only loaded 10mils records! This is with all the columns. I tried to reduce the number of columns to around 10, but the speed is still slow... only 30mils extracted in 5hours. Is this normal?

Is there anyway to improve the speed? Any thing that I can tweak in QlikView or SAP? The QV server is 64core with 64GB of RAM. QlikView's RAM usage is not high... less than 10GB. Plenty of free memory. Using SAP Connector 5.4, QlikView 9 SR5.

4,304 Views
0 Likes
21 Replies
suniljain
Master
Master
‎2010-09-07 02:29 AM

In response to

In your given details version of transport file is different.

I Mean, One Transport file is of one version and second transport file is of another version.

pls check this.

592 Views
0 Likes
Not applicable
‎2010-09-07 02:38 AM
Author

In response to suniljain

Hi Sunil,

The two transport files are for Data Extraction (E6DK900067) and User Profile (E6DK900051).

592 Views
0 Likes
suniljain
Master
Master
‎2010-09-07 03:22 AM

In response to

Following is combination od transport file but Your transport file have different combination.

5.4: E6DK900056 & E6DK900051

5.4 SR1: E6DK900064 & E6DK900051

592 Views
0 Likes
Not applicable
‎2010-09-07 03:30 AM
Author

In response to suniljain

Hi Sunil,

We are running on BASIS 6.20. The transports you mentioned are for BASIS 6.40 and above.

592 Views
0 Likes
suniljain
Master
Master
‎2010-09-07 03:32 AM

In response to

what is size of cache memory allocated to SAP connector in SAP ?

592 Views
0 Likes
Not applicable
‎2010-09-07 03:35 AM
Author

In response to suniljain

We changed the following parameters in SAP (following one of the post in this forum):

Import/export parameter rsdb/obj/buffersize to 400000 (400Mb) and rsdb/obj/max_objects to 100000.

Is it the same thing that you are talking about? If not, can you give me more details on how to configure the size of the cache memory?

592 Views
0 Likes
suniljain
Master
Master
‎2010-09-07 03:47 AM

In response to

Please Run RSPFLDOC via SE38

and post details whatever you get .

592 Views
0 Likes
suniljain
Master
Master
‎2010-09-07 03:49 AM

In response to suniljain

Parameter should be following for normal extraction of data from SAP. We are using this configuration setting.

Dflt value 4096
ProfileVal 400000
Current value 400000

592 Views
0 Likes
Not applicable
‎2010-09-07 04:12 AM
Author

In response to suniljain

Hi Sunil,

We have the same configuration for rsdb/obj/buffersize parameter.

Dflt value 4096
ProfileVal 400000
Current value 400000

592 Views
0 Likes
suniljain
Master
Master
‎2010-09-07 04:20 AM

In response to

I think there is no problem at SAP side and SAP connector side.

which window version you are using is it 64 bit server or 32 bit ?

592 Views
0 Likes