Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW
cancel
Showing results for 
Search instead for 
Did you mean: 
ksk278074
Contributor III
Contributor III

how to split the table data in qliksense

HI All,

i am loading the data from BW system using SAP bex connector but bex connector  having some some limitations(500000) for loading data. But here my table contains the more than 500000 data .

So in this case how to load the data from BW system to qliksense unsing bex connector?

thanks to all in advance.

2 Replies
Ivan_Bozov
Luminary
Luminary

Hi! I didn't know that there is a limit, but what you can do is use a WHERE statement and load the same table two times. Then both tables will concatenate automatically. Use some field to limit the load, e.g. ID, Date, etc.

Table_1:

LOAD * FROM ...

WHERE ID < 500000;

Table_2:

LOAD * FROM ...

WHERE ID > 500000;

vizmind.eu
Vegar
MVP
MVP

You need to identify how many rows you have in your source dataset. And thereafter loop 50000 rows at a time until you reached your limit. My guess is that you'll need something like this, you might have to adjust the syntax dending on your datasource/connector.

//Get the number of records in your dataset

RowCounter:

SQL SELECT

COUNT(*)  AS NOOFROWS

FROM .... ;

LET vNoOfRows = Peek('NOOFROWS',-1,'RowCounter'); // variable containing number of rows you are goin to catch.

LET vRecordNoLookup = 0; //Variable that inceases with 50000 per loop

// Loops 50000 rows for each iteration

DO WHILE $(vNoOfRows) > $(vRecordNo)

    LET vRecordNoLookup  = vRecordNoLookup +50000

    SQL SELECT

          *

    FROM ....

    WHERE

          ID >= $(vRecordNoLookup)-50000

          AND ID < $(vRecordNoLookup)

LOOP

Good luck with your problem.