how to split the table data in qliksense

[ksk278074]

HI All,

i am loading the data from BW system using SAP bex connector but bex connector  having some some limitations(500000) for loading data. But here my table contains the more than 500000 data .

So in this case how to load the data from BW system to qliksense unsing bex connector?

thanks to all in advance.

[Ivan_Bozov]

Hi! I didn't know that there is a limit, but what you can do is use a WHERE statement and load the same table two times. Then both tables will concatenate automatically. Use some field to limit the load, e.g. ID, Date, etc.

Table_1:

LOAD * FROM ...

WHERE ID < 500000;

Table_2:

LOAD * FROM ...

WHERE ID > 500000;

[Vegar]

You need to identify how many rows you have in your source dataset. And thereafter loop 50000 rows at a time until you reached your limit. My guess is that you'll need something like this, you might have to adjust the syntax dending on your datasource/connector.

//Get the number of records in your dataset
RowCounter:
SQL SELECT
COUNT(*)  AS NOOFROWS
FROM .... ;

LET vNoOfRows = Peek('NOOFROWS',-1,'RowCounter'); // variable containing number of rows you are goin to catch.
LET vRecordNoLookup = 0; //Variable that inceases with 50000 per loop

// Loops 50000 rows for each iteration
DO WHILE $(vNoOfRows) > $(vRecordNo)
    LET vRecordNoLookup  = vRecordNoLookup +50000
    SQL SELECT
          *
    FROM ....
    WHERE
          ID >= $(vRecordNoLookup)-50000 
          AND ID < $(vRecordNoLookup) 
LOOP

Good luck with your problem.