Qlik Community

New to Qlik Sense

Discussion board where members can get started with Qlik Sense.

Aleja54
New Contributor

Memory problem qlik sense

Hi everyone!

I'm new in the community.  I have a problem I have a data of approximately 700 thousand records and I must insert as 25 columns in a table, the issue is that I do not reach the fourth column and it tells me error calculation timed out, I probe it in my pc and in my note where it stays stuck, I'm connecting to mysql via odbc, I did the test with qvd tables, the tables are six.

I hope you can help me

 

1 Solution

Accepted Solutions
Highlighted
Channa
Valued Contributor III

Re: Memory problem qlik sense

LIB CONNECT TO 'mySQL Database Conection2'; 

tbl_conbp:

LOAD `CONBP_NOMBRE`,
`CONBP_NUMEGRE`,
`CONBP_TIPOFAC`,
`CONBP_RUTPROV`,
`CONBP_TIPOCC`,
`CONBP_TIPOFAC` as tipofac;
SQL SELECT `CONBP_NOMBRE`,
`CONBP_NUMEGRE`,
`CONBP_TIPOFAC`,
`CONBP_RUTPROV`,
`CONBP_TIPOCC`,
`CONBP_TIPOFAC`
FROM `texto_plano`.`tbl_conbp`;
STORE tbl_conbp INTO lib://mySQL Database Conection2/tbl_conbp.qvd(qvd);

Drop table tbl_conbp;

no need to repeat connection string for ever table and define table name in the beginning and drop after

Channa
6 Replies
Channa
Valued Contributor III

Re: Memory problem qlik sense

qlik and Mysql are in same net work

 

ur query fully executed on my SQL??

 

ODBC will have some network issues if you are not on same network

Channa
Aleja54
New Contributor

Re: Memory problem qlik sense

I use this script, this is part of the script:

LIB CONNECT TO 'mySQL Database Conection2';

LOAD `CONBP_NOMBRE`,
`CONBP_NUMEGRE`,
`CONBP_TIPOFAC`,
`CONBP_RUTPROV`,
`CONBP_TIPOCC`,
`CONBP_TIPOFAC` as tipofac;
SQL SELECT `CONBP_NOMBRE`,
`CONBP_NUMEGRE`,
`CONBP_TIPOFAC`,
`CONBP_RUTPROV`,
`CONBP_TIPOCC`,
`CONBP_TIPOFAC`
FROM `texto_plano`.`tbl_conbp`;
STORE tbl_conbp INTO lib://mySQL Database Conection2/tbl_conbp.qvd(qvd);

LIB CONNECT TO 'mySQL Database Conection2';

LOAD `MAEOB_CODCTACTE`,
`MAEOB_DEPTO`,
`MAEOB_ESTADO`,
`MAEOB_NUMDOC`,
`MAEOB_NUMEROCC`,
`MAEOB_NUMFAC` as numfact,
`MAEOB_NUMOBORI`,
`MAEOB_RUTPROV` as rutprov,
`MAEOB_TIPDOC`,
`MAEOB_TIPOB`,
`MAEOB_TIPOBORI`,
`MAEOB_TIPOCC`,
`MAEOB_TIPOFAC` as tipofac,
`MAEOB_TIPPR`,
`MAEOB_ANO`,
`MAEOB_AREAS`,
`MAEOB_DEVENGA`,
`MAEOB_FECANU`,
`MAEOB_FECDOC`,
`MAEOB_FECHA`,
`MAEOB_PAGADO`,
`MAEOB_VALDOC`,
`MAEOB_VALOBL`;
SQL SELECT `MAEOB_CODCTACTE`,
`MAEOB_DEPTO`,
`MAEOB_ESTADO`,
`MAEOB_NUMDOC`,
`MAEOB_NUMEROCC`,
`MAEOB_NUMFAC`,
`MAEOB_NUMOBORI`,
`MAEOB_RUTPROV`,
`MAEOB_TIPDOC`,
`MAEOB_TIPOB`,
`MAEOB_TIPOBORI`,
`MAEOB_TIPOCC`,
`MAEOB_TIPOFAC`,
`MAEOB_TIPPR`,
`MAEOB_ANO`,
`MAEOB_AREAS`,
`MAEOB_DEVENGA`,
`MAEOB_FECANU`,
`MAEOB_FECDOC`,
`MAEOB_FECHA`,
`MAEOB_PAGADO`,
`MAEOB_VALDOC`,
`MAEOB_VALOBL`
FROM `texto_plano`.`tbl_maeob`;

STORE tbl_maeob INTO lib://mySQL Database Conection2/tbl_maeob.qvd(qvd);

 

Try the option without saving the tables and I get the same error

Aleja54
New Contributor

Re: Memory problem qlik sense

I forgot to say that I have 9 tables, some joined with left join to another one and the other ones united spor field to main

Highlighted
Channa
Valued Contributor III

Re: Memory problem qlik sense

LIB CONNECT TO 'mySQL Database Conection2'; 

tbl_conbp:

LOAD `CONBP_NOMBRE`,
`CONBP_NUMEGRE`,
`CONBP_TIPOFAC`,
`CONBP_RUTPROV`,
`CONBP_TIPOCC`,
`CONBP_TIPOFAC` as tipofac;
SQL SELECT `CONBP_NOMBRE`,
`CONBP_NUMEGRE`,
`CONBP_TIPOFAC`,
`CONBP_RUTPROV`,
`CONBP_TIPOCC`,
`CONBP_TIPOFAC`
FROM `texto_plano`.`tbl_conbp`;
STORE tbl_conbp INTO lib://mySQL Database Conection2/tbl_conbp.qvd(qvd);

Drop table tbl_conbp;

no need to repeat connection string for ever table and define table name in the beginning and drop after

Channa
Aleja54
New Contributor

Re: Memory problem qlik sense

Sorry, I still have problems with the transformations, look at my script is the following:

LIB CONNECT TO 'mySQL Database Conection2';
[tbl_deta]:

LOAD `cuenta`,
`DETA_GLOSA`,
`numcc`,
`rutprov`,
`DETA_TIPOCC`,
`tipodoc`,
`DETA_AREAINT`,
`DETA_DEBE`,
`DETA_FECHACC`

FROM [lib://mySQL Database Conection2/provi2/tbl_deta.qvd](qvd);

LEFT JOIN(tbl_deta)

LOAD `numcc`,
`CONBP_SERIE`,
`CONBP_FECHA`,
`CONBP_NUMMOV`
FROM [lib://mySQL Database Conection2/provi2/tbl_conbp.qvd](qvd);
LIB CONNECT TO 'mySQL Database Conection2';
LEFT JOIN(tbl_deta)
LOAD `TTDOC_NOMDOC`,
`tipodoc`
FROM [lib://mySQL Database Conection2/provi2/tbl_ttdoc.qvd](qvd);
LIB CONNECT TO 'mySQL Database Conection2';
LEFT JOIN(tbl_deta)
LOAD `cuenta`,
`MCUEN_NOM_CTA`
FROM [lib://mySQL Database Conection2/provi2/tbl_mcuen.qvd](qvd);



Inner JOIN(tbl_deta)
LOAD `DECCS_CCOSTO`,
`DECCS_NUMFACT`,
`DECCS_FECHACC`,
`DECCS_NUMDEP`,
`codprog`,
`rutprov`

FROM [lib://mySQL Database Conection2/provi2/tbl_deccs.qvd](qvd);
LIB CONNECT TO 'mySQL Database Conection2';
LEFT JOIN(tbl_deccs)
LOAD `codprog`,
`TPROG_NOMPROG`

FROM [lib://mySQL Database Conection2/provi2/tbl_tprog.qvd](qvd);

STORE tbl_deta INTO lib://mySQL Database Conection2/provi3/tbl_deta.qvd(qvd);
Drop Table tbl_deta;

 

 

 

Aleja54
New Contributor

Re: Memory problem qlik sense

finally I managed to process the data, change the join for keep, thanks for guiding me in the consultations, that part did work and it was very helpful since I was very disoriented