topic Re: Load script skips a table during the script execution process in QlikView

Load script skips a table during the script execution process

sinanozdemir — Tue, 02 Feb 2016 16:03:08 GMT

Hi all,

I have been having an issue that I couldn't figure out the root cause of it. I am trying to load two tables VM_CLAIM and VM_MEMBMTHS, and they both reside in the same database so that the one ODBC connection is used. Also "Force 32 Bit" option is checked.

What happens is that the first table VM_CLAIM gets loaded, but the second table VM_MEMBMTHS doesn't. Almost QlikView skips the second table for some reasons. I checked the availability of VM_MEMBMTHS table in both SQL Server and another BI tool, the table runs perfectly.

Here is a screenshot of the script execution progress window:

There are two different tables in the load script:

I also checked if the tables are being concatenated, and there is only one common field in both tables so I don't think it is a concatenation issue.

If anyone had this issue and resolved it, I would appreciate your feedback.

Thank you

pbutterw‌

Re: Load script skips a table during the script execution process

andrespa — Tue, 02 Feb 2016 16:10:07 GMT

Hi Sinan, does your script finish or just break at that point in the execution?

Re: Load script skips a table during the script execution process

awhitfield — Tue, 02 Feb 2016 16:12:32 GMT

Hi,

can you supply your script details?

Andy

Re: Load script skips a table during the script execution process

sinanozdemir — Tue, 02 Feb 2016 16:18:56 GMT

Hi Andres,

It doesn't break, it just stops.

Thanks

Re: Load script skips a table during the script execution process

sinanozdemir — Tue, 02 Feb 2016 16:23:03 GMT

Hi Andy,

Sure. Here is the script of the problematic table:

MM:

LOAD

MM_UNITS,

PREMIUM_EMPLOYER_PAID,

PREMIUM_EMPLOYEE_PAID,

INCURRED_YEAR_AND_MONTH & '|' & CCHG_CAT_CODE_AND_DESC & '|' & PRODUCT_TYPE & '|' & OWNER_HOSPITAL As Key;

LOAD "INCURRED_YEAR_AND_MONTH" As MM_DATE_TEXT,

Sum("MM_UNITS") As MM_UNITS,

"PRODUCT_TYPE" As MM_BENFT_PACK,

"OWNER_HOSPITAL" As MM_OWNER,

Sum("PREMIUM_EMPLOYER_PAID") As PREMIUM_EMPLOYER_PAID,

Sum("PREMIUM_EMPLOYEE_PAID") As PREMIUM_EMPLOYEE_PAID,

"CCHG_CAT",

"CCHG_DESC",

"CCHG_CAT_CODE_AND_DESC" AS MM_CCHG_COMBINED

Where INCURRED_YEAR_AND_MONTH >= '201501' And MM_UNITS = 1

Group By

INCURRED_YEAR_AND_MONTH,

PRODUCT_TYPE,

OWNER_HOSPITAL,

CCHG_CAT,

CCHG_DESC,

CCHG_CAT_CODE_AND_DESC;

SQL SELECT "INCURRED_YEAR_AND_MONTH",

"MM_UNITS",

"PRODUCT_TYPE",

"OWNER_HOSPITAL",

"PREMIUM_EMPLOYER_PAID",

"PREMIUM_EMPLOYEE_PAID",

"CCHG_CAT",

"CCHG_DESC",

"CCHG_CAT_CODE_AND_DESC",

"MEMBER_COMPANY"

FROM MedInsight2.USR."VW_MEMBMTHS";

I also tried to load the data without the aggregation and no luck.

Thanks

Re: Load script skips a table during the script execution process

andrespa — Tue, 02 Feb 2016 16:26:08 GMT

What happens if you just run this part of the script: ??

SQL SELECT "INCURRED_YEAR_AND_MONTH",
"MM_UNITS",
"PRODUCT_TYPE",
"OWNER_HOSPITAL",
"PREMIUM_EMPLOYER_PAID",
"PREMIUM_EMPLOYEE_PAID",
"CCHG_CAT",
"CCHG_DESC",
"CCHG_CAT_CODE_AND_DESC",
"MEMBER_COMPANY"
FROM MedInsight2.USR."VW_MEMBMTHS";

Re: Load script skips a table during the script execution process

sinanozdemir — Tue, 02 Feb 2016 16:29:30 GMT

Hi Andres,

That seems to be running fine. Although, why would this happen with the preceding load?

Thanks

Re: Load script skips a table during the script execution process

andrespa — Tue, 02 Feb 2016 16:36:20 GMT

Try this one: I think the problem is happening because your double preceding load. So hopefuly this one should work fine.

MM:
LOAD *,
INCURRED_YEAR_AND_MONTH & '|' & CCHG_CAT_CODE_AND_DESC & '|' & PRODUCT_TYPE & '|' & OWNER_HOSPITAL As Key;
"INCURRED_YEAR_AND_MONTH" As MM_DATE_TEXT,
Sum("MM_UNITS") As MM_UNITS,
"PRODUCT_TYPE" As MM_BENFT_PACK,
"OWNER_HOSPITAL" As MM_OWNER,
Sum("PREMIUM_EMPLOYER_PAID") As PREMIUM_EMPLOYER_PAID,
Sum("PREMIUM_EMPLOYEE_PAID") As PREMIUM_EMPLOYEE_PAID,
"CCHG_CAT",
"CCHG_DESC",
"CCHG_CAT_CODE_AND_DESC" AS MM_CCHG_COMBINED
Where INCURRED_YEAR_AND_MONTH >= '201501' And MM_UNITS = 1
Group By
INCURRED_YEAR_AND_MONTH,
PRODUCT_TYPE,
OWNER_HOSPITAL,
CCHG_CAT,
CCHG_DESC,
CCHG_CAT_CODE_AND_DESC;
SQL SELECT "INCURRED_YEAR_AND_MONTH",
"MM_UNITS",
"PRODUCT_TYPE",
"OWNER_HOSPITAL",
"PREMIUM_EMPLOYER_PAID",
"PREMIUM_EMPLOYEE_PAID",
"CCHG_CAT",
"CCHG_DESC",
"CCHG_CAT_CODE_AND_DESC",
"MEMBER_COMPANY"
FROM MedInsight2.USR."VW_MEMBMTHS";

Re: Load script skips a table during the script execution process

Peter_Cammaert — Tue, 02 Feb 2016 16:39:00 GMT

It is commonly known (very recently by me as well, although I've been fighting them for some time now) that Preceding Loads should be used for doing just minor column and value manipulations. As soon as you start doing extra filtering (or GROUP BYs) you may unexpectedly run into trouble.

You can continue doing what Andres initiated. Add the next Preceding load and see what you get. If that doesn't work, try a conversion into successive RESIDENT LOADS. That should work in any case or will produce at least proper error messages if it doesn't.

Peter

Re: Load script skips a table during the script execution process

alexdataiq — Tue, 02 Feb 2016 16:39:03 GMT

Hi Sinan,

Does the scripts ends (the close button is active) or it just hangs? If it hangs maybe it taking a long time for the QV engine to build the data model.

Have you tried using the prefix Noconcatenate when loading your second table?

What does the document log says?

Regards

Re: Load script skips a table during the script execution process

sinanozdemir — Tue, 02 Feb 2016 16:43:42 GMT

Sorry Andres. It didn't work. Although, it works if I only pull everything "*" without any manipulations.

Thanks

Re: Load script skips a table during the script execution process

andrespa — Tue, 02 Feb 2016 16:46:14 GMT

No worries, it's as Peter just said. Try to do it with resident loads instead of preceding.

Best of luck,

Andrés

Re: Load script skips a table during the script execution process

sinanozdemir — Tue, 02 Feb 2016 16:46:29 GMT

Hi Peter,

Thank you for your feedback. However, this happens with only a handful of tables. I started wondering if it is because of the table/database design. For the problematic table, there are columns like the below ones:

And these columns are just empty. They are used as headers, but I am not even bringing any of these fields though.

Thank you.

Re: Load script skips a table during the script execution process

sinanozdemir — Tue, 02 Feb 2016 16:48:25 GMT

Thank you again Andres for your time and feedback.

Re: Load script skips a table during the script execution process

sinanozdemir — Tue, 02 Feb 2016 17:19:19 GMT

Hi Eduardo,

it just ends, the close button is active.

Yes, I tried Noconcatenate and it didn't solve the issue.

I will go with Marcus' suggestion.

Thank you all.

Re: Load script skips a table during the script execution process

byronhuff — Fri, 15 May 2020 15:42:04 GMT

Has anything been done in newer version of Qlik to alleviate this problem?