Problema com carga de dados

[Anonymous]

Boa tarde,

Será que alguém poderia me ajudar?

Estou tentando criar um QVD importando dados de uma view "pesada" que tem muitos registros. Para melhorar a administração, estou criando um QVD para cada ano.

No entanto, a quantidade de registros que o QlikSense diz que importou é muito menor do que a quantidade de registros que há na view para aquele ano. Para se ter ideia, em um ano com 5 MI de registros o qlik apenas importou 100k registros.

Alguém já passou por isso?

[Clever_Anjos]

Pode anexar o log da sua execução?

https://community.qlik.com/t5/Qlik-Brasil/Como-obter-ajuda-Leia-antes-de-postar/gpm-p/1475104

[Anonymous]

Oi Cuv. Sou novo nisso, não sei se tem log ativado. Consegue me ajudar?

[Clever_Anjos]

Vai no QMC

Tasks

Acha a task que faz a recarga

Seleciona e usa o botão "Download Script Log"

[Anonymous]

Obrigado pela ajuda.

Em anexo você tem o log, a imagem do código desenvolvido e a evidência do número de registros que tem na view que estou tentando carregar.

[Anonymous]

Não consegui upar o txt, então copiei e colei abaixo.

Repare na imagem que a consulta tem 61508257 registros, e o qlik apenas salvou 608.513

2018-12-12 19:25:26 Execution started.
2018-12-12 19:25:26 Qlik Sense Server Version 12.170.2
2018-12-12 19:25:26 CPU Target x64
2018-12-12 19:25:26 Operating System Windows Server 2012 R2 Standard (64 bit edition)
2018-12-12 19:25:26 Wow64 mode Not using Wow64
2018-12-12 19:25:26 Language 0409 English English
2018-12-12 19:25:26 Country USA United States United States
2018-12-12 19:25:26 MDAC Version 6.3.9600.16384
2018-12-12 19:25:26 MDAC Full Install Version 6.3.9600.16384
2018-12-12 19:25:26 PreferredCompression 2
2018-12-12 19:25:26 EnableParallelReload 1
2018-12-12 19:25:26 ParallelizeQvdLoads 1
2018-12-12 19:25:26 EnableFlushLog 0
2018-12-12 19:25:26 UserLogfileCharset 65001
2018-12-12 19:25:26 OdbcLoginTimeout -1
2018-12-12 19:25:26 OdbcConnectionTimeout -1
2018-12-12 19:25:26 LongestPossibleLine 1048576
2018-12-12 19:25:26 ScriptWantsDbWrite false
2018-12-12 19:25:26 ScriptWantsExe false
2018-12-12 19:25:26 ICU_FOR_CHARACTER_CLASSIFICATION true
2018-12-12 19:25:26 ICU_FOR_CODE_PAGES true
2018-12-12 19:25:26 ICU_FOR_COLLATION true
2018-12-12 19:25:26 ICU_FOR_LOCALE_INFO true
2018-12-12 19:25:26 ICU_FOR_SUPPORT_INFO true
2018-12-12 19:25:26 ICU_FOR_TIME_ZONE_INFO true
2018-12-12 19:25:26 LogFile CodePage Used: 65001
2018-12-12 19:25:26 UseMemoryFillPattern 1
2018-12-12 19:25:26 ScriptMode Standard (limits system access)
2018-12-12 19:25:26 SequentialThreadCount 14
2018-12-12 19:25:26 NumberOfCores (effective) 4
2018-12-12 19:25:26 ReloadCodebase Bnf
2018-12-12 19:25:27 Reload Executed By UserDirectory=INTERNAL; UserId=sa_scheduler
2018-12-12 19:25:27 Process Executing Qlik Sense Server
2018-12-12 19:25:27 Process ID 5536
2018-12-12 19:25:27 Grpc version 5.0.0
2018-12-12 19:25:27 Protobuf version 3.4.0
2018-12-12 19:25:27 0002 LIB CONNECT TO [bil]
2018-12-12 19:25:27 Connected.
2018-12-12 19:25:27 0004 Sub v_Dimensoes
2018-12-12 19:25:27 0150 LIB CONNECT TO 'bil'
2018-12-12 19:25:28 Connected.
2018-12-12 19:25:28 0152 FatoVenda:
2018-12-12 19:25:28 0153 LOAD TIPO_VENDA as %idTipoVenda,
2018-12-12 19:25:28 0154 DATA_TRANSACAO,
2018-12-12 19:25:28 0155 ID_CARTAO,
2018-12-12 19:25:28 0156 ID_SERVICO as %idServicoVenda,
2018-12-12 19:25:28 0157 ID_PRODUTO as %idProdutoVenda,
2018-12-12 19:25:28 0158 VALOR_PROMOCAO,
2018-12-12 19:25:28 0159 VALOR_RECARGA,
2018-12-12 19:25:28 0160 VALOR_CASCO,
2018-12-12 19:25:28 0161 VALOR_RECEBIDO,
2018-12-12 19:25:28 0162 NSU_SERVIDOR,
2018-12-12 19:25:28 0163 NSUHM,
2018-12-12 19:25:28 0164 RESPOSTA_HM,
2018-12-12 19:25:28 0165 ID_LOCAL as %idLocalVenda,
2018-12-12 19:25:28 0166 ID_TERMINAL as %idTerminalvenda,
2018-12-12 19:25:28 0167 ID_LINHASERVICO as %idLinhaServicoVenda,
2018-12-12 19:25:28 0168 ID_EMPRESA as %idEmpresaVenda,
2018-12-12 19:25:28 0169 SAM_TERMINAL,
2018-12-12 19:25:28 0170 ID_OPERADOR,
2018-12-12 19:25:28 0171 ID_PERFIL as %idPerfilVenda,
2018-12-12 19:25:28 0172 NSU_TERMINAL,
2018-12-12 19:25:28 0173 CONFIRMACAO_TERMINAL,
2018-12-12 19:25:28 0174 PAGAMENTO as %idFormaPagamentoVenda
2018-12-12 19:25:28 0175 SQL SELECT "TIPO_VENDA",
2018-12-12 19:25:28 0176 "DATA_TRANSACAO",
2018-12-12 19:25:28 0177 "ID_CARTAO",
2018-12-12 19:25:28 0178 "ID_SERVICO",
2018-12-12 19:25:28 0179 "ID_PRODUTO",
2018-12-12 19:25:28 0180 "VALOR_PROMOCAO",
2018-12-12 19:25:28 0181 "VALOR_RECARGA",
2018-12-12 19:25:28 0182 "VALOR_CASCO",
2018-12-12 19:25:28 0183 "VALOR_RECEBIDO",
2018-12-12 19:25:28 0184 "NSU_SERVIDOR",
2018-12-12 19:25:28 0185 "NSUHM",
2018-12-12 19:25:28 0186 "RESPOSTA_HM",
2018-12-12 19:25:28 0187 "ID_LOCAL",
2018-12-12 19:25:28 0188 "ID_TERMINAL",
2018-12-12 19:25:28 0189 "ID_LINHASERVICO",
2018-12-12 19:25:28 0190 "ID_EMPRESA",
2018-12-12 19:25:28 0191 "SAM_TERMINAL",
2018-12-12 19:25:28 0192 "ID_OPERADOR",
2018-12-12 19:25:28 0193 "ID_PERFIL",
2018-12-12 19:25:28 0194 "NSU_TERMINAL",
2018-12-12 19:25:28 0195 "CONFIRMACAO_TERMINAL",
2018-12-12 19:25:28 0196 "PAGAMENTO"
2018-12-12 19:25:28 0197 FROM "SBE"."VW_BI_FATO_VENDA"
2018-12-12 19:25:28 0198 WHERE "DATA_TRANSACAO" >= '01/01/2016' AND "DATA_TRANSACAO" < '01/01/2017'
2018-12-12 19:26:49 22 fields found: %idTipoVenda, DATA_TRANSACAO, ID_CARTAO, %idServicoVenda, %idProdutoVenda, VALOR_PROMOCAO, VALOR_RECARGA, VALOR_CASCO, VALOR_RECEBIDO, NSU_SERVIDOR, NSUHM, RESPOSTA_HM, %idLocalVenda, %idTerminalvenda, %idLinhaServicoVenda, %idEmpresaVenda, SAM_TERMINAL, ID_OPERADOR, %idPerfilVenda, NSU_TERMINAL, CONFIRMACAO_TERMINAL, %idFormaPagamentoVenda,
2018-12-12 19:26:49 608,513 lines fetched
2018-12-12 19:26:49 0200 Store FatoVenda into [lib://DATA/Vendas\fato_venda_2016.qvd]
2018-12-12 19:26:49 0201 Drop Table FatoVenda
2018-12-12 19:26:49 0204 SET ThousandSep='.'
2018-12-12 19:26:49 0205 SET DecimalSep=','
2018-12-12 19:26:49 0206 SET MoneyThousandSep='.'
2018-12-12 19:26:49 0207 SET MoneyDecimalSep=','
2018-12-12 19:26:49 0208 SET MoneyFormat='$#,##0.00;-$#,##0.00'
2018-12-12 19:26:49 0209 SET TimeFormat='h:mm:ss TT'
2018-12-12 19:26:49 0210 SET DateFormat='D/M/YYYY'
2018-12-12 19:26:49 0211 SET TimestampFormat='D/M/YYYY h:mm:ss[.fff] TT'
2018-12-12 19:26:49 0212 SET FirstWeekDay=6
2018-12-12 19:26:49 0213 SET BrokenWeeks=1
2018-12-12 19:26:49 0214 SET ReferenceDay=0
2018-12-12 19:26:49 0215 SET FirstMonthOfYear=1
2018-12-12 19:26:49 0216 SET CollationLocale='en-US'
2018-12-12 19:26:49 0217 SET CreateSearchIndexOnReload=1
2018-12-12 19:26:49 0218 SET MonthNames='jan;fev;mar;abr;mai;jun;jul;ago;set;out;nov;dez'
2018-12-12 19:26:49 0219 SET LongMonthNames='Janeiro;Fevereiro;Março;Abril;Maio;Junho;Julho;Agosto;Setembro;Outubro;Novembro;Dezembro'
2018-12-12 19:26:49 0220 SET DayNames='Seg;Ter;Qua;Qui;Sex;Sáb;Dom'
2018-12-12 19:26:49 0221 SET LongDayNames='Segunda;Terça;Quarta;Quinta;Sexta;Sábado;Domingo'
2018-12-12 19:26:49 0223 Call v_Dimensoes
2018-12-12 19:26:49 0008 TipoPagamento:
2018-12-12 19:26:49 0009 LOAD
2018-12-12 19:26:49 0010 NI_IDFORMAPAGTO as %tpPagamento,
2018-12-12 19:26:49 0011 VC_DESCRICAO as TipoPagamento
2018-12-12 19:26:49 0012 SQL SELECT "NI_IDFORMAPAGTO",
2018-12-12 19:26:49 0013 "VC_DESCRICAO"
2018-12-12 19:26:49 0014 FROM "SBE"."VW_BI_DIM_TIPO_PAGAMENTO"
2018-12-12 19:26:49 2 fields found: %tpPagamento, TipoPagamento,
2018-12-12 19:26:49 4 lines fetched
2018-12-12 19:26:49 0016 Store TipoPagamento into [lib://DATA/Vendas\TipoPagamento.qvd]
2018-12-12 19:26:49 0017 Drop Table TipoPagamento
2018-12-12 19:26:49 0021 TipoVenda:
2018-12-12 19:26:49 0022 LOAD
2018-12-12 19:26:49 0023 CODIGO_TIPO_VENDA as %tpVenda,
2018-12-12 19:26:49 0024 DESC_TIPO_VENDA as TipoVenda
2018-12-12 19:26:49 0025 SQL SELECT "CODIGO_TIPO_VENDA",
2018-12-12 19:26:49 0026 "DESC_TIPO_VENDA"
2018-12-12 19:26:49 0027 FROM "SBE"."VWBI_DM_TIPO_TRANSACAO_PDVATM"
2018-12-12 19:26:49 2 fields found: %tpVenda, TipoVenda,
2018-12-12 19:26:49 3 lines fetched
2018-12-12 19:26:49 0029 Store TipoVenda into [lib://DATA/Vendas\TipoVenda.qvd]
2018-12-12 19:26:49 0030 Drop Table TipoVenda
2018-12-12 19:26:49 0034 LinhaServico:
2018-12-12 19:26:49 0035 LOAD
2018-12-12 19:26:49 0036 NI_IDLINHASERVICO as %LinhaServico,
2018-12-12 19:26:49 0037 VC_DESCRICAO as Desc_Linha_Servico
2018-12-12 19:26:49 0038 SQL SELECT "NI_IDLINHASERVICO",
2018-12-12 19:26:49 0039 "VC_DESCRICAO"
2018-12-12 19:26:49 0040 FROM "SBE"."VWBI_DM_LINHASERVICO_MOED"
2018-12-12 19:26:49 2 fields found: %LinhaServico, Desc_Linha_Servico,
2018-12-12 19:26:49 176 lines fetched
2018-12-12 19:26:49 0042 Store LinhaServico into [lib://DATA/Vendas\LinhaServico.qvd]
2018-12-12 19:26:49 0043 Drop Table LinhaServico
2018-12-12 19:26:49 0047 Produto:
2018-12-12 19:26:49 0048 LOAD
2018-12-12 19:26:49 0049 NI_IDPRODUTO as %idProduto,
2018-12-12 19:26:49 0050 VC_DESCRICAO as Produto
2018-12-12 19:26:49 0051 SQL SELECT "NI_IDPRODUTO",
2018-12-12 19:26:49 0052 "VC_DESCRICAO"
2018-12-12 19:26:49 0053 FROM "SBE"."VWBI_DM_PRODUTOVENDA_MOED"
2018-12-12 19:26:49 2 fields found: %idProduto, Produto,
2018-12-12 19:26:49 88 lines fetched
2018-12-12 19:26:49 0055 Store Produto into [lib://DATA/Vendas\Produto.qvd]
2018-12-12 19:26:49 0056 Drop Table Produto
2018-12-12 19:26:49 0060 Perfil:
2018-12-12 19:26:49 0061 LOAD
2018-12-12 19:26:49 0062 NI_IDPERFIL as %idPerfil,
2018-12-12 19:26:49 0063 VC_DESCRICAO as Perfil
2018-12-12 19:26:49 0064 SQL SELECT "NI_IDPERFIL",
2018-12-12 19:26:49 0065 "VC_DESCRICAO"
2018-12-12 19:26:49 0066 FROM "SBE"."VWBI_DM_PERFIL_MOED"
2018-12-12 19:26:49 2 fields found: %idPerfil, Perfil,
2018-12-12 19:26:49 12 lines fetched
2018-12-12 19:26:49 0068 Store Perfil into [lib://DATA/Vendas\Perfil.qvd]
2018-12-12 19:26:49 0069 Drop Table Perfil
2018-12-12 19:26:49 0073 Linhas:
2018-12-12 19:26:49 0074 LOAD
2018-12-12 19:26:49 0075 NI_IDLINHA as %idLinha,
2018-12-12 19:26:49 0076 VC_DESCRICAO as Linha,
2018-12-12 19:26:49 0077 VC_SIGLA as SiglaLinha
2018-12-12 19:26:49 0078 SQL SELECT "NI_IDLINHA",
2018-12-12 19:26:49 0079 "VC_DESCRICAO",
2018-12-12 19:26:49 0080 "VC_SIGLA"
2018-12-12 19:26:49 0081 FROM "SBE"."VWBI_DM_LINHA_MOED"
2018-12-12 19:26:49 3 fields found: %idLinha, Linha, SiglaLinha,
2018-12-12 19:26:49 7 lines fetched
2018-12-12 19:26:49 0083 Store Linhas into [lib://DATA/Vendas\Linhas.qvd]
2018-12-12 19:26:49 0084 Drop Table Linhas
2018-12-12 19:26:49 0088 TipoTerminal:
2018-12-12 19:26:49 0089 LOAD
2018-12-12 19:26:49 0090 NI_IDMODELO as %idTipoTerminal,
2018-12-12 19:26:49 0091 VC_DESCRICAO as TipoTerminal
2018-12-12 19:26:49 0092 SQL SELECT "NI_IDMODELO",
2018-12-12 19:26:49 0093 "VC_DESCRICAO"
2018-12-12 19:26:49 0094 FROM "SBE"."VWBI_DM_TIPOTERMINAL_MOED"
2018-12-12 19:26:49 2 fields found: %idTipoTerminal, TipoTerminal,
2018-12-12 19:26:49 8 lines fetched
2018-12-12 19:26:49 0096 Store TipoTerminal into [lib://DATA/Vendas\TipoTerminal.qvd]
2018-12-12 19:26:49 0097 Drop Table TipoTerminal
2018-12-12 19:26:49 0101 Empresa:
2018-12-12 19:26:49 0102 LOAD
2018-12-12 19:26:49 0103 NI_IDEMPRESA as %idEmpresa,
2018-12-12 19:26:49 0104 VC_RAZAOSOCIAL as RazaoSocial,
2018-12-12 19:26:49 0105 VC_NOMEFANTASIA as Empresa
2018-12-12 19:26:49 0106 SQL SELECT "NI_IDEMPRESA",
2018-12-12 19:26:49 0107 "VC_RAZAOSOCIAL",
2018-12-12 19:26:49 0108 "VC_NOMEFANTASIA"
2018-12-12 19:26:49 0109 FROM "SBE"."VWBI_DM_EMPRESA_MOED"
2018-12-12 19:26:49 3 fields found: %idEmpresa, RazaoSocial, Empresa,
2018-12-12 19:26:49 3 lines fetched
2018-12-12 19:26:49 0111 Store Empresa into [lib://DATA/Vendas\Empresa.qvd]
2018-12-12 19:26:49 0112 Drop Table Empresa
2018-12-12 19:26:49 0115 PDV:
2018-12-12 19:26:49 0116 LOAD NI_IDTERMINAL as %idTerminal,
2018-12-12 19:26:49 0117 VC_DESCRICAO as PDV,
2018-12-12 19:26:49 0118 VC_ENDERECOIP as IpPDV,
2018-12-12 19:26:49 0119 NI_IDLOCAL as %idLocalPDV,
2018-12-12 19:26:49 0120 ID_EMPRESA as %idEmpresaPDV,
2018-12-12 19:26:49 0121 ID_LINHASERVICO as %idLinhaServicoPDV,
2018-12-12 19:26:49 0122 ID_MODELO as %idTipoPDV
2018-12-12 19:26:49 0124 SQL SELECT "NI_IDTERMINAL",
2018-12-12 19:26:49 0125 "VC_DESCRICAO",
2018-12-12 19:26:49 0126 "VC_ENDERECOIP",
2018-12-12 19:26:49 0127 "NI_IDLOCAL",
2018-12-12 19:26:49 0128 "ID_EMPRESA",
2018-12-12 19:26:49 0129 "ID_LINHASERVICO",
2018-12-12 19:26:49 0130 "ID_MODELO"
2018-12-12 19:26:49 0131 FROM "SBE"."VWBI_DM_PDV_MOED"
2018-12-12 19:26:50 7 fields found: %idTerminal, PDV, IpPDV, %idLocalPDV, %idEmpresaPDV, %idLinhaServicoPDV, %idTipoPDV,
2018-12-12 19:26:50 554 lines fetched
2018-12-12 19:26:50 0132 Store PDV into [lib://DATA/Vendas\PDV.qvd]
2018-12-12 19:26:50 0133 Drop Table PDV
2018-12-12 19:26:50 0136 Servico:
2018-12-12 19:26:50 0137 LOAD NI_VALOR as %idServico,
2018-12-12 19:26:50 0138 VC_DESCRICAO as Servico
2018-12-12 19:26:50 0139 SQL SELECT "NI_VALOR",
2018-12-12 19:26:50 0140 "VC_DESCRICAO"
2018-12-12 19:26:50 0141 FROM "SBE"."VW_BI_DIM_SERVICO"
2018-12-12 19:26:50 2 fields found: %idServico, Servico,
2018-12-12 19:26:50 11 lines fetched
2018-12-12 19:26:50 0142 Store Servico into [lib://DATA/Vendas\Servico.qvd]
2018-12-12 19:26:50 0143 Drop Table Servico
2018-12-12 19:26:50 0145 End Sub
2018-12-12 19:26:50 0225 exit Script
2018-12-12 19:26:50 Creating search index
2018-12-12 19:26:50 Search index creation completed successfully
2018-12-12 19:26:50 Execution finished.