Qlik Community

Qlik Brasil

Welcome to the group for Brazil users. .All discussions will be in Portuguese.

Highlighted
R7Rodrigues
New Contributor

Problema com carga de dados

Boa tarde,

Será que alguém poderia me ajudar?

Estou tentando criar um QVD importando dados de uma view "pesada" que tem muitos registros. Para melhorar a administração, estou criando um QVD para cada ano.

No entanto, a quantidade de registros que o QlikSense diz que importou é muito menor do que a quantidade de registros que há na view para aquele ano. Para se ter ideia, em um ano com 5 MI de registros o qlik apenas importou 100k registros.

Alguém já passou por isso?

Tags (1)
5 Replies
Employee
Employee

Re: Problema com carga de dados

R7Rodrigues
New Contributor

Re: Problema com carga de dados

Oi Cuv. Sou novo nisso, não sei se tem log ativado. Consegue me ajudar?

Employee
Employee

Re: Problema com carga de dados

Vai no QMC

Tasks

Acha a task que faz a recarga

Seleciona e usa o botão "Download Script Log"

Capturar.PNG

 

R7Rodrigues
New Contributor

Re: Problema com carga de dados

Obrigado pela ajuda.

Em anexo você tem o log, a imagem do código desenvolvido e a evidência do número de registros que tem na view que estou tentando carregar.

R7Rodrigues
New Contributor

Re: Problema com carga de dados

Não consegui upar o txt, então copiei e colei abaixo.

Repare na imagem que a consulta tem 61508257 registros, e o qlik apenas salvou 608.513

 

2018-12-12 19:25:26 Execution started.
2018-12-12 19:25:26 Qlik Sense Server Version 12.170.2
2018-12-12 19:25:26 CPU Target x64
2018-12-12 19:25:26 Operating System Windows Server 2012 R2 Standard (64 bit edition)
2018-12-12 19:25:26 Wow64 mode Not using Wow64
2018-12-12 19:25:26 Language 0409 English English
2018-12-12 19:25:26 Country USA United States United States
2018-12-12 19:25:26 MDAC Version 6.3.9600.16384
2018-12-12 19:25:26 MDAC Full Install Version 6.3.9600.16384
2018-12-12 19:25:26 PreferredCompression 2
2018-12-12 19:25:26 EnableParallelReload 1
2018-12-12 19:25:26 ParallelizeQvdLoads 1
2018-12-12 19:25:26 EnableFlushLog 0
2018-12-12 19:25:26 UserLogfileCharset 65001
2018-12-12 19:25:26 OdbcLoginTimeout -1
2018-12-12 19:25:26 OdbcConnectionTimeout -1
2018-12-12 19:25:26 LongestPossibleLine 1048576
2018-12-12 19:25:26 ScriptWantsDbWrite false
2018-12-12 19:25:26 ScriptWantsExe false
2018-12-12 19:25:26 ICU_FOR_CHARACTER_CLASSIFICATION true
2018-12-12 19:25:26 ICU_FOR_CODE_PAGES true
2018-12-12 19:25:26 ICU_FOR_COLLATION true
2018-12-12 19:25:26 ICU_FOR_LOCALE_INFO true
2018-12-12 19:25:26 ICU_FOR_SUPPORT_INFO true
2018-12-12 19:25:26 ICU_FOR_TIME_ZONE_INFO true
2018-12-12 19:25:26 LogFile CodePage Used: 65001
2018-12-12 19:25:26 UseMemoryFillPattern 1
2018-12-12 19:25:26 ScriptMode Standard (limits system access)
2018-12-12 19:25:26 SequentialThreadCount 14
2018-12-12 19:25:26 NumberOfCores (effective) 4
2018-12-12 19:25:26 ReloadCodebase Bnf
2018-12-12 19:25:27 Reload Executed By UserDirectory=INTERNAL; UserId=sa_scheduler
2018-12-12 19:25:27 Process Executing Qlik Sense Server
2018-12-12 19:25:27 Process ID 5536
2018-12-12 19:25:27 Grpc version 5.0.0
2018-12-12 19:25:27 Protobuf version 3.4.0
2018-12-12 19:25:27 0002 LIB CONNECT TO [bil]
2018-12-12 19:25:27 Connected.
2018-12-12 19:25:27 0004 Sub v_Dimensoes
2018-12-12 19:25:27 0150 LIB CONNECT TO 'bil'
2018-12-12 19:25:28 Connected.
2018-12-12 19:25:28 0152 FatoVenda:
2018-12-12 19:25:28 0153 LOAD TIPO_VENDA as %idTipoVenda,
2018-12-12 19:25:28 0154 DATA_TRANSACAO,
2018-12-12 19:25:28 0155 ID_CARTAO,
2018-12-12 19:25:28 0156 ID_SERVICO as %idServicoVenda,
2018-12-12 19:25:28 0157 ID_PRODUTO as %idProdutoVenda,
2018-12-12 19:25:28 0158 VALOR_PROMOCAO,
2018-12-12 19:25:28 0159 VALOR_RECARGA,
2018-12-12 19:25:28 0160 VALOR_CASCO,
2018-12-12 19:25:28 0161 VALOR_RECEBIDO,
2018-12-12 19:25:28 0162 NSU_SERVIDOR,
2018-12-12 19:25:28 0163 NSUHM,
2018-12-12 19:25:28 0164 RESPOSTA_HM,
2018-12-12 19:25:28 0165 ID_LOCAL as %idLocalVenda,
2018-12-12 19:25:28 0166 ID_TERMINAL as %idTerminalvenda,
2018-12-12 19:25:28 0167 ID_LINHASERVICO as %idLinhaServicoVenda,
2018-12-12 19:25:28 0168 ID_EMPRESA as %idEmpresaVenda,
2018-12-12 19:25:28 0169 SAM_TERMINAL,
2018-12-12 19:25:28 0170 ID_OPERADOR,
2018-12-12 19:25:28 0171 ID_PERFIL as %idPerfilVenda,
2018-12-12 19:25:28 0172 NSU_TERMINAL,
2018-12-12 19:25:28 0173 CONFIRMACAO_TERMINAL,
2018-12-12 19:25:28 0174 PAGAMENTO as %idFormaPagamentoVenda
2018-12-12 19:25:28 0175 SQL SELECT "TIPO_VENDA",
2018-12-12 19:25:28 0176 "DATA_TRANSACAO",
2018-12-12 19:25:28 0177 "ID_CARTAO",
2018-12-12 19:25:28 0178 "ID_SERVICO",
2018-12-12 19:25:28 0179 "ID_PRODUTO",
2018-12-12 19:25:28 0180 "VALOR_PROMOCAO",
2018-12-12 19:25:28 0181 "VALOR_RECARGA",
2018-12-12 19:25:28 0182 "VALOR_CASCO",
2018-12-12 19:25:28 0183 "VALOR_RECEBIDO",
2018-12-12 19:25:28 0184 "NSU_SERVIDOR",
2018-12-12 19:25:28 0185 "NSUHM",
2018-12-12 19:25:28 0186 "RESPOSTA_HM",
2018-12-12 19:25:28 0187 "ID_LOCAL",
2018-12-12 19:25:28 0188 "ID_TERMINAL",
2018-12-12 19:25:28 0189 "ID_LINHASERVICO",
2018-12-12 19:25:28 0190 "ID_EMPRESA",
2018-12-12 19:25:28 0191 "SAM_TERMINAL",
2018-12-12 19:25:28 0192 "ID_OPERADOR",
2018-12-12 19:25:28 0193 "ID_PERFIL",
2018-12-12 19:25:28 0194 "NSU_TERMINAL",
2018-12-12 19:25:28 0195 "CONFIRMACAO_TERMINAL",
2018-12-12 19:25:28 0196 "PAGAMENTO"
2018-12-12 19:25:28 0197 FROM "SBE"."VW_BI_FATO_VENDA"
2018-12-12 19:25:28 0198 WHERE "DATA_TRANSACAO" >= '01/01/2016' AND "DATA_TRANSACAO" < '01/01/2017'
2018-12-12 19:26:49 22 fields found: %idTipoVenda, DATA_TRANSACAO, ID_CARTAO, %idServicoVenda, %idProdutoVenda, VALOR_PROMOCAO, VALOR_RECARGA, VALOR_CASCO, VALOR_RECEBIDO, NSU_SERVIDOR, NSUHM, RESPOSTA_HM, %idLocalVenda, %idTerminalvenda, %idLinhaServicoVenda, %idEmpresaVenda, SAM_TERMINAL, ID_OPERADOR, %idPerfilVenda, NSU_TERMINAL, CONFIRMACAO_TERMINAL, %idFormaPagamentoVenda,
2018-12-12 19:26:49 608,513 lines fetched
2018-12-12 19:26:49 0200 Store FatoVenda into [lib://DATA/Vendas\fato_venda_2016.qvd]
2018-12-12 19:26:49 0201 Drop Table FatoVenda
2018-12-12 19:26:49 0204 SET ThousandSep='.'
2018-12-12 19:26:49 0205 SET DecimalSep=','
2018-12-12 19:26:49 0206 SET MoneyThousandSep='.'
2018-12-12 19:26:49 0207 SET MoneyDecimalSep=','
2018-12-12 19:26:49 0208 SET MoneyFormat='$#,##0.00;-$#,##0.00'
2018-12-12 19:26:49 0209 SET TimeFormat='h:mm:ss TT'
2018-12-12 19:26:49 0210 SET DateFormat='D/M/YYYY'
2018-12-12 19:26:49 0211 SET TimestampFormat='D/M/YYYY h:mm:ss[.fff] TT'
2018-12-12 19:26:49 0212 SET FirstWeekDay=6
2018-12-12 19:26:49 0213 SET BrokenWeeks=1
2018-12-12 19:26:49 0214 SET ReferenceDay=0
2018-12-12 19:26:49 0215 SET FirstMonthOfYear=1
2018-12-12 19:26:49 0216 SET CollationLocale='en-US'
2018-12-12 19:26:49 0217 SET CreateSearchIndexOnReload=1
2018-12-12 19:26:49 0218 SET MonthNames='jan;fev;mar;abr;mai;jun;jul;ago;set;out;nov;dez'
2018-12-12 19:26:49 0219 SET LongMonthNames='Janeiro;Fevereiro;Março;Abril;Maio;Junho;Julho;Agosto;Setembro;Outubro;Novembro;Dezembro'
2018-12-12 19:26:49 0220 SET DayNames='Seg;Ter;Qua;Qui;Sex;Sáb;Dom'
2018-12-12 19:26:49 0221 SET LongDayNames='Segunda;Terça;Quarta;Quinta;Sexta;Sábado;Domingo'
2018-12-12 19:26:49 0223 Call v_Dimensoes
2018-12-12 19:26:49 0008 TipoPagamento:
2018-12-12 19:26:49 0009 LOAD
2018-12-12 19:26:49 0010 NI_IDFORMAPAGTO as %tpPagamento,
2018-12-12 19:26:49 0011 VC_DESCRICAO as TipoPagamento
2018-12-12 19:26:49 0012 SQL SELECT "NI_IDFORMAPAGTO",
2018-12-12 19:26:49 0013 "VC_DESCRICAO"
2018-12-12 19:26:49 0014 FROM "SBE"."VW_BI_DIM_TIPO_PAGAMENTO"
2018-12-12 19:26:49 2 fields found: %tpPagamento, TipoPagamento,
2018-12-12 19:26:49 4 lines fetched
2018-12-12 19:26:49 0016 Store TipoPagamento into [lib://DATA/Vendas\TipoPagamento.qvd]
2018-12-12 19:26:49 0017 Drop Table TipoPagamento
2018-12-12 19:26:49 0021 TipoVenda:
2018-12-12 19:26:49 0022 LOAD
2018-12-12 19:26:49 0023 CODIGO_TIPO_VENDA as %tpVenda,
2018-12-12 19:26:49 0024 DESC_TIPO_VENDA as TipoVenda
2018-12-12 19:26:49 0025 SQL SELECT "CODIGO_TIPO_VENDA",
2018-12-12 19:26:49 0026 "DESC_TIPO_VENDA"
2018-12-12 19:26:49 0027 FROM "SBE"."VWBI_DM_TIPO_TRANSACAO_PDVATM"
2018-12-12 19:26:49 2 fields found: %tpVenda, TipoVenda,
2018-12-12 19:26:49 3 lines fetched
2018-12-12 19:26:49 0029 Store TipoVenda into [lib://DATA/Vendas\TipoVenda.qvd]
2018-12-12 19:26:49 0030 Drop Table TipoVenda
2018-12-12 19:26:49 0034 LinhaServico:
2018-12-12 19:26:49 0035 LOAD
2018-12-12 19:26:49 0036 NI_IDLINHASERVICO as %LinhaServico,
2018-12-12 19:26:49 0037 VC_DESCRICAO as Desc_Linha_Servico
2018-12-12 19:26:49 0038 SQL SELECT "NI_IDLINHASERVICO",
2018-12-12 19:26:49 0039 "VC_DESCRICAO"
2018-12-12 19:26:49 0040 FROM "SBE"."VWBI_DM_LINHASERVICO_MOED"
2018-12-12 19:26:49 2 fields found: %LinhaServico, Desc_Linha_Servico,
2018-12-12 19:26:49 176 lines fetched
2018-12-12 19:26:49 0042 Store LinhaServico into [lib://DATA/Vendas\LinhaServico.qvd]
2018-12-12 19:26:49 0043 Drop Table LinhaServico
2018-12-12 19:26:49 0047 Produto:
2018-12-12 19:26:49 0048 LOAD
2018-12-12 19:26:49 0049 NI_IDPRODUTO as %idProduto,
2018-12-12 19:26:49 0050 VC_DESCRICAO as Produto
2018-12-12 19:26:49 0051 SQL SELECT "NI_IDPRODUTO",
2018-12-12 19:26:49 0052 "VC_DESCRICAO"
2018-12-12 19:26:49 0053 FROM "SBE"."VWBI_DM_PRODUTOVENDA_MOED"
2018-12-12 19:26:49 2 fields found: %idProduto, Produto,
2018-12-12 19:26:49 88 lines fetched
2018-12-12 19:26:49 0055 Store Produto into [lib://DATA/Vendas\Produto.qvd]
2018-12-12 19:26:49 0056 Drop Table Produto
2018-12-12 19:26:49 0060 Perfil:
2018-12-12 19:26:49 0061 LOAD
2018-12-12 19:26:49 0062 NI_IDPERFIL as %idPerfil,
2018-12-12 19:26:49 0063 VC_DESCRICAO as Perfil
2018-12-12 19:26:49 0064 SQL SELECT "NI_IDPERFIL",
2018-12-12 19:26:49 0065 "VC_DESCRICAO"
2018-12-12 19:26:49 0066 FROM "SBE"."VWBI_DM_PERFIL_MOED"
2018-12-12 19:26:49 2 fields found: %idPerfil, Perfil,
2018-12-12 19:26:49 12 lines fetched
2018-12-12 19:26:49 0068 Store Perfil into [lib://DATA/Vendas\Perfil.qvd]
2018-12-12 19:26:49 0069 Drop Table Perfil
2018-12-12 19:26:49 0073 Linhas:
2018-12-12 19:26:49 0074 LOAD
2018-12-12 19:26:49 0075 NI_IDLINHA as %idLinha,
2018-12-12 19:26:49 0076 VC_DESCRICAO as Linha,
2018-12-12 19:26:49 0077 VC_SIGLA as SiglaLinha
2018-12-12 19:26:49 0078 SQL SELECT "NI_IDLINHA",
2018-12-12 19:26:49 0079 "VC_DESCRICAO",
2018-12-12 19:26:49 0080 "VC_SIGLA"
2018-12-12 19:26:49 0081 FROM "SBE"."VWBI_DM_LINHA_MOED"
2018-12-12 19:26:49 3 fields found: %idLinha, Linha, SiglaLinha,
2018-12-12 19:26:49 7 lines fetched
2018-12-12 19:26:49 0083 Store Linhas into [lib://DATA/Vendas\Linhas.qvd]
2018-12-12 19:26:49 0084 Drop Table Linhas
2018-12-12 19:26:49 0088 TipoTerminal:
2018-12-12 19:26:49 0089 LOAD
2018-12-12 19:26:49 0090 NI_IDMODELO as %idTipoTerminal,
2018-12-12 19:26:49 0091 VC_DESCRICAO as TipoTerminal
2018-12-12 19:26:49 0092 SQL SELECT "NI_IDMODELO",
2018-12-12 19:26:49 0093 "VC_DESCRICAO"
2018-12-12 19:26:49 0094 FROM "SBE"."VWBI_DM_TIPOTERMINAL_MOED"
2018-12-12 19:26:49 2 fields found: %idTipoTerminal, TipoTerminal,
2018-12-12 19:26:49 8 lines fetched
2018-12-12 19:26:49 0096 Store TipoTerminal into [lib://DATA/Vendas\TipoTerminal.qvd]
2018-12-12 19:26:49 0097 Drop Table TipoTerminal
2018-12-12 19:26:49 0101 Empresa:
2018-12-12 19:26:49 0102 LOAD
2018-12-12 19:26:49 0103 NI_IDEMPRESA as %idEmpresa,
2018-12-12 19:26:49 0104 VC_RAZAOSOCIAL as RazaoSocial,
2018-12-12 19:26:49 0105 VC_NOMEFANTASIA as Empresa
2018-12-12 19:26:49 0106 SQL SELECT "NI_IDEMPRESA",
2018-12-12 19:26:49 0107 "VC_RAZAOSOCIAL",
2018-12-12 19:26:49 0108 "VC_NOMEFANTASIA"
2018-12-12 19:26:49 0109 FROM "SBE"."VWBI_DM_EMPRESA_MOED"
2018-12-12 19:26:49 3 fields found: %idEmpresa, RazaoSocial, Empresa,
2018-12-12 19:26:49 3 lines fetched
2018-12-12 19:26:49 0111 Store Empresa into [lib://DATA/Vendas\Empresa.qvd]
2018-12-12 19:26:49 0112 Drop Table Empresa
2018-12-12 19:26:49 0115 PDV:
2018-12-12 19:26:49 0116 LOAD NI_IDTERMINAL as %idTerminal,
2018-12-12 19:26:49 0117 VC_DESCRICAO as PDV,
2018-12-12 19:26:49 0118 VC_ENDERECOIP as IpPDV,
2018-12-12 19:26:49 0119 NI_IDLOCAL as %idLocalPDV,
2018-12-12 19:26:49 0120 ID_EMPRESA as %idEmpresaPDV,
2018-12-12 19:26:49 0121 ID_LINHASERVICO as %idLinhaServicoPDV,
2018-12-12 19:26:49 0122 ID_MODELO as %idTipoPDV
2018-12-12 19:26:49 0124 SQL SELECT "NI_IDTERMINAL",
2018-12-12 19:26:49 0125 "VC_DESCRICAO",
2018-12-12 19:26:49 0126 "VC_ENDERECOIP",
2018-12-12 19:26:49 0127 "NI_IDLOCAL",
2018-12-12 19:26:49 0128 "ID_EMPRESA",
2018-12-12 19:26:49 0129 "ID_LINHASERVICO",
2018-12-12 19:26:49 0130 "ID_MODELO"
2018-12-12 19:26:49 0131 FROM "SBE"."VWBI_DM_PDV_MOED"
2018-12-12 19:26:50 7 fields found: %idTerminal, PDV, IpPDV, %idLocalPDV, %idEmpresaPDV, %idLinhaServicoPDV, %idTipoPDV,
2018-12-12 19:26:50 554 lines fetched
2018-12-12 19:26:50 0132 Store PDV into [lib://DATA/Vendas\PDV.qvd]
2018-12-12 19:26:50 0133 Drop Table PDV
2018-12-12 19:26:50 0136 Servico:
2018-12-12 19:26:50 0137 LOAD NI_VALOR as %idServico,
2018-12-12 19:26:50 0138 VC_DESCRICAO as Servico
2018-12-12 19:26:50 0139 SQL SELECT "NI_VALOR",
2018-12-12 19:26:50 0140 "VC_DESCRICAO"
2018-12-12 19:26:50 0141 FROM "SBE"."VW_BI_DIM_SERVICO"
2018-12-12 19:26:50 2 fields found: %idServico, Servico,
2018-12-12 19:26:50 11 lines fetched
2018-12-12 19:26:50 0142 Store Servico into [lib://DATA/Vendas\Servico.qvd]
2018-12-12 19:26:50 0143 Drop Table Servico
2018-12-12 19:26:50 0145 End Sub
2018-12-12 19:26:50 0225 exit Script
2018-12-12 19:26:50 Creating search index
2018-12-12 19:26:50 Search index creation completed successfully
2018-12-12 19:26:50 Execution finished.