Qlik Replicate - Source - HIVE Db Issues

skokanay — Thu, 23 Feb 2023 17:13:14 GMT

The task fails due to the below fatal errors :- Diagnostic package is attached.

00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: Failed (retcode -1) to execute statement: 'SELECT `key`,`collections_customer_flags_attributes`,`audit_rec`,`cdc_flag`,`process_date` FROM `interfaces`.`coll_cust_flags_if_snap`' [1022502] (ar_odbc_stmt.c:2799)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: RetCode: SQL_ERROR SqlState: 42000 NativeError: 80 Message: [Cloudera][Hardy] (80) Syntax or semantic analysis error thrown in server while executing query. Error message from server: Error while compiling statement: FAILED: SemanticException [Error 10056]: Queries against partitioned tables without a partition filter are disabled for safety reasons. If you know what you are doing, please set hive.strict.checks.no.partition.filter to f [1022502] (ar_odbc_stmt.c:2805)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]I: Unload finished for table 'interfaces'.'coll_cust_flags_if_snap' (Id = 1). 0 rows sent. (streamcomponent.c:3690)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: ODBC source. Cannot init table workspace - '1022505' - for table 0 [1022505] (odbc_endpoint_unload.c:477)
00016991: 2023-02-24T03:46:54 [TARGET_LOAD ]I: Load finished for table 'interfaces'.'coll_cust_flags_if_snap' (Id = 1). 0 rows received. 0 rows skipped. Volume transferred 0. (streamcomponent.c:3974)
00016852: 2023-02-24T03:46:54 [TASK_MANAGER ]E: Table error occurred. Based on error behavior policy, task will stop. [1021705] (replicationtask.c:3113)
00016852: 2023-02-24T03:46:54 [TASK_MANAGER ]W: Task 'CRDHS_NP_TEST' encountered a fatal error (repository.c:5853)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: Error executing source loop [1022505] (streamcomponent.c:1917)
00016990: 2023-02-24T03:46:54 [TASK_MANAGER ]E: Stream component failed at subtask 1, component st_1_CRDHS_NP_TEST [1022505] (subtask.c:1396)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: Stream component 'st_1_CRDHS_NP_TEST' terminated [1022505] (subtask.c:1565)

Re: Qlik Replicate - Source - HIVE Db Issues

SwathiPulagam — Thu, 23 Feb 2023 17:21:26 GMT

Hi @skokanay ,

You got an exception from Hive. Please enable set hive.strict.checks.no.partition.filter to false on the Hive server and rerun the task.

Thanks,

Swathi

Re: Qlik Replicate - Source - HIVE Db Issues

skokanay — Thu, 23 Feb 2023 17:38:13 GMT

Hi swathi, thnal for the response. It soesnt need the config changes in HIVE server. The task need to be added with the filter condition i.e partitioned column and it worked.

Re: Qlik Replicate - Source - HIVE Db Issues

SwathiPulagam — Thu, 23 Feb 2023 17:47:52 GMT

@skokanay Thanks for the confirmation. Yes, one way to disable restriction on the Hive side(so we can run the same select without filter) or we need to add a partition filter.

Thanks,

Swathi

topic Re: Qlik Replicate - Source - HIVE Db Issues in Qlik Replicate

Qlik Replicate - Source - HIVE Db Issues

Re: Qlik Replicate - Source - HIVE Db Issues

Re: Qlik Replicate - Source - HIVE Db Issues

Re: Qlik Replicate - Source - HIVE Db Issues